[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:14:07 dist-test-slave-mvvj krb5kdc[11268](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:14:07 dist-test-slave-mvvj krb5kdc[11268](info): set up 2 sockets
Aug 06 09:14:07 dist-test-slave-mvvj krb5kdc[11268](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260806 09:14:08.749975 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.004s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:14:08 dist-test-slave-mvvj krb5kdc[11268](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:14:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:14:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:14:08.965875 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:38175
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:38175
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:09.442832 11281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:09.443261 11281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:09.443444 11281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:09.452086 11281 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:14:09.452252 11281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:09.452364 11281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:09.452474 11281 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:14:09.452538 11281 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:14:09.469026 11281 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:38175
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:38175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:09.471493 11281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:09.473809 11281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:09.508852 11287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:09.509258 11286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:09.509397 11289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:09.510567 11281 server_base.cc:1034] running on GCE node
I20260806 09:14:09.512033 11281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:09.514863 11281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:09.518368 11281 hybrid_clock.cc:648] HybridClock initialized: now 1786007649518255 us; error 120 us; skew 500 ppm
I20260806 09:14:09.519280 11281 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:09 dist-test-slave-mvvj krb5kdc[11268](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007649, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:09.528038 11281 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:14:09.531203 11281 webserver.cc:460] Webserver started at http://127.10.255.126:45645/ using document root <none> and password file <none>
I20260806 09:14:09.532524 11281 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:09.532723 11281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:09.533553 11281 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:09.539232 11281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "7b981149274943868ec08b854b6a947d"
format_stamp: "Formatted at 2026-08-06 09:14:09 on dist-test-slave-mvvj"
server_key: "924f8712157d09081dde04bc17a062f7"
server_key_iv: "c570de939927a584773c3989afd2c22d"
server_key_version: "encryptionkey@0"
I20260806 09:14:09.540899 11281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "7b981149274943868ec08b854b6a947d"
format_stamp: "Formatted at 2026-08-06 09:14:09 on dist-test-slave-mvvj"
server_key: "924f8712157d09081dde04bc17a062f7"
server_key_iv: "c570de939927a584773c3989afd2c22d"
server_key_version: "encryptionkey@0"
I20260806 09:14:09.550576 11281 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.004s sys 0.004s
I20260806 09:14:09.557531 11296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:09.560081 11281 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.006s sys 0.000s
I20260806 09:14:09.560488 11281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "7b981149274943868ec08b854b6a947d"
format_stamp: "Formatted at 2026-08-06 09:14:09 on dist-test-slave-mvvj"
server_key: "924f8712157d09081dde04bc17a062f7"
server_key_iv: "c570de939927a584773c3989afd2c22d"
server_key_version: "encryptionkey@0"
I20260806 09:14:09.560737 11281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:09.584726 11281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:09.591444 11281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:09.591913 11281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:09.624404 11347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:38175 every 8 connection(s)
I20260806 09:14:09.624444 11281 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:38175
I20260806 09:14:09.627434 11281 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:14:09.633733 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 11281
I20260806 09:14:09.634296 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:14:09.637225 11348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:09.638491 11261 external_mini_cluster.cc:1428] Setting key b865ad383f57232237f42e963d8a48dd
I20260806 09:14:09.661270 11348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b981149274943868ec08b854b6a947d: Bootstrap starting.
I20260806 09:14:09.668821 11348 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b981149274943868ec08b854b6a947d: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:09.671100 11348 log.cc:824] T 00000000000000000000000000000000 P 7b981149274943868ec08b854b6a947d: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:09.677560 11348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b981149274943868ec08b854b6a947d: No bootstrap required, opened a new log
Aug 06 09:14:09 dist-test-slave-mvvj krb5kdc[11268](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:09.690691 11348 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b981149274943868ec08b854b6a947d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b981149274943868ec08b854b6a947d" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 38175 } }
I20260806 09:14:09.691424 11348 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b981149274943868ec08b854b6a947d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:09.691671 11348 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b981149274943868ec08b854b6a947d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b981149274943868ec08b854b6a947d, State: Initialized, Role: FOLLOWER
I20260806 09:14:09.692994 11348 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b981149274943868ec08b854b6a947d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b981149274943868ec08b854b6a947d" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 38175 } }
I20260806 09:14:09.693615 11348 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7b981149274943868ec08b854b6a947d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:14:09.693979 11348 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b981149274943868ec08b854b6a947d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:14:09.694308 11348 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b981149274943868ec08b854b6a947d [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:09.698043 11351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:09.649256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36194 (local address 127.10.255.126:38175)
0806 09:14:09.650448 (+ 1192us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:09.650467 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:09.650553 (+ 86us) server_negotiation.cc:407] Connection header received
0806 09:14:09.661075 (+ 10522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:09.661109 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:09.662069 (+ 960us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:09.662844 (+ 775us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:09.666701 (+ 3857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:09.669672 (+ 2971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:09.673059 (+ 3387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:09.674395 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:09.674892 (+ 497us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:09.683107 (+ 8215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:09.683194 (+ 87us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:09.683250 (+ 56us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:09.683332 (+ 82us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:09.688869 (+ 5537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:09.690222 (+ 1353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:09.690232 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:09.690239 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:09.690605 (+ 366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:09.691519 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:09.691526 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:09.691530 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:09.692690 (+ 1160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:09.693258 (+ 568us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:09.694464 (+ 1206us) server_negotiation.cc:299] Negotiation successful
0806 09:14:09.695014 (+ 550us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":836,"thread_start_us":539,"threads_started":1}
I20260806 09:14:09.698680 11348 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b981149274943868ec08b854b6a947d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b981149274943868ec08b854b6a947d" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 38175 } }
I20260806 09:14:09.700536 11348 leader_election.cc:302] T 00000000000000000000000000000000 P 7b981149274943868ec08b854b6a947d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b981149274943868ec08b854b6a947d; no voters:
I20260806 09:14:09.702301 11348 leader_election.cc:288] T 00000000000000000000000000000000 P 7b981149274943868ec08b854b6a947d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:14:09.703109 11353 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b981149274943868ec08b854b6a947d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:14:09.705554 11353 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b981149274943868ec08b854b6a947d [term 1 LEADER]: Becoming Leader. State: Replica: 7b981149274943868ec08b854b6a947d, State: Running, Role: LEADER
I20260806 09:14:09.707387 11348 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b981149274943868ec08b854b6a947d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:14:09.707321 11353 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b981149274943868ec08b854b6a947d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b981149274943868ec08b854b6a947d" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 38175 } }
I20260806 09:14:09.715762 11354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b981149274943868ec08b854b6a947d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7b981149274943868ec08b854b6a947d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b981149274943868ec08b854b6a947d" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 38175 } } }
I20260806 09:14:09.715631 11355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b981149274943868ec08b854b6a947d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b981149274943868ec08b854b6a947d. Latest consensus state: current_term: 1 leader_uuid: "7b981149274943868ec08b854b6a947d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b981149274943868ec08b854b6a947d" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 38175 } } }
I20260806 09:14:09.717165 11354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b981149274943868ec08b854b6a947d [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:09.717190 11355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b981149274943868ec08b854b6a947d [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:09.719151 11361 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:14:09.731662 11361 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:14:09.751276 11361 catalog_manager.cc:1347] Generated new cluster ID: df748bc7a9b644fa96af368f812fee3b
I20260806 09:14:09.751514 11361 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:14:09.770597 11361 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:14:09.773036 11361 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:14:09.783169 11361 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b981149274943868ec08b854b6a947d: Generated new TSK 0
I20260806 09:14:09.785255 11361 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.255.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
I20260806 09:14:09.866345 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:38175
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:10.292878 11374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:10.293264 11374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:10.293448 11374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:10.301766 11374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:10.301975 11374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:10.302181 11374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:14:10.315558 11374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:38175
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:10.317322 11374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:10.319126 11374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:10.338057 11380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:10.338092 11379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:10.338737 11382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:10.339145 11374 server_base.cc:1034] running on GCE node
I20260806 09:14:10.340052 11374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:10.341254 11374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:10.342547 11374 hybrid_clock.cc:648] HybridClock initialized: now 1786007650342498 us; error 108 us; skew 500 ppm
I20260806 09:14:10.342936 11374 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:10 dist-test-slave-mvvj krb5kdc[11268](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007650, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:10.346632 11374 init.cc:377] Logged in from keytab as kudu/127.10.255.65@KRBTEST.COM (short username kudu)
I20260806 09:14:10.348393 11374 webserver.cc:460] Webserver started at http://127.10.255.65:42239/ using document root <none> and password file <none>
I20260806 09:14:10.349138 11374 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:10.349248 11374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:10.349555 11374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:10.352960 11374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "64c9e45398134c39b073cac8310303f6"
format_stamp: "Formatted at 2026-08-06 09:14:10 on dist-test-slave-mvvj"
server_key: "fd216c019de4976595d528d2ed4b75fb"
server_key_iv: "b08f0a3255c378ad4864af3b0521056d"
server_key_version: "encryptionkey@0"
I20260806 09:14:10.353971 11374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "64c9e45398134c39b073cac8310303f6"
format_stamp: "Formatted at 2026-08-06 09:14:10 on dist-test-slave-mvvj"
server_key: "fd216c019de4976595d528d2ed4b75fb"
server_key_iv: "b08f0a3255c378ad4864af3b0521056d"
server_key_version: "encryptionkey@0"
I20260806 09:14:10.360230 11374 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 09:14:10.364449 11390 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:10.366253 11374 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 09:14:10.366460 11374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "64c9e45398134c39b073cac8310303f6"
format_stamp: "Formatted at 2026-08-06 09:14:10 on dist-test-slave-mvvj"
server_key: "fd216c019de4976595d528d2ed4b75fb"
server_key_iv: "b08f0a3255c378ad4864af3b0521056d"
server_key_version: "encryptionkey@0"
I20260806 09:14:10.366699 11374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:10.395251 11374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:10.400753 11374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:10.401111 11374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:10.402313 11374 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:14:10.404260 11374 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:10.404340 11374 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:10.404628 11374 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:10.404732 11374 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:10.464748 11374 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:40331
I20260806 09:14:10.464808 11502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:40331 every 8 connection(s)
I20260806 09:14:10.466681 11374 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:14:10.473587 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 11374
I20260806 09:14:10.473877 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:14:10.474596 11261 external_mini_cluster.cc:1428] Setting key d70b462bb7cebd4fbfff02f8c7615fd1
Aug 06 09:14:10 dist-test-slave-mvvj krb5kdc[11268](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007650, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.255.66@KRBTEST.COM; defaulting to no policy
I20260806 09:14:10.496495 11505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:10.471680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:60893 (local address 127.10.255.126:38175)
0806 09:14:10.472547 (+ 867us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:10.472588 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:10.473879 (+ 1291us) server_negotiation.cc:407] Connection header received
0806 09:14:10.477183 (+ 3304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:10.477188 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:10.477286 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:10.477407 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:10.479588 (+ 2181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:10.480576 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:10.482614 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:10.483231 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:10.483404 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:10.488851 (+ 5447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:10.488858 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:10.488861 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:10.488901 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:10.492694 (+ 3793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:10.493626 (+ 932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:10.493632 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:10.493642 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:10.493834 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:10.494349 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:10.494355 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:10.494359 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:10.494715 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:10.494902 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:10.495774 (+ 872us) server_negotiation.cc:299] Negotiation successful
0806 09:14:10.496083 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":733,"thread_start_us":571,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.66@KRBTEST.COM" created.
I20260806 09:14:10.497808 11506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:10.472479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:38175 (local address 127.10.255.65:60893)
0806 09:14:10.473658 (+ 1179us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:10.473728 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:10.476881 (+ 3153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:10.477738 (+ 857us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:10.477748 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:10.478469 (+ 721us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:10.479341 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:10.479362 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:10.480748 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:10.480759 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:10.482430 (+ 1671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:10.482444 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:10.483596 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:10.483606 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:10.484000 (+ 394us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:10.484990 (+ 990us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:10.485016 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:10.488521 (+ 3505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:10.492896 (+ 4375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:10.492908 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:10.492931 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:10.493468 (+ 537us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:10.493969 (+ 501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:10.493974 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:10.493978 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:10.494218 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:10.494874 (+ 656us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:10.494883 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:10.495307 (+ 424us) client_negotiation.cc:769] Sending connection context
0806 09:14:10.495683 (+ 376us) client_negotiation.cc:240] Negotiation successful
0806 09:14:10.496421 (+ 738us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":875,"thread_start_us":541,"threads_started":1}
I20260806 09:14:10.500276 11503 heartbeater.cc:347] Connected to a master server at 127.10.255.126:38175
I20260806 09:14:10.500901 11503 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:10.501955 11503 heartbeater.cc:511] Master 127.10.255.126:38175 requested a full tablet report, sending...
I20260806 09:14:10.506821 11313 ts_manager.cc:194] Registered new tserver with Master: 64c9e45398134c39b073cac8310303f6 (127.10.255.65:40331)
I20260806 09:14:10.509331 11313 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.65@KRBTEST.COM'} at 127.10.255.65:60893
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
I20260806 09:14:10.524973 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:38175
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:11.020609 11509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:11.021031 11509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:11.021173 11509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:11.032059 11509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:11.032274 11509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:11.032465 11509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:14:11.045742 11509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:38175
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:11.047318 11509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:11.049103 11509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:11.068150 11514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:11.068426 11517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:11.068286 11515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:11.070930 11509 server_base.cc:1034] running on GCE node
I20260806 09:14:11.072041 11509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:11.073520 11509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:11.074826 11509 hybrid_clock.cc:648] HybridClock initialized: now 1786007651074707 us; error 63 us; skew 500 ppm
I20260806 09:14:11.075310 11509 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:11 dist-test-slave-mvvj krb5kdc[11268](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007651, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:11.080190 11509 init.cc:377] Logged in from keytab as kudu/127.10.255.66@KRBTEST.COM (short username kudu)
I20260806 09:14:11.082651 11509 webserver.cc:460] Webserver started at http://127.10.255.66:43437/ using document root <none> and password file <none>
I20260806 09:14:11.083783 11509 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:11.084084 11509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:11.084564 11509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:11.088780 11509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "c7e3cd35b1c149e0ae545e1e7c108b33"
format_stamp: "Formatted at 2026-08-06 09:14:11 on dist-test-slave-mvvj"
server_key: "3702fb737249aea0275e4a6e7f969157"
server_key_iv: "89823e74cb96539845188067db35c950"
server_key_version: "encryptionkey@0"
I20260806 09:14:11.089952 11509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "c7e3cd35b1c149e0ae545e1e7c108b33"
format_stamp: "Formatted at 2026-08-06 09:14:11 on dist-test-slave-mvvj"
server_key: "3702fb737249aea0275e4a6e7f969157"
server_key_iv: "89823e74cb96539845188067db35c950"
server_key_version: "encryptionkey@0"
I20260806 09:14:11.097739 11509 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.005s
I20260806 09:14:11.103354 11524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:11.105336 11509 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:14:11.105675 11509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "c7e3cd35b1c149e0ae545e1e7c108b33"
format_stamp: "Formatted at 2026-08-06 09:14:11 on dist-test-slave-mvvj"
server_key: "3702fb737249aea0275e4a6e7f969157"
server_key_iv: "89823e74cb96539845188067db35c950"
server_key_version: "encryptionkey@0"
I20260806 09:14:11.106040 11509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:11.134339 11509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:11.140767 11509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:11.141247 11509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:11.142869 11509 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:14:11.145064 11509 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:11.145274 11509 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:11.145651 11509 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:11.145892 11509 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:11.238533 11509 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:45355
I20260806 09:14:11.238808 11636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:45355 every 8 connection(s)
I20260806 09:14:11.240339 11509 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:14:11.242419 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 11509
I20260806 09:14:11.242887 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:14:11.243656 11261 external_mini_cluster.cc:1428] Setting key 1d28d1595863848a0d74604455bcbb7d
Aug 06 09:14:11 dist-test-slave-mvvj krb5kdc[11268](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007651, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.255.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.67@KRBTEST.COM" created.
I20260806 09:14:11.273638 11639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:11.244898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:35529 (local address 127.10.255.126:38175)
0806 09:14:11.245949 (+ 1051us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:11.245955 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:11.247624 (+ 1669us) server_negotiation.cc:407] Connection header received
0806 09:14:11.251056 (+ 3432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:11.251066 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:11.251169 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:11.251296 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:11.254503 (+ 3207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:11.255968 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:11.258627 (+ 2659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:11.259736 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:11.259947 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:11.265172 (+ 5225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:11.265178 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:11.265182 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:11.265221 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:11.269554 (+ 4333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:11.270580 (+ 1026us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:11.270589 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:11.270596 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:11.270828 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:11.271391 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:11.271399 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:11.271405 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:11.271945 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:11.272111 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:11.272968 (+ 857us) server_negotiation.cc:299] Negotiation successful
0806 09:14:11.273263 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":916,"thread_start_us":757,"threads_started":1}
I20260806 09:14:11.274919 11640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:11.245548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:38175 (local address 127.10.255.66:35529)
0806 09:14:11.247258 (+ 1710us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:11.247319 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:11.250698 (+ 3379us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:11.251612 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:11.251622 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:11.252505 (+ 883us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:11.254181 (+ 1676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:11.254238 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:11.256214 (+ 1976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:11.256219 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:11.258385 (+ 2166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:11.258410 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:11.260128 (+ 1718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:11.260136 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:11.260575 (+ 439us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:11.261461 (+ 886us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:11.261509 (+ 48us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:11.264745 (+ 3236us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:11.269806 (+ 5061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:11.269817 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:11.269848 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:11.270350 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:11.271006 (+ 656us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:11.271010 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:11.271012 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:11.271248 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:11.272129 (+ 881us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:11.272135 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:11.272520 (+ 385us) client_negotiation.cc:769] Sending connection context
0806 09:14:11.272798 (+ 278us) client_negotiation.cc:240] Negotiation successful
0806 09:14:11.273241 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1316,"thread_start_us":959,"threads_started":1}
I20260806 09:14:11.276669 11637 heartbeater.cc:347] Connected to a master server at 127.10.255.126:38175
I20260806 09:14:11.277088 11637 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:11.278053 11637 heartbeater.cc:511] Master 127.10.255.126:38175 requested a full tablet report, sending...
I20260806 09:14:11.280282 11313 ts_manager.cc:194] Registered new tserver with Master: c7e3cd35b1c149e0ae545e1e7c108b33 (127.10.255.66:45355)
I20260806 09:14:11.281441 11313 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.66@KRBTEST.COM'} at 127.10.255.66:35529
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
I20260806 09:14:11.296676 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:38175
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:14:11.514015 11503 heartbeater.cc:503] Master 127.10.255.126:38175 was elected leader, sending a full tablet report...
W20260806 09:14:11.751485 11643 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:11.751878 11643 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:11.752049 11643 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:11.760236 11643 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:11.760371 11643 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:11.760562 11643 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:14:11.771713 11643 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:38175
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:11.773183 11643 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:11.774591 11643 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:11.791242 11651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:11.791311 11648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:11.791329 11649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:11.792480 11643 server_base.cc:1034] running on GCE node
I20260806 09:14:11.793282 11643 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:11.794446 11643 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:11.795720 11643 hybrid_clock.cc:648] HybridClock initialized: now 1786007651795635 us; error 68 us; skew 500 ppm
I20260806 09:14:11.796262 11643 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:11 dist-test-slave-mvvj krb5kdc[11268](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007651, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:11.800316 11643 init.cc:377] Logged in from keytab as kudu/127.10.255.67@KRBTEST.COM (short username kudu)
I20260806 09:14:11.802152 11643 webserver.cc:460] Webserver started at http://127.10.255.67:40701/ using document root <none> and password file <none>
I20260806 09:14:11.802942 11643 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:11.803103 11643 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:11.803443 11643 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:11.806788 11643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "19ef6fbe58f64d26b2adf6e7f657c10e"
format_stamp: "Formatted at 2026-08-06 09:14:11 on dist-test-slave-mvvj"
server_key: "d879626300b277c7e304a61515d3faa5"
server_key_iv: "d706e3fc70882e8b28f254b385d3eccf"
server_key_version: "encryptionkey@0"
I20260806 09:14:11.807719 11643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "19ef6fbe58f64d26b2adf6e7f657c10e"
format_stamp: "Formatted at 2026-08-06 09:14:11 on dist-test-slave-mvvj"
server_key: "d879626300b277c7e304a61515d3faa5"
server_key_iv: "d706e3fc70882e8b28f254b385d3eccf"
server_key_version: "encryptionkey@0"
I20260806 09:14:11.814604 11643 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260806 09:14:11.819628 11658 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:11.821419 11643 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 09:14:11.821659 11643 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "19ef6fbe58f64d26b2adf6e7f657c10e"
format_stamp: "Formatted at 2026-08-06 09:14:11 on dist-test-slave-mvvj"
server_key: "d879626300b277c7e304a61515d3faa5"
server_key_iv: "d706e3fc70882e8b28f254b385d3eccf"
server_key_version: "encryptionkey@0"
I20260806 09:14:11.821940 11643 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:11.847097 11643 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:11.852710 11643 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:11.853096 11643 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:11.854478 11643 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:14:11.856359 11643 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:11.856578 11643 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:11.856820 11643 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:11.856909 11643 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:11.907084 11643 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:39457
I20260806 09:14:11.907135 11771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:39457 every 8 connection(s)
I20260806 09:14:11.908902 11643 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:14:11.911788 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 11643
I20260806 09:14:11.912092 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:14:11.912724 11261 external_mini_cluster.cc:1428] Setting key f25348492a985dedc92e8c3f3ff9d08f
Aug 06 09:14:11 dist-test-slave-mvvj krb5kdc[11268](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007651, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:11.935194 11774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:11.912433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:60689 (local address 127.10.255.126:38175)
0806 09:14:11.913139 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:11.913147 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:11.914436 (+ 1289us) server_negotiation.cc:407] Connection header received
0806 09:14:11.917205 (+ 2769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:11.917209 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:11.917280 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:11.917370 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:11.919195 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:11.920233 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:11.922150 (+ 1917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:11.922728 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:11.922855 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:11.927502 (+ 4647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:11.927508 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:11.927512 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:11.927550 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:11.931610 (+ 4060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:11.932598 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:11.932603 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:11.932605 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:11.932735 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:11.933370 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:11.933374 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:11.933376 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:11.933692 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:11.933836 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:11.934665 (+ 829us) server_negotiation.cc:299] Negotiation successful
0806 09:14:11.934863 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":370,"threads_started":1}
I20260806 09:14:11.936280 11775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:11.913207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:38175 (local address 127.10.255.67:60689)
0806 09:14:11.914225 (+ 1018us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:11.914286 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:11.916854 (+ 2568us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:11.917733 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:11.917743 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:11.918325 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:11.918955 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:11.918975 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:11.920502 (+ 1527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:11.920506 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:11.921943 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:11.921958 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:11.923040 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:11.923047 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:11.923271 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:11.924155 (+ 884us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:11.924181 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:11.927205 (+ 3024us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:11.931770 (+ 4565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:11.931780 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:11.931796 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:11.932461 (+ 665us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:11.932903 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:11.932909 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:11.932912 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:11.933205 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:11.933834 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:11.933869 (+ 35us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:11.934245 (+ 376us) client_negotiation.cc:769] Sending connection context
0806 09:14:11.934535 (+ 290us) client_negotiation.cc:240] Negotiation successful
0806 09:14:11.934994 (+ 459us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":688,"thread_start_us":414,"threads_started":1}
I20260806 09:14:11.938045 11772 heartbeater.cc:347] Connected to a master server at 127.10.255.126:38175
I20260806 09:14:11.938437 11772 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:11.939316 11772 heartbeater.cc:511] Master 127.10.255.126:38175 requested a full tablet report, sending...
I20260806 09:14:11.941215 11313 ts_manager.cc:194] Registered new tserver with Master: 19ef6fbe58f64d26b2adf6e7f657c10e (127.10.255.67:39457)
I20260806 09:14:11.942291 11313 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.67@KRBTEST.COM'} at 127.10.255.67:60689
I20260806 09:14:11.944053 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 09:14:11 dist-test-slave-mvvj krb5kdc[11268](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007651, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 09:14:11 dist-test-slave-mvvj krb5kdc[11268](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007651, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.255.65@KRBTEST.COM
I20260806 09:14:12.000806 11780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:11.981228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59222 (local address 127.10.255.65:40331)
0806 09:14:11.982169 (+ 941us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:11.982176 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:11.982206 (+ 30us) server_negotiation.cc:407] Connection header received
0806 09:14:11.982327 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:11.982337 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:11.982676 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:11.982893 (+ 217us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:11.984984 (+ 2091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:11.986180 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:11.987692 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:11.988452 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:11.988577 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:11.993515 (+ 4938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:11.993542 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:11.993563 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:11.993624 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:11.997231 (+ 3607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:11.998124 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:11.998133 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:11.998135 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:11.998364 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:11.998887 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:11.998892 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:11.998895 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:11.999331 (+ 436us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:11.999684 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:12.000104 (+ 420us) server_negotiation.cc:299] Negotiation successful
0806 09:14:12.000409 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":774,"thread_start_us":629,"threads_started":1}
W20260806 09:14:12.002530 11418 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:59222
Aug 06 09:14:12 dist-test-slave-mvvj krb5kdc[11268](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007652, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 09:14:12 dist-test-slave-mvvj krb5kdc[11268](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007652, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.65@KRBTEST.COM
I20260806 09:14:12.056051 11780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:12.039225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59232 (local address 127.10.255.65:40331)
0806 09:14:12.039495 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:12.039502 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:12.039626 (+ 124us) server_negotiation.cc:407] Connection header received
0806 09:14:12.039778 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:12.039782 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:12.039973 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:12.040071 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:12.041626 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:12.042338 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:12.043697 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:12.044224 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:12.044323 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:12.050144 (+ 5821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:12.050150 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:12.050153 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:12.050198 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:12.053270 (+ 3072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:12.054072 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:12.054076 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:12.054079 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:12.054220 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:12.054559 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:12.054562 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:12.054564 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:12.054836 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:12.055038 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:12.055392 (+ 354us) server_negotiation.cc:299] Negotiation successful
0806 09:14:12.055589 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260806 09:14:12.058494 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 11374
I20260806 09:14:12.073972 11780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:12.060140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59246 (local address 127.10.255.65:40331)
0806 09:14:12.060415 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:12.060422 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:12.060608 (+ 186us) server_negotiation.cc:407] Connection header received
0806 09:14:12.060839 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:12.060845 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:12.060928 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:12.061069 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:12.062369 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:12.063156 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:12.064671 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:12.065175 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:12.065322 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:12.068067 (+ 2745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:12.068073 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:12.068077 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:12.068116 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:12.070948 (+ 2832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:12.071734 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:12.071740 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:12.071743 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:12.071973 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:12.072389 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:12.072395 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:12.072399 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:12.072719 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:12.072976 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:12.073313 (+ 337us) server_negotiation.cc:299] Negotiation successful
0806 09:14:12.073592 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260806 09:14:12.074910 11498 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:12.167814 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 11374
I20260806 09:14:12.187578 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 11509
Aug 06 09:14:12 dist-test-slave-mvvj krb5kdc[11268](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007652, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.66@KRBTEST.COM
I20260806 09:14:12.206817 11787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:12.188966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48480 (local address 127.10.255.66:45355)
0806 09:14:12.189671 (+ 705us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:12.189678 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:12.189704 (+ 26us) server_negotiation.cc:407] Connection header received
0806 09:14:12.189768 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:12.189774 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:12.190001 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:12.190132 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:12.191435 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:12.192612 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:12.194042 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:12.194607 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:12.194707 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:12.199745 (+ 5038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:12.199762 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:12.199779 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:12.199885 (+ 106us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:12.203219 (+ 3334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:12.204299 (+ 1080us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:12.204309 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:12.204311 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:12.204499 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:12.204963 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:12.204968 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:12.204970 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:12.205446 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:12.205705 (+ 259us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:12.206056 (+ 351us) server_negotiation.cc:299] Negotiation successful
0806 09:14:12.206341 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":371,"threads_started":1}
I20260806 09:14:12.208379 11632 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:12.297750 11637 heartbeater.cc:503] Master 127.10.255.126:38175 was elected leader, sending a full tablet report...
I20260806 09:14:12.300021 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 11509
I20260806 09:14:12.319511 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 11643
Aug 06 09:14:12 dist-test-slave-mvvj krb5kdc[11268](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007652, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.67@KRBTEST.COM
I20260806 09:14:12.337357 11789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:12.320764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44652 (local address 127.10.255.67:39457)
0806 09:14:12.321350 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:12.321358 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:12.321390 (+ 32us) server_negotiation.cc:407] Connection header received
0806 09:14:12.321454 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:12.321461 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:12.321712 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:12.321851 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:12.323129 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:12.324345 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:12.325687 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:12.326316 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:12.326421 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:12.331071 (+ 4650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:12.331086 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:12.331102 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:12.331151 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:12.334368 (+ 3217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:12.335086 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:12.335095 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:12.335097 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:12.335249 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:12.335668 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:12.335672 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:12.335674 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:12.336167 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:12.336471 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:12.336672 (+ 201us) server_negotiation.cc:299] Negotiation successful
0806 09:14:12.336891 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":305,"threads_started":1}
I20260806 09:14:12.338785 11767 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:12.425447 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 11643
I20260806 09:14:12.445441 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 11281
I20260806 09:14:12.446887 11343 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:12.554685 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 11281
2026-08-06T09:14:12Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (4984 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:14:12 dist-test-slave-mvvj krb5kdc[11795](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:14:12 dist-test-slave-mvvj krb5kdc[11795](info): set up 2 sockets
Aug 06 09:14:12 dist-test-slave-mvvj krb5kdc[11795](info): commencing operation
krb5kdc: starting...
W20260806 09:14:13.706786 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.003s sys 0.015s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:14:13 dist-test-slave-mvvj krb5kdc[11795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:14:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:14:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:14:13.915789 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:37127
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:40367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:37127
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:14.270498 11808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:14.270910 11808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:14.271090 11808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:14.279394 11808 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:14:14.279623 11808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:14.279758 11808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:14.279886 11808 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:14:14.279963 11808 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:14:14.290856 11808 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:40367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:37127
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:37127
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:14.292603 11808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:14.294957 11808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:14.311292 11816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:14.311249 11813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:14.311220 11814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:14.313030 11808 server_base.cc:1034] running on GCE node
I20260806 09:14:14.313946 11808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:14.315798 11808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:14.317142 11808 hybrid_clock.cc:648] HybridClock initialized: now 1786007654317077 us; error 62 us; skew 500 ppm
I20260806 09:14:14.317564 11808 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:14 dist-test-slave-mvvj krb5kdc[11795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007654, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:14.321777 11808 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:14:14.323762 11808 webserver.cc:460] Webserver started at http://127.10.255.126:37499/ using document root <none> and password file <none>
I20260806 09:14:14.324611 11808 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:14.324782 11808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:14.325151 11808 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:14.328727 11808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "d712d75f7f9946d6832f58a0308341d7"
format_stamp: "Formatted at 2026-08-06 09:14:14 on dist-test-slave-mvvj"
server_key: "539cff4dfba6945178a95aade4a4b196"
server_key_iv: "ffac1c514628e67c89139780e9a5fa59"
server_key_version: "encryptionkey@0"
I20260806 09:14:14.329764 11808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "d712d75f7f9946d6832f58a0308341d7"
format_stamp: "Formatted at 2026-08-06 09:14:14 on dist-test-slave-mvvj"
server_key: "539cff4dfba6945178a95aade4a4b196"
server_key_iv: "ffac1c514628e67c89139780e9a5fa59"
server_key_version: "encryptionkey@0"
I20260806 09:14:14.336302 11808 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260806 09:14:14.340734 11823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:14.342506 11808 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:14:14.342759 11808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "d712d75f7f9946d6832f58a0308341d7"
format_stamp: "Formatted at 2026-08-06 09:14:14 on dist-test-slave-mvvj"
server_key: "539cff4dfba6945178a95aade4a4b196"
server_key_iv: "ffac1c514628e67c89139780e9a5fa59"
server_key_version: "encryptionkey@0"
I20260806 09:14:14.343007 11808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:14.359491 11808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:14.364624 11808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:14.365013 11808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:14.386518 11808 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:37127
I20260806 09:14:14.386543 11874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:37127 every 8 connection(s)
I20260806 09:14:14.388234 11808 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:14:14.393018 11875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:14.397446 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 11808
I20260806 09:14:14.397756 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:14:14.398710 11261 external_mini_cluster.cc:1428] Setting key 79b6d567d18cbe7b52837087ce8e9bbc
I20260806 09:14:14.409157 11875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d712d75f7f9946d6832f58a0308341d7: Bootstrap starting.
I20260806 09:14:14.413560 11875 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d712d75f7f9946d6832f58a0308341d7: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:14.415169 11875 log.cc:824] T 00000000000000000000000000000000 P d712d75f7f9946d6832f58a0308341d7: Log is configured to *not* fsync() on all Append() calls
Aug 06 09:14:14 dist-test-slave-mvvj krb5kdc[11795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:14.419011 11875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d712d75f7f9946d6832f58a0308341d7: No bootstrap required, opened a new log
I20260806 09:14:14.426723 11878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:14.401310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47348 (local address 127.10.255.126:37127)
0806 09:14:14.402208 (+ 898us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:14.402221 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:14.402266 (+ 45us) server_negotiation.cc:407] Connection header received
0806 09:14:14.404274 (+ 2008us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:14.404304 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:14.404826 (+ 522us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:14.405224 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:14.407372 (+ 2148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:14.408946 (+ 1574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:14.410845 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:14.411801 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:14.412070 (+ 269us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:14.417660 (+ 5590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:14.417671 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:14.417688 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:14.417731 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:14.421283 (+ 3552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:14.422406 (+ 1123us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:14.422414 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:14.422422 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:14.422647 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:14.423139 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:14.423143 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:14.423145 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:14.423774 (+ 629us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:14.424152 (+ 378us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:14.424850 (+ 698us) server_negotiation.cc:299] Negotiation successful
0806 09:14:14.425394 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":675,"thread_start_us":436,"threads_started":1}
I20260806 09:14:14.429006 11875 raft_consensus.cc:348] T 00000000000000000000000000000000 P d712d75f7f9946d6832f58a0308341d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d712d75f7f9946d6832f58a0308341d7" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37127 } }
I20260806 09:14:14.429458 11875 raft_consensus.cc:374] T 00000000000000000000000000000000 P d712d75f7f9946d6832f58a0308341d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:14.429602 11875 raft_consensus.cc:729] T 00000000000000000000000000000000 P d712d75f7f9946d6832f58a0308341d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d712d75f7f9946d6832f58a0308341d7, State: Initialized, Role: FOLLOWER
I20260806 09:14:14.430260 11875 consensus_queue.cc:260] T 00000000000000000000000000000000 P d712d75f7f9946d6832f58a0308341d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d712d75f7f9946d6832f58a0308341d7" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37127 } }
I20260806 09:14:14.430569 11875 raft_consensus.cc:388] T 00000000000000000000000000000000 P d712d75f7f9946d6832f58a0308341d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:14:14.430739 11875 raft_consensus.cc:482] T 00000000000000000000000000000000 P d712d75f7f9946d6832f58a0308341d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:14:14.430927 11875 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d712d75f7f9946d6832f58a0308341d7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:14.433378 11875 raft_consensus.cc:504] T 00000000000000000000000000000000 P d712d75f7f9946d6832f58a0308341d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d712d75f7f9946d6832f58a0308341d7" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37127 } }
I20260806 09:14:14.433964 11875 leader_election.cc:302] T 00000000000000000000000000000000 P d712d75f7f9946d6832f58a0308341d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d712d75f7f9946d6832f58a0308341d7; no voters:
I20260806 09:14:14.434664 11875 leader_election.cc:288] T 00000000000000000000000000000000 P d712d75f7f9946d6832f58a0308341d7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:14:14.434801 11880 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d712d75f7f9946d6832f58a0308341d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:14:14.435639 11880 raft_consensus.cc:686] T 00000000000000000000000000000000 P d712d75f7f9946d6832f58a0308341d7 [term 1 LEADER]: Becoming Leader. State: Replica: d712d75f7f9946d6832f58a0308341d7, State: Running, Role: LEADER
I20260806 09:14:14.436326 11880 consensus_queue.cc:237] T 00000000000000000000000000000000 P d712d75f7f9946d6832f58a0308341d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d712d75f7f9946d6832f58a0308341d7" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37127 } }
I20260806 09:14:14.436986 11875 sys_catalog.cc:564] T 00000000000000000000000000000000 P d712d75f7f9946d6832f58a0308341d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:14:14.439646 11881 sys_catalog.cc:455] T 00000000000000000000000000000000 P d712d75f7f9946d6832f58a0308341d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d712d75f7f9946d6832f58a0308341d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d712d75f7f9946d6832f58a0308341d7" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37127 } } }
I20260806 09:14:14.440228 11881 sys_catalog.cc:458] T 00000000000000000000000000000000 P d712d75f7f9946d6832f58a0308341d7 [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:14.439778 11882 sys_catalog.cc:455] T 00000000000000000000000000000000 P d712d75f7f9946d6832f58a0308341d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d712d75f7f9946d6832f58a0308341d7. Latest consensus state: current_term: 1 leader_uuid: "d712d75f7f9946d6832f58a0308341d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d712d75f7f9946d6832f58a0308341d7" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37127 } } }
I20260806 09:14:14.440593 11882 sys_catalog.cc:458] T 00000000000000000000000000000000 P d712d75f7f9946d6832f58a0308341d7 [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:14.441231 11887 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:14:14.448892 11887 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:14:14.460147 11887 catalog_manager.cc:1347] Generated new cluster ID: 65e33fa9abe641e084e8074e6301d665
I20260806 09:14:14.460299 11887 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:14:14.513525 11887 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:14:14.515153 11887 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:14:14.527797 11887 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d712d75f7f9946d6832f58a0308341d7: Generated new TSK 0
I20260806 09:14:14.528859 11887 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.255.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
I20260806 09:14:14.580699 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:37127
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:40367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:14.947767 11902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:14.948284 11902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:14.948525 11902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:14.957510 11902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:14.957654 11902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:14.957872 11902 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:14:14.969521 11902 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:40367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:37127
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:14.971029 11902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:14.972652 11902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:14.988404 11908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:14.988425 11907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:14.988571 11910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:14.990010 11902 server_base.cc:1034] running on GCE node
I20260806 09:14:14.991319 11902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:14.992719 11902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:14.994032 11902 hybrid_clock.cc:648] HybridClock initialized: now 1786007654993960 us; error 64 us; skew 500 ppm
I20260806 09:14:14.994457 11902 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:15 dist-test-slave-mvvj krb5kdc[11795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007655, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:15.008324 11902 init.cc:377] Logged in from keytab as kudu/127.10.255.65@KRBTEST.COM (short username kudu)
I20260806 09:14:15.010236 11902 webserver.cc:460] Webserver started at http://127.10.255.65:36805/ using document root <none> and password file <none>
I20260806 09:14:15.011080 11902 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:15.011219 11902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:15.011520 11902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:15.015111 11902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "92c15c412fb44089b25383d0d49bdafa"
format_stamp: "Formatted at 2026-08-06 09:14:15 on dist-test-slave-mvvj"
server_key: "40a514461b41e2199d0ab04656688eeb"
server_key_iv: "fad3637fdcbfdd41567a5a89eeb41a62"
server_key_version: "encryptionkey@0"
I20260806 09:14:15.016181 11902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "92c15c412fb44089b25383d0d49bdafa"
format_stamp: "Formatted at 2026-08-06 09:14:15 on dist-test-slave-mvvj"
server_key: "40a514461b41e2199d0ab04656688eeb"
server_key_iv: "fad3637fdcbfdd41567a5a89eeb41a62"
server_key_version: "encryptionkey@0"
I20260806 09:14:15.024230 11902 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260806 09:14:15.028860 11917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:15.030773 11902 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260806 09:14:15.030962 11902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "92c15c412fb44089b25383d0d49bdafa"
format_stamp: "Formatted at 2026-08-06 09:14:15 on dist-test-slave-mvvj"
server_key: "40a514461b41e2199d0ab04656688eeb"
server_key_iv: "fad3637fdcbfdd41567a5a89eeb41a62"
server_key_version: "encryptionkey@0"
I20260806 09:14:15.031227 11902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:15.044697 11902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:15.049839 11902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:15.050189 11902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:15.051333 11902 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:14:15.053130 11902 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:15.053215 11902 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:15.053304 11902 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:15.053352 11902 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:15.096935 11902 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:35685
I20260806 09:14:15.096961 12030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:35685 every 8 connection(s)
I20260806 09:14:15.100603 11902 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:14:15.106331 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 11902
I20260806 09:14:15.106802 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:14:15.108925 11261 external_mini_cluster.cc:1428] Setting key 6a8f3e6c316bc833b7209a6c7c42a4c1
Aug 06 09:14:15 dist-test-slave-mvvj krb5kdc[11795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007655, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.255.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.66@KRBTEST.COM" created.
I20260806 09:14:15.167196 12033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:15.107317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:54323 (local address 127.10.255.126:37127)
0806 09:14:15.108703 (+ 1386us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:15.108721 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:15.111634 (+ 2913us) server_negotiation.cc:407] Connection header received
0806 09:14:15.118598 (+ 6964us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:15.118605 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:15.118861 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:15.119067 (+ 206us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:15.126708 (+ 7641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:15.129986 (+ 3278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:15.134088 (+ 4102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:15.136305 (+ 2217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:15.136706 (+ 401us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:15.148094 (+ 11388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:15.148118 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:15.148136 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:15.148253 (+ 117us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:15.157508 (+ 9255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:15.159491 (+ 1983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:15.159521 (+ 30us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:15.159527 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:15.160020 (+ 493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:15.161018 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:15.161067 (+ 49us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:15.161073 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:15.162785 (+ 1712us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:15.163086 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:15.164753 (+ 1667us) server_negotiation.cc:299] Negotiation successful
0806 09:14:15.165726 (+ 973us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1138,"thread_start_us":809,"threads_started":1}
I20260806 09:14:15.167972 12034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:15.109225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37127 (local address 127.10.255.65:54323)
0806 09:14:15.111356 (+ 2131us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:15.111449 (+ 93us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:15.117613 (+ 6164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:15.119979 (+ 2366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:15.120002 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:15.122133 (+ 2131us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:15.126061 (+ 3928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:15.126184 (+ 123us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:15.130691 (+ 4507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:15.130699 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:15.133647 (+ 2948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:15.133693 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:15.137283 (+ 3590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:15.137293 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:15.137890 (+ 597us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:15.140049 (+ 2159us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:15.140135 (+ 86us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:15.147305 (+ 7170us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:15.157985 (+ 10680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:15.158024 (+ 39us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:15.158077 (+ 53us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:15.159154 (+ 1077us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:15.160316 (+ 1162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:15.160329 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:15.160332 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:15.160756 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:15.163041 (+ 2285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:15.163057 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:15.164046 (+ 989us) client_negotiation.cc:769] Sending connection context
0806 09:14:15.164334 (+ 288us) client_negotiation.cc:240] Negotiation successful
0806 09:14:15.165363 (+ 1029us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1370,"thread_start_us":991,"threads_started":1}
I20260806 09:14:15.171986 12031 heartbeater.cc:347] Connected to a master server at 127.10.255.126:37127
I20260806 09:14:15.172566 12031 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:15.174247 12031 heartbeater.cc:511] Master 127.10.255.126:37127 requested a full tablet report, sending...
I20260806 09:14:15.179418 11840 ts_manager.cc:194] Registered new tserver with Master: 92c15c412fb44089b25383d0d49bdafa (127.10.255.65:35685)
I20260806 09:14:15.182374 11840 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.65@KRBTEST.COM'} at 127.10.255.65:54323
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
I20260806 09:14:15.209343 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:37127
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:40367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:15.903228 12037 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:15.903651 12037 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:15.903937 12037 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:15.913679 12037 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:15.914036 12037 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:15.914326 12037 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:14:15.941246 12037 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:40367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:37127
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:15.943750 12037 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:15.947619 12037 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:15.982297 12042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:15.982196 12043 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:15.982275 12045 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:15.985872 12037 server_base.cc:1034] running on GCE node
I20260806 09:14:15.987608 12037 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:15.990265 12037 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:15.993914 12037 hybrid_clock.cc:648] HybridClock initialized: now 1786007655993656 us; error 159 us; skew 500 ppm
I20260806 09:14:15.994716 12037 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:15 dist-test-slave-mvvj krb5kdc[11795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007655, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:16.002379 12037 init.cc:377] Logged in from keytab as kudu/127.10.255.66@KRBTEST.COM (short username kudu)
I20260806 09:14:16.004639 12037 webserver.cc:460] Webserver started at http://127.10.255.66:45533/ using document root <none> and password file <none>
I20260806 09:14:16.006212 12037 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:16.006636 12037 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:16.007503 12037 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:16.015336 12037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "847be67666cc4927b82f49b5a9069098"
format_stamp: "Formatted at 2026-08-06 09:14:16 on dist-test-slave-mvvj"
server_key: "c5d799949154daf6f2db7cd0dec041c2"
server_key_iv: "dcde7f6b69718710ef082aabeb4b30b0"
server_key_version: "encryptionkey@0"
I20260806 09:14:16.017266 12037 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "847be67666cc4927b82f49b5a9069098"
format_stamp: "Formatted at 2026-08-06 09:14:16 on dist-test-slave-mvvj"
server_key: "c5d799949154daf6f2db7cd0dec041c2"
server_key_iv: "dcde7f6b69718710ef082aabeb4b30b0"
server_key_version: "encryptionkey@0"
I20260806 09:14:16.032451 12037 fs_manager.cc:691] Time spent creating directory manager: real 0.014s user 0.006s sys 0.008s
I20260806 09:14:16.043699 12052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:16.047266 12037 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.006s sys 0.001s
I20260806 09:14:16.047734 12037 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "847be67666cc4927b82f49b5a9069098"
format_stamp: "Formatted at 2026-08-06 09:14:16 on dist-test-slave-mvvj"
server_key: "c5d799949154daf6f2db7cd0dec041c2"
server_key_iv: "dcde7f6b69718710ef082aabeb4b30b0"
server_key_version: "encryptionkey@0"
I20260806 09:14:16.048292 12037 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:16.098062 12037 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:16.110824 12037 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:16.111645 12037 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:16.114235 12037 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:14:16.117093 12037 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:16.117249 12037 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:16.117460 12037 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:16.117591 12037 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:16.190498 12031 heartbeater.cc:503] Master 127.10.255.126:37127 was elected leader, sending a full tablet report...
I20260806 09:14:16.208627 12037 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:33733
I20260806 09:14:16.208719 12165 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:33733 every 8 connection(s)
I20260806 09:14:16.211572 12037 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:14:16.221572 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 12037
I20260806 09:14:16.221933 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:14:16.222892 11261 external_mini_cluster.cc:1428] Setting key effdb3bebb7ef0dcd8f156faf4ea6be8
Aug 06 09:14:16 dist-test-slave-mvvj krb5kdc[11795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007655, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.255.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.67@KRBTEST.COM" created.
I20260806 09:14:16.257128 12168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:16.216710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:52571 (local address 127.10.255.126:37127)
0806 09:14:16.217512 (+ 802us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:16.217517 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:16.219250 (+ 1733us) server_negotiation.cc:407] Connection header received
0806 09:14:16.224109 (+ 4859us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:16.224115 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:16.224235 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:16.224369 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:16.227321 (+ 2952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:16.228775 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:16.234220 (+ 5445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:16.235451 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:16.235799 (+ 348us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:16.243935 (+ 8136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:16.243960 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:16.243966 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:16.244060 (+ 94us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:16.250012 (+ 5952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:16.251934 (+ 1922us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:16.251956 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:16.251982 (+ 26us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:16.252458 (+ 476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:16.253506 (+ 1048us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:16.253511 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:16.253513 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:16.254191 (+ 678us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:16.254386 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:16.256033 (+ 1647us) server_negotiation.cc:299] Negotiation successful
0806 09:14:16.256685 (+ 652us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":636,"thread_start_us":452,"threads_started":1}
I20260806 09:14:16.260877 12169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:16.217681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37127 (local address 127.10.255.66:52571)
0806 09:14:16.218976 (+ 1295us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:16.219050 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:16.223487 (+ 4437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:16.224690 (+ 1203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:16.224706 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:16.225351 (+ 645us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:16.226852 (+ 1501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:16.226911 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:16.229119 (+ 2208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:16.229131 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:16.233781 (+ 4650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:16.233849 (+ 68us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:16.236121 (+ 2272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:16.236134 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:16.236992 (+ 858us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:16.238370 (+ 1378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:16.238431 (+ 61us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:16.243276 (+ 4845us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:16.250418 (+ 7142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:16.250443 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:16.250493 (+ 50us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:16.251536 (+ 1043us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:16.252729 (+ 1193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:16.252734 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:16.252737 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:16.253113 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:16.254440 (+ 1327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:16.254449 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:16.255279 (+ 830us) client_negotiation.cc:769] Sending connection context
0806 09:14:16.255772 (+ 493us) client_negotiation.cc:240] Negotiation successful
0806 09:14:16.256863 (+ 1091us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":894,"thread_start_us":493,"threads_started":1}
I20260806 09:14:16.264570 12166 heartbeater.cc:347] Connected to a master server at 127.10.255.126:37127
I20260806 09:14:16.265375 12166 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:16.267552 12166 heartbeater.cc:511] Master 127.10.255.126:37127 requested a full tablet report, sending...
I20260806 09:14:16.271099 11840 ts_manager.cc:194] Registered new tserver with Master: 847be67666cc4927b82f49b5a9069098 (127.10.255.66:33733)
I20260806 09:14:16.272861 11840 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.66@KRBTEST.COM'} at 127.10.255.66:52571
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
I20260806 09:14:16.297906 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:37127
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:40367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:17.009980 12172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:17.010352 12172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:17.010545 12172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:17.018406 12172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:17.018611 12172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:17.018810 12172 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:14:17.029732 12172 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:40367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:37127
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:17.031278 12172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:17.032717 12172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:17.047688 12177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:17.047709 12180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:17.047683 12178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:17.048509 12172 server_base.cc:1034] running on GCE node
I20260806 09:14:17.049490 12172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:17.050767 12172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:17.052074 12172 hybrid_clock.cc:648] HybridClock initialized: now 1786007657052017 us; error 39 us; skew 500 ppm
I20260806 09:14:17.052472 12172 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:17 dist-test-slave-mvvj krb5kdc[11795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007657, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:17.056175 12172 init.cc:377] Logged in from keytab as kudu/127.10.255.67@KRBTEST.COM (short username kudu)
I20260806 09:14:17.057858 12172 webserver.cc:460] Webserver started at http://127.10.255.67:41661/ using document root <none> and password file <none>
I20260806 09:14:17.058704 12172 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:17.058868 12172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:17.059230 12172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:17.062721 12172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "5dc39311c4aa4105bffebd07aa049c6d"
format_stamp: "Formatted at 2026-08-06 09:14:17 on dist-test-slave-mvvj"
server_key: "668e4d1f9d3d2e8b2650aea833fa2e5a"
server_key_iv: "cdb8411a64d8b4b51799452f3a18d6b7"
server_key_version: "encryptionkey@0"
I20260806 09:14:17.063673 12172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "5dc39311c4aa4105bffebd07aa049c6d"
format_stamp: "Formatted at 2026-08-06 09:14:17 on dist-test-slave-mvvj"
server_key: "668e4d1f9d3d2e8b2650aea833fa2e5a"
server_key_iv: "cdb8411a64d8b4b51799452f3a18d6b7"
server_key_version: "encryptionkey@0"
I20260806 09:14:17.070001 12172 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 09:14:17.074247 12187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:17.075995 12172 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:14:17.076231 12172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "5dc39311c4aa4105bffebd07aa049c6d"
format_stamp: "Formatted at 2026-08-06 09:14:17 on dist-test-slave-mvvj"
server_key: "668e4d1f9d3d2e8b2650aea833fa2e5a"
server_key_iv: "cdb8411a64d8b4b51799452f3a18d6b7"
server_key_version: "encryptionkey@0"
I20260806 09:14:17.076495 12172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:17.103358 12172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:17.109438 12172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:17.109879 12172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:17.111035 12172 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:14:17.112577 12172 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:17.112663 12172 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:17.112754 12172 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:17.112799 12172 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:17.150765 12172 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:40295
I20260806 09:14:17.150816 12300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:40295 every 8 connection(s)
I20260806 09:14:17.152411 12172 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:14:17.162060 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 12172
I20260806 09:14:17.162297 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:14:17.162892 11261 external_mini_cluster.cc:1428] Setting key 4ca46735b71704a10c7a848219d00470
Aug 06 09:14:17 dist-test-slave-mvvj krb5kdc[11795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007657, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:17.177505 12303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:17.155432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:46829 (local address 127.10.255.126:37127)
0806 09:14:17.155987 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:17.155994 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:17.156954 (+ 960us) server_negotiation.cc:407] Connection header received
0806 09:14:17.159111 (+ 2157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:17.159117 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:17.159239 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:17.159375 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:17.161459 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.162507 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.165058 (+ 2551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.165723 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.165902 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:17.170381 (+ 4479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:17.170388 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:17.170393 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:17.170440 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:17.173629 (+ 3189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:17.174639 (+ 1010us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:17.174644 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:17.174647 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:17.174811 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:17.175352 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:17.175357 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:17.175359 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:17.175673 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:17.175915 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:17.176754 (+ 839us) server_negotiation.cc:299] Negotiation successful
0806 09:14:17.177038 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":292,"threads_started":1}
I20260806 09:14:17.178719 12304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:17.155976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37127 (local address 127.10.255.67:46829)
0806 09:14:17.156776 (+ 800us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:17.156819 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:17.158766 (+ 1947us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:17.159664 (+ 898us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:17.159675 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:17.160491 (+ 816us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:17.161196 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:17.161219 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.162701 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.162709 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:17.164863 (+ 2154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:17.164882 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.166038 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.166047 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:17.166401 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:17.167346 (+ 945us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:17.167374 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:17.170065 (+ 2691us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:17.173851 (+ 3786us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:17.173864 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:17.173894 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:17.174449 (+ 555us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:17.174956 (+ 507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:17.174962 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:17.174966 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:17.175198 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:17.175879 (+ 681us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:17.175888 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:17.176318 (+ 430us) client_negotiation.cc:769] Sending connection context
0806 09:14:17.176626 (+ 308us) client_negotiation.cc:240] Negotiation successful
0806 09:14:17.177277 (+ 651us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":299,"threads_started":1}
I20260806 09:14:17.180485 12301 heartbeater.cc:347] Connected to a master server at 127.10.255.126:37127
I20260806 09:14:17.180928 12301 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:17.181877 12301 heartbeater.cc:511] Master 127.10.255.126:37127 requested a full tablet report, sending...
I20260806 09:14:17.183779 11840 ts_manager.cc:194] Registered new tserver with Master: 5dc39311c4aa4105bffebd07aa049c6d (127.10.255.67:40295)
I20260806 09:14:17.184924 11840 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.67@KRBTEST.COM'} at 127.10.255.67:46829
I20260806 09:14:17.192929 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 09:14:17.218128 12303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:17.201109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48178 (local address 127.10.255.126:37127)
0806 09:14:17.201298 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:17.201322 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:17.201910 (+ 588us) server_negotiation.cc:407] Connection header received
0806 09:14:17.202153 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:17.202158 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:17.202235 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:17.202347 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:17.204108 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.205176 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.206690 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.207339 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.207501 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:17.210834 (+ 3333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:17.210839 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:17.210843 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:17.210879 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:17.214604 (+ 3725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:17.215632 (+ 1028us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:17.215639 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:17.215648 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:17.215916 (+ 268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:17.216535 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:17.216540 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:17.216542 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:17.216986 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:17.217205 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:17.217669 (+ 464us) server_negotiation.cc:299] Negotiation successful
0806 09:14:17.217874 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 09:14:17.228739 11840 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48178:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:14:17.237690 11840 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:14:17.278381 12166 heartbeater.cc:503] Master 127.10.255.126:37127 was elected leader, sending a full tablet report...
I20260806 09:14:17.282871 12315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:17.256402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:33733 (local address 127.0.0.1:34748)
0806 09:14:17.269136 (+ 12734us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:17.269388 (+ 252us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:17.269933 (+ 545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:17.271649 (+ 1716us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:17.271664 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:17.271719 (+ 55us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:17.272386 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:17.272405 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.274740 (+ 2335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.274746 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:17.278734 (+ 3988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:17.278751 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.281358 (+ 2607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.281365 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:17.281731 (+ 366us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:17.282034 (+ 303us) client_negotiation.cc:769] Sending connection context
0806 09:14:17.282167 (+ 133us) client_negotiation.cc:240] Negotiation successful
0806 09:14:17.282372 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12308,"mutex_wait_us":327,"thread_start_us":17051,"threads_started":1}
I20260806 09:14:17.282974 12316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:17.256575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34748 (local address 127.10.255.66:33733)
0806 09:14:17.268170 (+ 11595us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:17.268190 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:17.270286 (+ 2096us) server_negotiation.cc:407] Connection header received
0806 09:14:17.270457 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:17.270472 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:17.270900 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:17.271198 (+ 298us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:17.272812 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.274541 (+ 1729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.278944 (+ 4403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.280682 (+ 1738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.280832 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:17.281134 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:17.282346 (+ 1212us) server_negotiation.cc:299] Negotiation successful
0806 09:14:17.282590 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10911,"thread_start_us":11269,"threads_started":1}
I20260806 09:14:17.285638 12314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:17.256553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:40295 (local address 127.0.0.1:50470)
0806 09:14:17.273739 (+ 17186us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:17.273761 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:17.273947 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:17.274742 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:17.274746 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:17.274775 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:17.275344 (+ 569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:17.275358 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.277913 (+ 2555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.277919 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:17.282633 (+ 4714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:17.282647 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.284607 (+ 1960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.284615 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:17.284839 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:17.284878 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 09:14:17.285009 (+ 131us) client_negotiation.cc:240] Negotiation successful
0806 09:14:17.285178 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17042,"thread_start_us":11926,"threads_started":1}
I20260806 09:14:17.285696 12317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:17.256892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50470 (local address 127.10.255.67:40295)
0806 09:14:17.272952 (+ 16060us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:17.272961 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:17.274097 (+ 1136us) server_negotiation.cc:407] Connection header received
0806 09:14:17.274208 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:17.274217 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:17.274516 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:17.275590 (+ 1074us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:17.275952 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.277715 (+ 1763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.282847 (+ 5132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.284367 (+ 1520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.284526 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:17.284770 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:17.285117 (+ 347us) server_negotiation.cc:299] Negotiation successful
0806 09:14:17.285331 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15788,"thread_start_us":16073,"threads_started":1}
I20260806 09:14:17.289330 12318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:17.262221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:35685 (local address 127.0.0.1:51006)
0806 09:14:17.279064 (+ 16843us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:17.279095 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:17.279262 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:17.281465 (+ 2203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:17.281471 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:17.281499 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:17.282049 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:17.282064 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.284227 (+ 2163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.284234 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:17.286555 (+ 2321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:17.286569 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.288479 (+ 1910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.288486 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:17.288649 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:17.288683 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 09:14:17.288796 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 09:14:17.288946 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16637,"mutex_wait_us":6,"thread_start_us":17614,"threads_started":1}
I20260806 09:14:17.289424 12319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:17.262509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51006 (local address 127.10.255.65:35685)
0806 09:14:17.280257 (+ 17748us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:17.280268 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:17.280363 (+ 95us) server_negotiation.cc:407] Connection header received
0806 09:14:17.280513 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:17.280525 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:17.280850 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:17.281107 (+ 257us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:17.282282 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.284065 (+ 1783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.286736 (+ 2671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.288224 (+ 1488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.288395 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:17.288686 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:17.288861 (+ 175us) server_negotiation.cc:299] Negotiation successful
0806 09:14:17.289054 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17185,"thread_start_us":19234,"threads_started":1}
I20260806 09:14:17.288750 12100 tablet_service.cc:1467] Processing CreateTablet for tablet 6cc4dcfbf77c49ba8122401ca06adbbc (DEFAULT_TABLE table=test-table [id=0aadf1f02cb4453480e48e3a0185fb51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:17.290699 12100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cc4dcfbf77c49ba8122401ca06adbbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:17.290548 12235 tablet_service.cc:1467] Processing CreateTablet for tablet 6cc4dcfbf77c49ba8122401ca06adbbc (DEFAULT_TABLE table=test-table [id=0aadf1f02cb4453480e48e3a0185fb51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:17.292279 12235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cc4dcfbf77c49ba8122401ca06adbbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:17.293160 11965 tablet_service.cc:1467] Processing CreateTablet for tablet 6cc4dcfbf77c49ba8122401ca06adbbc (DEFAULT_TABLE table=test-table [id=0aadf1f02cb4453480e48e3a0185fb51]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:17.294761 11965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6cc4dcfbf77c49ba8122401ca06adbbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:17.308209 12320 tablet_bootstrap.cc:492] T 6cc4dcfbf77c49ba8122401ca06adbbc P 92c15c412fb44089b25383d0d49bdafa: Bootstrap starting.
I20260806 09:14:17.310812 12322 tablet_bootstrap.cc:492] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098: Bootstrap starting.
I20260806 09:14:17.311882 12321 tablet_bootstrap.cc:492] T 6cc4dcfbf77c49ba8122401ca06adbbc P 5dc39311c4aa4105bffebd07aa049c6d: Bootstrap starting.
I20260806 09:14:17.314867 12320 tablet_bootstrap.cc:654] T 6cc4dcfbf77c49ba8122401ca06adbbc P 92c15c412fb44089b25383d0d49bdafa: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:17.315474 12322 tablet_bootstrap.cc:654] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:17.316171 12321 tablet_bootstrap.cc:654] T 6cc4dcfbf77c49ba8122401ca06adbbc P 5dc39311c4aa4105bffebd07aa049c6d: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:17.316632 12320 log.cc:824] T 6cc4dcfbf77c49ba8122401ca06adbbc P 92c15c412fb44089b25383d0d49bdafa: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:17.317096 12322 log.cc:824] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:17.317691 12321 log.cc:824] T 6cc4dcfbf77c49ba8122401ca06adbbc P 5dc39311c4aa4105bffebd07aa049c6d: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:17.320590 12320 tablet_bootstrap.cc:492] T 6cc4dcfbf77c49ba8122401ca06adbbc P 92c15c412fb44089b25383d0d49bdafa: No bootstrap required, opened a new log
I20260806 09:14:17.320730 12322 tablet_bootstrap.cc:492] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098: No bootstrap required, opened a new log
I20260806 09:14:17.320958 12320 ts_tablet_manager.cc:1397] T 6cc4dcfbf77c49ba8122401ca06adbbc P 92c15c412fb44089b25383d0d49bdafa: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20260806 09:14:17.321048 12322 ts_tablet_manager.cc:1397] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260806 09:14:17.322748 12321 tablet_bootstrap.cc:492] T 6cc4dcfbf77c49ba8122401ca06adbbc P 5dc39311c4aa4105bffebd07aa049c6d: No bootstrap required, opened a new log
I20260806 09:14:17.323073 12321 ts_tablet_manager.cc:1397] T 6cc4dcfbf77c49ba8122401ca06adbbc P 5dc39311c4aa4105bffebd07aa049c6d: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.002s
I20260806 09:14:17.330191 12320 raft_consensus.cc:348] T 6cc4dcfbf77c49ba8122401ca06adbbc P 92c15c412fb44089b25383d0d49bdafa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847be67666cc4927b82f49b5a9069098" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 33733 } } peers { permanent_uuid: "5dc39311c4aa4105bffebd07aa049c6d" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 40295 } } peers { permanent_uuid: "92c15c412fb44089b25383d0d49bdafa" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35685 } }
I20260806 09:14:17.330693 12320 raft_consensus.cc:374] T 6cc4dcfbf77c49ba8122401ca06adbbc P 92c15c412fb44089b25383d0d49bdafa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:17.330859 12320 raft_consensus.cc:729] T 6cc4dcfbf77c49ba8122401ca06adbbc P 92c15c412fb44089b25383d0d49bdafa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92c15c412fb44089b25383d0d49bdafa, State: Initialized, Role: FOLLOWER
I20260806 09:14:17.331630 12320 consensus_queue.cc:260] T 6cc4dcfbf77c49ba8122401ca06adbbc P 92c15c412fb44089b25383d0d49bdafa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847be67666cc4927b82f49b5a9069098" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 33733 } } peers { permanent_uuid: "5dc39311c4aa4105bffebd07aa049c6d" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 40295 } } peers { permanent_uuid: "92c15c412fb44089b25383d0d49bdafa" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35685 } }
I20260806 09:14:17.333587 12322 raft_consensus.cc:348] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847be67666cc4927b82f49b5a9069098" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 33733 } } peers { permanent_uuid: "5dc39311c4aa4105bffebd07aa049c6d" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 40295 } } peers { permanent_uuid: "92c15c412fb44089b25383d0d49bdafa" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35685 } }
I20260806 09:14:17.334009 12320 ts_tablet_manager.cc:1428] T 6cc4dcfbf77c49ba8122401ca06adbbc P 92c15c412fb44089b25383d0d49bdafa: Time spent starting tablet: real 0.013s user 0.006s sys 0.006s
I20260806 09:14:17.334286 12322 raft_consensus.cc:374] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:17.334479 12322 raft_consensus.cc:729] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847be67666cc4927b82f49b5a9069098, State: Initialized, Role: FOLLOWER
I20260806 09:14:17.335265 12322 consensus_queue.cc:260] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847be67666cc4927b82f49b5a9069098" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 33733 } } peers { permanent_uuid: "5dc39311c4aa4105bffebd07aa049c6d" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 40295 } } peers { permanent_uuid: "92c15c412fb44089b25383d0d49bdafa" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35685 } }
I20260806 09:14:17.336668 12321 raft_consensus.cc:348] T 6cc4dcfbf77c49ba8122401ca06adbbc P 5dc39311c4aa4105bffebd07aa049c6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847be67666cc4927b82f49b5a9069098" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 33733 } } peers { permanent_uuid: "5dc39311c4aa4105bffebd07aa049c6d" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 40295 } } peers { permanent_uuid: "92c15c412fb44089b25383d0d49bdafa" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35685 } }
I20260806 09:14:17.337283 12321 raft_consensus.cc:374] T 6cc4dcfbf77c49ba8122401ca06adbbc P 5dc39311c4aa4105bffebd07aa049c6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:17.337430 12321 raft_consensus.cc:729] T 6cc4dcfbf77c49ba8122401ca06adbbc P 5dc39311c4aa4105bffebd07aa049c6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dc39311c4aa4105bffebd07aa049c6d, State: Initialized, Role: FOLLOWER
I20260806 09:14:17.338178 12321 consensus_queue.cc:260] T 6cc4dcfbf77c49ba8122401ca06adbbc P 5dc39311c4aa4105bffebd07aa049c6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847be67666cc4927b82f49b5a9069098" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 33733 } } peers { permanent_uuid: "5dc39311c4aa4105bffebd07aa049c6d" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 40295 } } peers { permanent_uuid: "92c15c412fb44089b25383d0d49bdafa" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35685 } }
I20260806 09:14:17.339087 12322 ts_tablet_manager.cc:1428] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098: Time spent starting tablet: real 0.018s user 0.015s sys 0.001s
I20260806 09:14:17.340437 12301 heartbeater.cc:503] Master 127.10.255.126:37127 was elected leader, sending a full tablet report...
I20260806 09:14:17.341246 12321 ts_tablet_manager.cc:1428] T 6cc4dcfbf77c49ba8122401ca06adbbc P 5dc39311c4aa4105bffebd07aa049c6d: Time spent starting tablet: real 0.018s user 0.011s sys 0.005s
W20260806 09:14:17.356732 12032 tablet.cc:2369] T 6cc4dcfbf77c49ba8122401ca06adbbc P 92c15c412fb44089b25383d0d49bdafa: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 09:14:17.404361 12302 tablet.cc:2369] T 6cc4dcfbf77c49ba8122401ca06adbbc P 5dc39311c4aa4105bffebd07aa049c6d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 09:14:17.465786 12167 tablet.cc:2369] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:14:17.643509 12327 raft_consensus.cc:482] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:14:17.643863 12327 raft_consensus.cc:504] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847be67666cc4927b82f49b5a9069098" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 33733 } } peers { permanent_uuid: "5dc39311c4aa4105bffebd07aa049c6d" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 40295 } } peers { permanent_uuid: "92c15c412fb44089b25383d0d49bdafa" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35685 } }
I20260806 09:14:17.646163 12327 leader_election.cc:288] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5dc39311c4aa4105bffebd07aa049c6d (127.10.255.67:40295), 92c15c412fb44089b25383d0d49bdafa (127.10.255.65:35685)
I20260806 09:14:17.651547 12326 raft_consensus.cc:482] T 6cc4dcfbf77c49ba8122401ca06adbbc P 92c15c412fb44089b25383d0d49bdafa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:14:17.651973 12326 raft_consensus.cc:504] T 6cc4dcfbf77c49ba8122401ca06adbbc P 92c15c412fb44089b25383d0d49bdafa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847be67666cc4927b82f49b5a9069098" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 33733 } } peers { permanent_uuid: "5dc39311c4aa4105bffebd07aa049c6d" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 40295 } } peers { permanent_uuid: "92c15c412fb44089b25383d0d49bdafa" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35685 } }
I20260806 09:14:17.654428 12317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:17.646677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:45495 (local address 127.10.255.67:40295)
0806 09:14:17.646916 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:17.646923 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:17.648056 (+ 1133us) server_negotiation.cc:407] Connection header received
0806 09:14:17.648273 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:17.648277 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:17.648342 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:17.648449 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:17.649114 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.649834 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.652086 (+ 2252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.653307 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.653495 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:17.653578 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:17.654000 (+ 422us) server_negotiation.cc:299] Negotiation successful
0806 09:14:17.654152 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260806 09:14:17.654421 12326 leader_election.cc:288] T 6cc4dcfbf77c49ba8122401ca06adbbc P 92c15c412fb44089b25383d0d49bdafa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 847be67666cc4927b82f49b5a9069098 (127.10.255.66:33733), 5dc39311c4aa4105bffebd07aa049c6d (127.10.255.67:40295)
I20260806 09:14:17.654659 12330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:17.646850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:40295 (local address 127.10.255.66:45495)
0806 09:14:17.647935 (+ 1085us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:17.647952 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:17.648112 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:17.648473 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:17.648477 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:17.648502 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:17.648935 (+ 433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:17.648949 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.650021 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.650029 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:17.651886 (+ 1857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:17.651903 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.653574 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.653582 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:17.653779 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:17.653819 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 09:14:17.653948 (+ 129us) client_negotiation.cc:240] Negotiation successful
0806 09:14:17.654113 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":926,"mutex_wait_us":32,"thread_start_us":473,"threads_started":1}
I20260806 09:14:17.655632 12319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:17.646784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:53767 (local address 127.10.255.65:35685)
0806 09:14:17.647039 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:17.647044 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:17.647953 (+ 909us) server_negotiation.cc:407] Connection header received
0806 09:14:17.648222 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:17.648228 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:17.648318 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:17.648433 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:17.649173 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.650100 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.652673 (+ 2573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.653879 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.654067 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:17.654137 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:17.654729 (+ 592us) server_negotiation.cc:299] Negotiation successful
0806 09:14:17.655066 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260806 09:14:17.656097 12255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cc4dcfbf77c49ba8122401ca06adbbc" candidate_uuid: "847be67666cc4927b82f49b5a9069098" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc39311c4aa4105bffebd07aa049c6d" is_pre_election: true
I20260806 09:14:17.656493 12329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:17.646835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:35685 (local address 127.10.255.66:53767)
0806 09:14:17.647768 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:17.647787 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:17.648049 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:17.648455 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:17.648460 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:17.648488 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:17.649007 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:17.649020 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.650266 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.650279 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:17.652455 (+ 2176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:17.652472 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.654309 (+ 1837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.654317 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:17.654515 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:17.654560 (+ 45us) client_negotiation.cc:769] Sending connection context
0806 09:14:17.655819 (+ 1259us) client_negotiation.cc:240] Negotiation successful
0806 09:14:17.656027 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":789,"mutex_wait_us":1,"thread_start_us":490,"threads_started":1}
I20260806 09:14:17.656922 12255 raft_consensus.cc:2454] T 6cc4dcfbf77c49ba8122401ca06adbbc P 5dc39311c4aa4105bffebd07aa049c6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847be67666cc4927b82f49b5a9069098 in term 0.
I20260806 09:14:17.657903 12056 leader_election.cc:302] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dc39311c4aa4105bffebd07aa049c6d, 847be67666cc4927b82f49b5a9069098; no voters:
I20260806 09:14:17.658510 12327 raft_consensus.cc:2781] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:14:17.658782 12327 raft_consensus.cc:482] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:14:17.659008 12327 raft_consensus.cc:3037] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:17.658797 11985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cc4dcfbf77c49ba8122401ca06adbbc" candidate_uuid: "847be67666cc4927b82f49b5a9069098" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92c15c412fb44089b25383d0d49bdafa" is_pre_election: true
I20260806 09:14:17.659430 11985 raft_consensus.cc:2454] T 6cc4dcfbf77c49ba8122401ca06adbbc P 92c15c412fb44089b25383d0d49bdafa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 847be67666cc4927b82f49b5a9069098 in term 0.
I20260806 09:14:17.662568 12327 raft_consensus.cc:504] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847be67666cc4927b82f49b5a9069098" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 33733 } } peers { permanent_uuid: "5dc39311c4aa4105bffebd07aa049c6d" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 40295 } } peers { permanent_uuid: "92c15c412fb44089b25383d0d49bdafa" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35685 } }
I20260806 09:14:17.663818 12255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cc4dcfbf77c49ba8122401ca06adbbc" candidate_uuid: "847be67666cc4927b82f49b5a9069098" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc39311c4aa4105bffebd07aa049c6d"
I20260806 09:14:17.664176 12327 leader_election.cc:288] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098 [CANDIDATE]: Term 1 election: Requested vote from peers 5dc39311c4aa4105bffebd07aa049c6d (127.10.255.67:40295), 92c15c412fb44089b25383d0d49bdafa (127.10.255.65:35685)
I20260806 09:14:17.664151 12255 raft_consensus.cc:3037] T 6cc4dcfbf77c49ba8122401ca06adbbc P 5dc39311c4aa4105bffebd07aa049c6d [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:17.664449 11985 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cc4dcfbf77c49ba8122401ca06adbbc" candidate_uuid: "847be67666cc4927b82f49b5a9069098" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92c15c412fb44089b25383d0d49bdafa"
I20260806 09:14:17.664763 11985 raft_consensus.cc:3037] T 6cc4dcfbf77c49ba8122401ca06adbbc P 92c15c412fb44089b25383d0d49bdafa [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:17.667060 12316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:17.656546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:37033 (local address 127.10.255.66:33733)
0806 09:14:17.656821 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:17.656831 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:17.658284 (+ 1453us) server_negotiation.cc:407] Connection header received
0806 09:14:17.658730 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:17.658736 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:17.658847 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:17.658960 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:17.660119 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.661295 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.664589 (+ 3294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.665878 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.666062 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:17.666145 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:17.666648 (+ 503us) server_negotiation.cc:299] Negotiation successful
0806 09:14:17.666812 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 09:14:17.667405 12331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:17.655922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:33733 (local address 127.10.255.65:37033)
0806 09:14:17.658186 (+ 2264us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:17.658203 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:17.658586 (+ 383us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:17.659217 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:17.659223 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:17.659270 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:17.659914 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:17.659929 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.661477 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.661482 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:17.664281 (+ 2799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:17.664302 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.666162 (+ 1860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.666171 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:17.666407 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:17.666446 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 09:14:17.666569 (+ 123us) client_negotiation.cc:240] Negotiation successful
0806 09:14:17.666751 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2138,"mutex_wait_us":112,"thread_start_us":1295,"threads_started":1}
I20260806 09:14:17.667677 12255 raft_consensus.cc:2454] T 6cc4dcfbf77c49ba8122401ca06adbbc P 5dc39311c4aa4105bffebd07aa049c6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847be67666cc4927b82f49b5a9069098 in term 1.
I20260806 09:14:17.668187 11985 raft_consensus.cc:2454] T 6cc4dcfbf77c49ba8122401ca06adbbc P 92c15c412fb44089b25383d0d49bdafa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 847be67666cc4927b82f49b5a9069098 in term 1.
I20260806 09:14:17.668228 12056 leader_election.cc:302] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dc39311c4aa4105bffebd07aa049c6d, 847be67666cc4927b82f49b5a9069098; no voters:
I20260806 09:14:17.668695 12327 raft_consensus.cc:2781] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:14:17.668570 12121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cc4dcfbf77c49ba8122401ca06adbbc" candidate_uuid: "92c15c412fb44089b25383d0d49bdafa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847be67666cc4927b82f49b5a9069098" is_pre_election: true
I20260806 09:14:17.669349 12327 raft_consensus.cc:686] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098 [term 1 LEADER]: Becoming Leader. State: Replica: 847be67666cc4927b82f49b5a9069098, State: Running, Role: LEADER
I20260806 09:14:17.669999 12327 consensus_queue.cc:237] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847be67666cc4927b82f49b5a9069098" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 33733 } } peers { permanent_uuid: "5dc39311c4aa4105bffebd07aa049c6d" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 40295 } } peers { permanent_uuid: "92c15c412fb44089b25383d0d49bdafa" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35685 } }
I20260806 09:14:17.672071 12332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:17.655028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:40295 (local address 127.10.255.65:52227)
0806 09:14:17.657602 (+ 2574us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:17.657627 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:17.658373 (+ 746us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:17.659038 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:17.659044 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:17.659071 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:17.659752 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:17.659768 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.661300 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.661307 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:17.668584 (+ 7277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:17.668604 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.670957 (+ 2353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.670965 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:17.671225 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:17.671277 (+ 52us) client_negotiation.cc:769] Sending connection context
0806 09:14:17.671386 (+ 109us) client_negotiation.cc:240] Negotiation successful
0806 09:14:17.671570 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2414,"mutex_wait_us":4306,"thread_start_us":2730,"threads_started":1}
I20260806 09:14:17.672092 12317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:17.655207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:52227 (local address 127.10.255.67:40295)
0806 09:14:17.657029 (+ 1822us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:17.657036 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:17.657722 (+ 686us) server_negotiation.cc:407] Connection header received
0806 09:14:17.658619 (+ 897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:17.658625 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:17.658718 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:17.658830 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:17.659993 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.661152 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.668831 (+ 7679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.670355 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.670569 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:17.670683 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:17.671511 (+ 828us) server_negotiation.cc:299] Negotiation successful
0806 09:14:17.671684 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1683}
I20260806 09:14:17.672921 12255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6cc4dcfbf77c49ba8122401ca06adbbc" candidate_uuid: "92c15c412fb44089b25383d0d49bdafa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dc39311c4aa4105bffebd07aa049c6d" is_pre_election: true
I20260806 09:14:17.673512 12255 raft_consensus.cc:2379] T 6cc4dcfbf77c49ba8122401ca06adbbc P 5dc39311c4aa4105bffebd07aa049c6d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92c15c412fb44089b25383d0d49bdafa in current term 1: Already voted for candidate 847be67666cc4927b82f49b5a9069098 in this term.
I20260806 09:14:17.676158 11919 leader_election.cc:302] T 6cc4dcfbf77c49ba8122401ca06adbbc P 92c15c412fb44089b25383d0d49bdafa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92c15c412fb44089b25383d0d49bdafa; no voters: 5dc39311c4aa4105bffebd07aa049c6d, 847be67666cc4927b82f49b5a9069098
I20260806 09:14:17.676663 12326 raft_consensus.cc:2726] T 6cc4dcfbf77c49ba8122401ca06adbbc P 92c15c412fb44089b25383d0d49bdafa [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260806 09:14:17.678090 11839 catalog_manager.cc:5495] T 6cc4dcfbf77c49ba8122401ca06adbbc P 847be67666cc4927b82f49b5a9069098 reported cstate change: term changed from 0 to 1, leader changed from <none> to 847be67666cc4927b82f49b5a9069098 (127.10.255.66). New cstate: current_term: 1 leader_uuid: "847be67666cc4927b82f49b5a9069098" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "847be67666cc4927b82f49b5a9069098" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 33733 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5dc39311c4aa4105bffebd07aa049c6d" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 40295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92c15c412fb44089b25383d0d49bdafa" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35685 } health_report { overall_health: UNKNOWN } } }
Aug 06 09:14:17 dist-test-slave-mvvj krb5kdc[11795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.65@KRBTEST.COM
I20260806 09:14:17.749825 12319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:17.731898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51016 (local address 127.10.255.65:35685)
0806 09:14:17.732173 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:17.732184 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:17.732552 (+ 368us) server_negotiation.cc:407] Connection header received
0806 09:14:17.732707 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:17.732711 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:17.732799 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:17.732899 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:17.734625 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.735689 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.737579 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.738032 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.738166 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:17.742913 (+ 4747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:17.742932 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:17.742949 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:17.742992 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:17.746219 (+ 3227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:17.747225 (+ 1006us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:17.747234 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:17.747236 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:17.747432 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:17.748037 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:17.748045 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:17.748048 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:17.748598 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:17.748847 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:17.749185 (+ 338us) server_negotiation.cc:299] Negotiation successful
0806 09:14:17.749405 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
Aug 06 09:14:17 dist-test-slave-mvvj krb5kdc[11795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007657, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 09:14:17 dist-test-slave-mvvj krb5kdc[11795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007657, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.255.65@KRBTEST.COM
I20260806 09:14:17.805765 12319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:17.788864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51026 (local address 127.10.255.65:35685)
0806 09:14:17.789132 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:17.789141 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:17.789514 (+ 373us) server_negotiation.cc:407] Connection header received
0806 09:14:17.789749 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:17.789754 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:17.789821 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:17.789934 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:17.791430 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.792262 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.793587 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.794088 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.794255 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:17.799117 (+ 4862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:17.799123 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:17.799126 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:17.799174 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:17.802573 (+ 3399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:17.803421 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:17.803432 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:17.803434 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:17.803615 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:17.804158 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:17.804170 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:17.804173 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:17.804499 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:17.804803 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:17.805141 (+ 338us) server_negotiation.cc:299] Negotiation successful
0806 09:14:17.805403 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
Aug 06 09:14:17 dist-test-slave-mvvj krb5kdc[11795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007657, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 09:14:17 dist-test-slave-mvvj krb5kdc[11795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007657, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.65@KRBTEST.COM
I20260806 09:14:17.861678 12319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:17.844311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51042 (local address 127.10.255.65:35685)
0806 09:14:17.844542 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:17.844549 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:17.844958 (+ 409us) server_negotiation.cc:407] Connection header received
0806 09:14:17.845188 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:17.845193 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:17.845264 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:17.845381 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:17.846954 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.847810 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.849339 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.849816 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.849972 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:17.854540 (+ 4568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:17.854546 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:17.854550 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:17.854598 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:17.857958 (+ 3360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:17.859046 (+ 1088us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:17.859053 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:17.859055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:17.859240 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:17.859775 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:17.859786 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:17.859788 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:17.860288 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:17.860640 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:17.860972 (+ 332us) server_negotiation.cc:299] Negotiation successful
0806 09:14:17.861265 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260806 09:14:17.864918 11945 tablet_service.cc:2908] Rejecting scan request for tablet 6cc4dcfbf77c49ba8122401ca06adbbc: Uninitialized: clean time has not yet been initialized
I20260806 09:14:17.869354 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 11902
I20260806 09:14:17.885578 12319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:17.870457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51046 (local address 127.10.255.65:35685)
0806 09:14:17.870714 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:17.870723 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:17.871027 (+ 304us) server_negotiation.cc:407] Connection header received
0806 09:14:17.871382 (+ 355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:17.871395 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:17.871489 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:17.871623 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:17.873075 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.873836 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.875204 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:17.875655 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:17.875828 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:17.878781 (+ 2953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:17.878787 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:17.878790 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:17.878832 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:17.882098 (+ 3266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:17.882946 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:17.882951 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:17.882953 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:17.883112 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:17.883615 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:17.883619 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:17.883621 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:17.884045 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:17.884257 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:17.884890 (+ 633us) server_negotiation.cc:299] Negotiation successful
0806 09:14:17.885198 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 09:14:17.886356 12026 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:17.985230 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 11902
I20260806 09:14:18.006376 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 12037
Aug 06 09:14:18 dist-test-slave-mvvj krb5kdc[11795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007657, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.66@KRBTEST.COM
I20260806 09:14:18.025779 12316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:18.007316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34752 (local address 127.10.255.66:33733)
0806 09:14:18.007590 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:18.007595 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:18.007617 (+ 22us) server_negotiation.cc:407] Connection header received
0806 09:14:18.008027 (+ 410us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:18.008032 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:18.008120 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:18.008225 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:18.009597 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:18.010388 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:18.012012 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:18.012485 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:18.012630 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:18.017693 (+ 5063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:18.017712 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:18.017731 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:18.017777 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:18.021617 (+ 3840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:18.022799 (+ 1182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:18.022808 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:18.022811 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:18.022997 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:18.023564 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:18.023569 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:18.023571 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:18.024314 (+ 743us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:18.024588 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:18.025048 (+ 460us) server_negotiation.cc:299] Negotiation successful
0806 09:14:18.025273 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260806 09:14:18.026768 12161 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:18.124939 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 12037
W20260806 09:14:18.145619 12188 connection.cc:535] server connection from 127.10.255.66:45495 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 09:14:18.146049 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 12172
Aug 06 09:14:18 dist-test-slave-mvvj krb5kdc[11795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007657, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.67@KRBTEST.COM
I20260806 09:14:18.165320 12317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:18.146989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50484 (local address 127.10.255.67:40295)
0806 09:14:18.147196 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:18.147204 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:18.147228 (+ 24us) server_negotiation.cc:407] Connection header received
0806 09:14:18.147501 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:18.147507 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:18.147607 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:18.147721 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:18.149192 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:18.150113 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:18.151937 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:18.152666 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:18.152799 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:18.157815 (+ 5016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:18.157833 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:18.157856 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:18.157922 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:18.161981 (+ 4059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:18.162867 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:18.162878 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:18.162882 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:18.163060 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:18.163446 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:18.163450 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:18.163453 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:18.164138 (+ 685us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:18.164477 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:18.164749 (+ 272us) server_negotiation.cc:299] Negotiation successful
0806 09:14:18.164989 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 09:14:18.166213 12296 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:18.261972 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 12172
I20260806 09:14:18.282605 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 11808
I20260806 09:14:18.284006 11870 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:18.402814 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 11808
2026-08-06T09:14:18Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (5849 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:14:18 dist-test-slave-mvvj krb5kdc[12352](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:14:18 dist-test-slave-mvvj krb5kdc[12352](info): set up 2 sockets
Aug 06 09:14:18 dist-test-slave-mvvj krb5kdc[12352](info): commencing operation
krb5kdc: starting...
W20260806 09:14:19.583426 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.001s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:14:19 dist-test-slave-mvvj krb5kdc[12352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007659, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:14:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:14:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:14:19.809326 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:43071
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:45593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:43071
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:20.182719 12365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:20.183151 12365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:20.183338 12365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:20.191151 12365 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:14:20.191331 12365 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 09:14:20.191442 12365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:20.191563 12365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:20.191660 12365 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:14:20.191754 12365 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:14:20.202452 12365 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:45593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:43071
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:43071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:20.204013 12365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:20.205538 12365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:20.220064 12371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:20.220018 12370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:20.220104 12373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:20.221515 12365 server_base.cc:1034] running on GCE node
I20260806 09:14:20.222860 12365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:20.225049 12365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:20.226431 12365 hybrid_clock.cc:648] HybridClock initialized: now 1786007660226351 us; error 52 us; skew 500 ppm
I20260806 09:14:20.226927 12365 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:20 dist-test-slave-mvvj krb5kdc[12352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007660, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:20.235522 12365 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:14:20.237430 12365 webserver.cc:460] Webserver started at http://127.10.255.126:42159/ using document root <none> and password file <none>
I20260806 09:14:20.238198 12365 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:20.238292 12365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:20.238615 12365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:20.242071 12365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "ff43d84fe1e4471e88eda96e1163934b"
format_stamp: "Formatted at 2026-08-06 09:14:20 on dist-test-slave-mvvj"
server_key: "407e905369e37e594ce09ee80b88a8e7"
server_key_iv: "77579a85637a08f412fce0d9d8f18353"
server_key_version: "encryptionkey@0"
I20260806 09:14:20.242936 12365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "ff43d84fe1e4471e88eda96e1163934b"
format_stamp: "Formatted at 2026-08-06 09:14:20 on dist-test-slave-mvvj"
server_key: "407e905369e37e594ce09ee80b88a8e7"
server_key_iv: "77579a85637a08f412fce0d9d8f18353"
server_key_version: "encryptionkey@0"
I20260806 09:14:20.249239 12365 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260806 09:14:20.253499 12380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:20.255136 12365 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:14:20.255311 12365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "ff43d84fe1e4471e88eda96e1163934b"
format_stamp: "Formatted at 2026-08-06 09:14:20 on dist-test-slave-mvvj"
server_key: "407e905369e37e594ce09ee80b88a8e7"
server_key_iv: "77579a85637a08f412fce0d9d8f18353"
server_key_version: "encryptionkey@0"
I20260806 09:14:20.255539 12365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:20.281829 12365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:20.288352 12365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:20.288679 12365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:20.318202 12365 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:43071
I20260806 09:14:20.318238 12441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:43071 every 8 connection(s)
I20260806 09:14:20.319924 12365 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:14:20.323769 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 12365
I20260806 09:14:20.324101 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:14:20.324849 11261 external_mini_cluster.cc:1428] Setting key 6a54ba7943c9547366cab4c221a282cd
I20260806 09:14:20.325209 12442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:20.341712 12442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b: Bootstrap starting.
Aug 06 09:14:20 dist-test-slave-mvvj krb5kdc[12352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007659, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:20.345988 12442 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:20.347666 12442 log.cc:824] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:20.351914 12442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b: No bootstrap required, opened a new log
I20260806 09:14:20.354183 12445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:20.327302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33126 (local address 127.10.255.126:43071)
0806 09:14:20.328327 (+ 1025us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:20.328344 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:20.328397 (+ 53us) server_negotiation.cc:407] Connection header received
0806 09:14:20.330586 (+ 2189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:20.330615 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:20.331174 (+ 559us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:20.331603 (+ 429us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:20.333753 (+ 2150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:20.335809 (+ 2056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:20.337372 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:20.338688 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:20.338920 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:20.344045 (+ 5125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:20.344060 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:20.344083 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:20.344151 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:20.348733 (+ 4582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:20.349774 (+ 1041us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:20.349783 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:20.349794 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:20.350095 (+ 301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:20.350644 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:20.350653 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:20.350656 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:20.351436 (+ 780us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:20.351751 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:20.352434 (+ 683us) server_negotiation.cc:299] Negotiation successful
0806 09:14:20.352992 (+ 558us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":767,"thread_start_us":489,"threads_started":1}
I20260806 09:14:20.361475 12442 raft_consensus.cc:348] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff43d84fe1e4471e88eda96e1163934b" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 43071 } }
I20260806 09:14:20.362007 12442 raft_consensus.cc:374] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:20.362133 12442 raft_consensus.cc:729] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff43d84fe1e4471e88eda96e1163934b, State: Initialized, Role: FOLLOWER
I20260806 09:14:20.362854 12442 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff43d84fe1e4471e88eda96e1163934b" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 43071 } }
I20260806 09:14:20.363137 12442 raft_consensus.cc:388] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:14:20.363297 12442 raft_consensus.cc:482] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:14:20.363487 12442 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:20.365895 12442 raft_consensus.cc:504] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff43d84fe1e4471e88eda96e1163934b" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 43071 } }
I20260806 09:14:20.366490 12442 leader_election.cc:302] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff43d84fe1e4471e88eda96e1163934b; no voters:
I20260806 09:14:20.367278 12442 leader_election.cc:288] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:14:20.367509 12447 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:14:20.369110 12447 raft_consensus.cc:686] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b [term 1 LEADER]: Becoming Leader. State: Replica: ff43d84fe1e4471e88eda96e1163934b, State: Running, Role: LEADER
I20260806 09:14:20.369747 12447 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff43d84fe1e4471e88eda96e1163934b" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 43071 } }
I20260806 09:14:20.370095 12442 sys_catalog.cc:564] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:14:20.373667 12448 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff43d84fe1e4471e88eda96e1163934b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff43d84fe1e4471e88eda96e1163934b" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 43071 } } }
I20260806 09:14:20.374171 12448 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:20.374698 12449 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff43d84fe1e4471e88eda96e1163934b. Latest consensus state: current_term: 1 leader_uuid: "ff43d84fe1e4471e88eda96e1163934b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff43d84fe1e4471e88eda96e1163934b" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 43071 } } }
I20260806 09:14:20.375097 12449 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:20.379904 12457 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:14:20.386348 12457 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:14:20.396836 12457 catalog_manager.cc:1347] Generated new cluster ID: 7811289fa9e142d2a066f7d2df183bb1
I20260806 09:14:20.396994 12457 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:14:20.406869 12457 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:14:20.409175 12457 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:14:20.418411 12457 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b: Generated new TSK 0
I20260806 09:14:20.419714 12457 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.255.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
I20260806 09:14:20.480861 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:43071
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:45593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:20.861544 12468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:20.861920 12468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:20.862105 12468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:20.869966 12468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:20.870155 12468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:20.870316 12468 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 09:14:20.870488 12468 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:14:20.881848 12468 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:45593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.255.126:43071
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:20.883405 12468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:20.885058 12468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:20.901257 12473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:20.901196 12474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:20.901602 12476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:20.903184 12468 server_base.cc:1034] running on GCE node
I20260806 09:14:20.904145 12468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:20.905402 12468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:20.906785 12468 hybrid_clock.cc:648] HybridClock initialized: now 1786007660906676 us; error 96 us; skew 500 ppm
I20260806 09:14:20.907166 12468 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:20 dist-test-slave-mvvj krb5kdc[12352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007660, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:20.911413 12468 init.cc:377] Logged in from keytab as kudu/127.10.255.65@KRBTEST.COM (short username kudu)
I20260806 09:14:20.913950 12468 webserver.cc:460] Webserver started at http://127.10.255.65:46333/ using document root <none> and password file <none>
I20260806 09:14:20.915171 12468 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:20.915437 12468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:20.915997 12468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:20.920025 12468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "742ab1485d364919a0a06cad9b00cae6"
format_stamp: "Formatted at 2026-08-06 09:14:20 on dist-test-slave-mvvj"
server_key: "b2bbf0b2bfc355dff258d9a1dfa46efb"
server_key_iv: "a3e627f1a9de80801534494b136ecb56"
server_key_version: "encryptionkey@0"
I20260806 09:14:20.921065 12468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "742ab1485d364919a0a06cad9b00cae6"
format_stamp: "Formatted at 2026-08-06 09:14:20 on dist-test-slave-mvvj"
server_key: "b2bbf0b2bfc355dff258d9a1dfa46efb"
server_key_iv: "a3e627f1a9de80801534494b136ecb56"
server_key_version: "encryptionkey@0"
I20260806 09:14:20.927460 12468 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.003s
I20260806 09:14:20.931795 12483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:20.933614 12468 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260806 09:14:20.933846 12468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "742ab1485d364919a0a06cad9b00cae6"
format_stamp: "Formatted at 2026-08-06 09:14:20 on dist-test-slave-mvvj"
server_key: "b2bbf0b2bfc355dff258d9a1dfa46efb"
server_key_iv: "a3e627f1a9de80801534494b136ecb56"
server_key_version: "encryptionkey@0"
I20260806 09:14:20.934125 12468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:20.971563 12468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:20.977388 12468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:20.977775 12468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:20.981194 12468 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:20.981324 12468 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:20.981521 12468 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:20.981612 12468 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 09:14:20 dist-test-slave-mvvj krb5kdc[12352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007660, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:21.011754 12492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:20.982046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:52377 (local address 127.10.255.126:43071)
0806 09:14:20.982887 (+ 841us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:20.982894 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:20.984193 (+ 1299us) server_negotiation.cc:407] Connection header received
0806 09:14:20.987006 (+ 2813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:20.987016 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:20.987136 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:20.987275 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:20.990504 (+ 3229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:20.991715 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:20.995445 (+ 3730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:20.996110 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:20.996298 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:21.002227 (+ 5929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:21.002237 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:21.002245 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:21.002305 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:21.006912 (+ 4607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:21.008588 (+ 1676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:21.008596 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:21.008602 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:21.008822 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:21.009449 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:21.009454 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:21.009457 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:21.009776 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:21.009962 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:21.010882 (+ 920us) server_negotiation.cc:299] Negotiation successful
0806 09:14:21.011347 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":711,"thread_start_us":584,"threads_started":1}
I20260806 09:14:21.013360 12493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:20.982858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:43071 (local address 127.10.255.65:52377)
0806 09:14:20.983987 (+ 1129us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:20.984039 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:20.986542 (+ 2503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:20.988029 (+ 1487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:20.988047 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:20.989110 (+ 1063us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:20.990240 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:20.990282 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:20.992023 (+ 1741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:20.992032 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:20.995191 (+ 3159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:20.995223 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:20.996402 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:20.996413 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:20.996673 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:20.997513 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:20.997558 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:21.001655 (+ 4097us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:21.007191 (+ 5536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:21.007211 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:21.007240 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:21.008286 (+ 1046us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:21.008993 (+ 707us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:21.009005 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:21.009015 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:21.009275 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:21.009951 (+ 676us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:21.009961 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:21.010430 (+ 469us) client_negotiation.cc:769] Sending connection context
0806 09:14:21.010728 (+ 298us) client_negotiation.cc:240] Negotiation successful
0806 09:14:21.011555 (+ 827us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":731,"thread_start_us":453,"threads_started":1}
I20260806 09:14:21.039316 12492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:21.022858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:52743 (local address 127.10.255.126:43071)
0806 09:14:21.023113 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:21.023120 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:21.024393 (+ 1273us) server_negotiation.cc:407] Connection header received
0806 09:14:21.024698 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:21.024707 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:21.024817 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:21.024951 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:21.026772 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:21.027784 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:21.029371 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:21.029859 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:21.030026 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:21.032166 (+ 2140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:21.032172 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:21.032175 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:21.032211 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:21.035702 (+ 3491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:21.036540 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:21.036546 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:21.036551 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:21.036693 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:21.037486 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:21.037491 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:21.037493 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:21.037796 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:21.037927 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:21.038705 (+ 778us) server_negotiation.cc:299] Negotiation successful
0806 09:14:21.038979 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260806 09:14:21.039821 12561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:21.023094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:43071 (local address 127.10.255.65:52743)
0806 09:14:21.024211 (+ 1117us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:21.024239 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:21.024508 (+ 269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:21.024993 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:21.024998 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:21.025969 (+ 971us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:21.026493 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:21.026508 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:21.027972 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:21.027978 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:21.029190 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:21.029211 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:21.030121 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:21.030128 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:21.030294 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:21.031024 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:21.031044 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:21.031930 (+ 886us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:21.035900 (+ 3970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:21.035911 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:21.035916 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:21.036384 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:21.036938 (+ 554us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:21.036947 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:21.036955 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:21.037303 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:21.037944 (+ 641us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:21.037953 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:21.038308 (+ 355us) client_negotiation.cc:769] Sending connection context
0806 09:14:21.038541 (+ 233us) client_negotiation.cc:240] Negotiation successful
0806 09:14:21.039136 (+ 595us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":842,"thread_start_us":403,"threads_started":1}
I20260806 09:14:21.051534 12468 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:45749
I20260806 09:14:21.051560 12603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:45749 every 8 connection(s)
I20260806 09:14:21.053104 12468 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:14:21.056027 12604 heartbeater.cc:347] Connected to a master server at 127.10.255.126:43071
I20260806 09:14:21.056277 12604 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:21.057106 12604 heartbeater.cc:511] Master 127.10.255.126:43071 requested a full tablet report, sending...
I20260806 09:14:21.059146 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 12468
I20260806 09:14:21.059468 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:14:21.059521 12397 ts_manager.cc:194] Registered new tserver with Master: 742ab1485d364919a0a06cad9b00cae6 (127.10.255.65:45749)
I20260806 09:14:21.060281 11261 external_mini_cluster.cc:1428] Setting key 9891da9895e97ff5d872f38bf58e44d1
I20260806 09:14:21.061498 12397 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.65@KRBTEST.COM'} at 127.10.255.65:52377
WARNING: no policy specified for kudu/127.10.255.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
I20260806 09:14:21.119642 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:43071
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:45593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:21.498497 12608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:21.498844 12608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:21.499029 12608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:21.507812 12608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:21.508090 12608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:21.508268 12608 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 09:14:21.508409 12608 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:14:21.520627 12608 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:45593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.255.126:43071
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:21.522270 12608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:21.523767 12608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:21.539233 12613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:21.539139 12614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:21.539180 12616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:21.546463 12608 server_base.cc:1034] running on GCE node
I20260806 09:14:21.547365 12608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:21.548676 12608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:21.549973 12608 hybrid_clock.cc:648] HybridClock initialized: now 1786007661549875 us; error 75 us; skew 500 ppm
I20260806 09:14:21.550379 12608 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:21 dist-test-slave-mvvj krb5kdc[12352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007661, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:21.554272 12608 init.cc:377] Logged in from keytab as kudu/127.10.255.66@KRBTEST.COM (short username kudu)
I20260806 09:14:21.556144 12608 webserver.cc:460] Webserver started at http://127.10.255.66:36593/ using document root <none> and password file <none>
I20260806 09:14:21.557017 12608 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:21.557171 12608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:21.557540 12608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:21.561046 12608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "75e561d75c464b2f9fac6f4fc858bff5"
format_stamp: "Formatted at 2026-08-06 09:14:21 on dist-test-slave-mvvj"
server_key: "5b7ffafb00935511073806a66d4c6451"
server_key_iv: "ed69fbddd0a1f9a7473aec022bfa19d4"
server_key_version: "encryptionkey@0"
I20260806 09:14:21.561946 12608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "75e561d75c464b2f9fac6f4fc858bff5"
format_stamp: "Formatted at 2026-08-06 09:14:21 on dist-test-slave-mvvj"
server_key: "5b7ffafb00935511073806a66d4c6451"
server_key_iv: "ed69fbddd0a1f9a7473aec022bfa19d4"
server_key_version: "encryptionkey@0"
I20260806 09:14:21.568120 12608 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260806 09:14:21.572187 12624 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:21.573915 12608 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:14:21.574134 12608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "75e561d75c464b2f9fac6f4fc858bff5"
format_stamp: "Formatted at 2026-08-06 09:14:21 on dist-test-slave-mvvj"
server_key: "5b7ffafb00935511073806a66d4c6451"
server_key_iv: "ed69fbddd0a1f9a7473aec022bfa19d4"
server_key_version: "encryptionkey@0"
I20260806 09:14:21.574422 12608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:21.598578 12608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:21.604197 12608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:21.604560 12608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:21.608096 12608 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:21.608246 12608 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:21.608417 12608 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:21.608517 12608 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 09:14:21 dist-test-slave-mvvj krb5kdc[12352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007661, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:21.636655 12632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:21.608620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:34113 (local address 127.10.255.126:43071)
0806 09:14:21.609183 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:21.609191 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:21.610961 (+ 1770us) server_negotiation.cc:407] Connection header received
0806 09:14:21.613976 (+ 3015us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:21.613984 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:21.614105 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:21.614271 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:21.617165 (+ 2894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:21.618318 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:21.621752 (+ 3434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:21.622508 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:21.622692 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:21.628388 (+ 5696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:21.628394 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:21.628398 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:21.628441 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:21.631825 (+ 3384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:21.633323 (+ 1498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:21.633333 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:21.633337 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:21.633568 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:21.634245 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:21.634251 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:21.634255 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:21.634599 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:21.634803 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:21.635688 (+ 885us) server_negotiation.cc:299] Negotiation successful
0806 09:14:21.636031 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":268,"threads_started":1}
I20260806 09:14:21.638392 12634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:21.609623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:43071 (local address 127.10.255.66:34113)
0806 09:14:21.610654 (+ 1031us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:21.610704 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:21.613492 (+ 2788us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:21.614705 (+ 1213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:21.614718 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:21.615639 (+ 921us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:21.616818 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:21.616892 (+ 74us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:21.618565 (+ 1673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:21.618569 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:21.621302 (+ 2733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:21.621325 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:21.622860 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:21.622872 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:21.623142 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:21.624220 (+ 1078us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:21.624281 (+ 61us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:21.628034 (+ 3753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:21.632160 (+ 4126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:21.632173 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:21.632206 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:21.633035 (+ 829us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:21.633750 (+ 715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:21.633758 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:21.633765 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:21.634084 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:21.634761 (+ 677us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:21.634772 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:21.635245 (+ 473us) client_negotiation.cc:769] Sending connection context
0806 09:14:21.635570 (+ 325us) client_negotiation.cc:240] Negotiation successful
0806 09:14:21.636296 (+ 726us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":669,"thread_start_us":436,"threads_started":1}
I20260806 09:14:21.669523 12697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:21.646332 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:43071 (local address 127.10.255.66:58883)
0806 09:14:21.650037 (+ 3705us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:21.650055 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:21.650205 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:21.650584 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:21.650589 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:21.651161 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:21.651531 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:21.651542 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:21.652957 (+ 1415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:21.652963 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:21.655542 (+ 2579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:21.655571 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:21.657164 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:21.657176 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:21.657488 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:21.658588 (+ 1100us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:21.658621 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:21.660121 (+ 1500us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:21.665505 (+ 5384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:21.665516 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:21.665523 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:21.666378 (+ 855us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:21.666961 (+ 583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:21.666966 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:21.666969 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:21.667189 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:21.668121 (+ 932us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:21.668127 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:21.668421 (+ 294us) client_negotiation.cc:769] Sending connection context
0806 09:14:21.668657 (+ 236us) client_negotiation.cc:240] Negotiation successful
0806 09:14:21.669105 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3555,"thread_start_us":3410,"threads_started":1}
I20260806 09:14:21.670029 12632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:21.646862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:58883 (local address 127.10.255.126:43071)
0806 09:14:21.647140 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:21.647150 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:21.650178 (+ 3028us) server_negotiation.cc:407] Connection header received
0806 09:14:21.650315 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:21.650319 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:21.650395 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:21.650541 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:21.651710 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:21.652752 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:21.655813 (+ 3061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:21.656624 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:21.656795 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:21.660334 (+ 3539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:21.660375 (+ 41us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:21.660380 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:21.660433 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:21.665236 (+ 4803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:21.666646 (+ 1410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:21.666650 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:21.666653 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:21.666810 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:21.667359 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:21.667364 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:21.667366 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:21.667944 (+ 578us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:21.668139 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:21.668890 (+ 751us) server_negotiation.cc:299] Negotiation successful
0806 09:14:21.669354 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260806 09:14:21.676893 12608 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:36845
I20260806 09:14:21.676929 12746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:36845 every 8 connection(s)
I20260806 09:14:21.678608 12608 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:14:21.681329 12747 heartbeater.cc:347] Connected to a master server at 127.10.255.126:43071
I20260806 09:14:21.681674 12747 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:21.682456 12747 heartbeater.cc:511] Master 127.10.255.126:43071 requested a full tablet report, sending...
I20260806 09:14:21.684238 12396 ts_manager.cc:194] Registered new tserver with Master: 75e561d75c464b2f9fac6f4fc858bff5 (127.10.255.66:36845)
I20260806 09:14:21.684369 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 12608
I20260806 09:14:21.684680 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:14:21.685177 11261 external_mini_cluster.cc:1428] Setting key 7155d0d12ab97f3b2d122c8c47664e7b
I20260806 09:14:21.685376 12396 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.66@KRBTEST.COM'} at 127.10.255.66:34113
WARNING: no policy specified for kudu/127.10.255.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
I20260806 09:14:21.736583 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:43071
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:45593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:14:22.065155 12604 heartbeater.cc:503] Master 127.10.255.126:43071 was elected leader, sending a full tablet report...
W20260806 09:14:22.114363 12751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:22.114708 12751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:22.114894 12751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:22.123226 12751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:22.123379 12751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:22.123523 12751 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 09:14:22.123663 12751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:14:22.134745 12751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:45593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.255.126:43071
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:22.136305 12751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:22.138012 12751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:22.155095 12757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:22.155193 12756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:22.155418 12759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:22.156585 12751 server_base.cc:1034] running on GCE node
I20260806 09:14:22.157330 12751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:22.158622 12751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:22.159997 12751 hybrid_clock.cc:648] HybridClock initialized: now 1786007662159927 us; error 36 us; skew 500 ppm
I20260806 09:14:22.160481 12751 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:22 dist-test-slave-mvvj krb5kdc[12352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007662, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:22.164171 12751 init.cc:377] Logged in from keytab as kudu/127.10.255.67@KRBTEST.COM (short username kudu)
I20260806 09:14:22.165812 12751 webserver.cc:460] Webserver started at http://127.10.255.67:41091/ using document root <none> and password file <none>
I20260806 09:14:22.166615 12751 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:22.166718 12751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:22.167009 12751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:22.170578 12751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05"
format_stamp: "Formatted at 2026-08-06 09:14:22 on dist-test-slave-mvvj"
server_key: "427f8ab34d7c7ea5445051927ef32227"
server_key_iv: "88c136933c9271cc4d65420a3fc9df09"
server_key_version: "encryptionkey@0"
I20260806 09:14:22.171504 12751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05"
format_stamp: "Formatted at 2026-08-06 09:14:22 on dist-test-slave-mvvj"
server_key: "427f8ab34d7c7ea5445051927ef32227"
server_key_iv: "88c136933c9271cc4d65420a3fc9df09"
server_key_version: "encryptionkey@0"
I20260806 09:14:22.177688 12751 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260806 09:14:22.182408 12766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:22.184496 12751 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 09:14:22.184690 12751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05"
format_stamp: "Formatted at 2026-08-06 09:14:22 on dist-test-slave-mvvj"
server_key: "427f8ab34d7c7ea5445051927ef32227"
server_key_iv: "88c136933c9271cc4d65420a3fc9df09"
server_key_version: "encryptionkey@0"
I20260806 09:14:22.184924 12751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:22.210655 12751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:22.215755 12751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:22.216126 12751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:22.219774 12751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:22.219959 12751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260806 09:14:22.220149 12751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:22.220234 12751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 09:14:22 dist-test-slave-mvvj krb5kdc[12352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007662, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:22.250239 12776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:22.220641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:59145 (local address 127.10.255.126:43071)
0806 09:14:22.221249 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:22.221255 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:22.222705 (+ 1450us) server_negotiation.cc:407] Connection header received
0806 09:14:22.225538 (+ 2833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:22.225543 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:22.225626 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:22.225742 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:22.228759 (+ 3017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.230035 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.232746 (+ 2711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.233400 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.233538 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:22.241250 (+ 7712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:22.241259 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:22.241266 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:22.241327 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:22.245498 (+ 4171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:22.246856 (+ 1358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:22.246862 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:22.246865 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:22.247089 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:22.248016 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:22.248025 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:22.248030 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:22.248417 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:22.248624 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:22.249476 (+ 852us) server_negotiation.cc:299] Negotiation successful
0806 09:14:22.249784 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":321,"threads_started":1}
I20260806 09:14:22.251504 12777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:22.221470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:43071 (local address 127.10.255.67:59145)
0806 09:14:22.222454 (+ 984us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:22.222509 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:22.225032 (+ 2523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:22.226396 (+ 1364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:22.226414 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:22.227382 (+ 968us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:22.228490 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:22.228539 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.230243 (+ 1704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.230249 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:22.232514 (+ 2265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:22.232547 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.233865 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.233872 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:22.234150 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:22.237053 (+ 2903us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:22.237095 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:22.240860 (+ 3765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:22.245721 (+ 4861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:22.245746 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:22.245774 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:22.246660 (+ 886us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:22.247260 (+ 600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:22.247269 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:22.247275 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:22.247790 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:22.248599 (+ 809us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:22.248609 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:22.249043 (+ 434us) client_negotiation.cc:769] Sending connection context
0806 09:14:22.249356 (+ 313us) client_negotiation.cc:240] Negotiation successful
0806 09:14:22.250019 (+ 663us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"thread_start_us":438,"threads_started":1}
I20260806 09:14:22.282018 12776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:22.258724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:33369 (local address 127.10.255.126:43071)
0806 09:14:22.259126 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:22.259135 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:22.265064 (+ 5929us) server_negotiation.cc:407] Connection header received
0806 09:14:22.265497 (+ 433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:22.265504 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:22.265632 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:22.265788 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:22.267242 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.268178 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.270428 (+ 2250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.271148 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.271310 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:22.274303 (+ 2993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:22.274314 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:22.274317 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:22.274353 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:22.278194 (+ 3841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:22.279327 (+ 1133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:22.279336 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:22.279339 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:22.279500 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:22.280015 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:22.280024 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:22.280029 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:22.280586 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:22.280857 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:22.281351 (+ 494us) server_negotiation.cc:299] Negotiation successful
0806 09:14:22.281610 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232}
I20260806 09:14:22.282204 12839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:22.258725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:43071 (local address 127.10.255.67:33369)
0806 09:14:22.264857 (+ 6132us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:22.264890 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:22.265251 (+ 361us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:22.265830 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:22.265838 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:22.266504 (+ 666us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:22.267051 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:22.267065 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.268352 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.268358 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:22.270182 (+ 1824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:22.270207 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.271377 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.271383 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:22.271633 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:22.272429 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:22.272473 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:22.273976 (+ 1503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:22.278434 (+ 4458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:22.278446 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:22.278453 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:22.279174 (+ 721us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:22.279631 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:22.279637 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:22.279641 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:22.279788 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:22.280771 (+ 983us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:22.280775 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:22.281062 (+ 287us) client_negotiation.cc:769] Sending connection context
0806 09:14:22.281236 (+ 174us) client_negotiation.cc:240] Negotiation successful
0806 09:14:22.281702 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5837,"thread_start_us":5493,"threads_started":1}
I20260806 09:14:22.295543 12751 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:45899
I20260806 09:14:22.295583 12889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:45899 every 8 connection(s)
I20260806 09:14:22.297055 12751 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:14:22.299662 12890 heartbeater.cc:347] Connected to a master server at 127.10.255.126:43071
I20260806 09:14:22.300004 12890 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:22.300773 12890 heartbeater.cc:511] Master 127.10.255.126:43071 requested a full tablet report, sending...
I20260806 09:14:22.301643 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 12751
I20260806 09:14:22.301870 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:14:22.302364 11261 external_mini_cluster.cc:1428] Setting key 6855a0996756548f6e7a7bb854d9080d
I20260806 09:14:22.303057 12396 ts_manager.cc:194] Registered new tserver with Master: 7f13d3bc57b24c5eb8b7b02ea4853b05 (127.10.255.67:45899)
I20260806 09:14:22.304162 12396 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.67@KRBTEST.COM'} at 127.10.255.67:59145
I20260806 09:14:22.305949 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 09:14:22 dist-test-slave-mvvj krb5kdc[12352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007662, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 09:14:22 dist-test-slave-mvvj krb5kdc[12352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007662, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:22.361126 12776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:22.344270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33134 (local address 127.10.255.126:43071)
0806 09:14:22.344591 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:22.344599 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:22.344931 (+ 332us) server_negotiation.cc:407] Connection header received
0806 09:14:22.345240 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:22.345245 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:22.345316 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:22.345443 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:22.347057 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.347793 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.349256 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.349718 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.349861 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:22.354595 (+ 4734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:22.354600 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:22.354604 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:22.354650 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:22.357875 (+ 3225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:22.358757 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:22.358762 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:22.358765 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:22.358927 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:22.359425 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:22.359430 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:22.359432 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:22.359770 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:22.360097 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:22.360616 (+ 519us) server_negotiation.cc:299] Negotiation successful
0806 09:14:22.360810 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260806 09:14:22.366755 12396 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33134:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:14:22.375325 12396 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:14:22.403098 12903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:22.391766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:45899 (local address 127.0.0.1:51758)
0806 09:14:22.392627 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:22.392670 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:22.392881 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:22.394163 (+ 1282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:22.394177 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:22.394208 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:22.394669 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:22.394684 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.396989 (+ 2305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.396997 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:22.399604 (+ 2607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:22.399618 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.401914 (+ 2296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.401923 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:22.402161 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:22.402233 (+ 72us) client_negotiation.cc:769] Sending connection context
0806 09:14:22.402393 (+ 160us) client_negotiation.cc:240] Negotiation successful
0806 09:14:22.402615 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"mutex_wait_us":1,"thread_start_us":424,"threads_started":1}
I20260806 09:14:22.404663 12904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:22.392135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51758 (local address 127.10.255.67:45899)
0806 09:14:22.392913 (+ 778us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:22.392919 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:22.392951 (+ 32us) server_negotiation.cc:407] Connection header received
0806 09:14:22.393156 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:22.393164 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:22.393595 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:22.393810 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:22.394945 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.396809 (+ 1864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.399805 (+ 2996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.401628 (+ 1823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.401808 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:22.402079 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:22.403994 (+ 1915us) server_negotiation.cc:299] Negotiation successful
0806 09:14:22.404229 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":424,"threads_started":1}
I20260806 09:14:22.404742 12905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:22.393178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:36845 (local address 127.0.0.1:32900)
0806 09:14:22.393791 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:22.393810 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:22.393946 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:22.397745 (+ 3799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:22.397750 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:22.397806 (+ 56us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:22.398272 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:22.398284 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.400243 (+ 1959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.400249 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:22.401943 (+ 1694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:22.401957 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.403946 (+ 1989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.403956 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:22.404096 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:22.404123 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 09:14:22.404182 (+ 59us) client_negotiation.cc:240] Negotiation successful
0806 09:14:22.404282 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":449,"mutex_wait_us":5,"thread_start_us":312,"threads_started":1}
I20260806 09:14:22.405403 12907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:22.393939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:45749 (local address 127.0.0.1:34474)
0806 09:14:22.396201 (+ 2262us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:22.396222 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:22.396357 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:22.397182 (+ 825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:22.397187 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:22.397215 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:22.397733 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:22.397744 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.399892 (+ 2148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.399900 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:22.402321 (+ 2421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:22.402336 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.404527 (+ 2191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.404534 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:22.404724 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:22.404776 (+ 52us) client_negotiation.cc:769] Sending connection context
0806 09:14:22.404882 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 09:14:22.405034 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2134,"mutex_wait_us":3,"thread_start_us":2011,"threads_started":1}
I20260806 09:14:22.406188 12908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:22.394628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34474 (local address 127.10.255.65:45749)
0806 09:14:22.395745 (+ 1117us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:22.395754 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:22.396359 (+ 605us) server_negotiation.cc:407] Connection header received
0806 09:14:22.396576 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:22.396584 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:22.396936 (+ 352us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:22.397193 (+ 257us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:22.398026 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.399677 (+ 1651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.402583 (+ 2906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.404270 (+ 1687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.404446 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:22.404697 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:22.405662 (+ 965us) server_negotiation.cc:299] Negotiation successful
0806 09:14:22.405862 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":934,"thread_start_us":771,"threads_started":1}
I20260806 09:14:22.406996 12906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:22.393511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32900 (local address 127.10.255.66:36845)
0806 09:14:22.396861 (+ 3350us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:22.396871 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:22.396902 (+ 31us) server_negotiation.cc:407] Connection header received
0806 09:14:22.397015 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:22.397021 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:22.397280 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:22.397498 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:22.398602 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.400095 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.402160 (+ 2065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.403652 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.406166 (+ 2514us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:22.406414 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:22.406504 (+ 90us) server_negotiation.cc:299] Negotiation successful
0806 09:14:22.406692 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3165,"thread_start_us":3041,"threads_started":1}
I20260806 09:14:22.409358 12819 tablet_service.cc:1467] Processing CreateTablet for tablet 9d60a634e40049c7949e9b3338ec8ed6 (DEFAULT_TABLE table=test-table [id=f329985be2244440980dbcc92d082933]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:22.409669 12534 tablet_service.cc:1467] Processing CreateTablet for tablet 9d60a634e40049c7949e9b3338ec8ed6 (DEFAULT_TABLE table=test-table [id=f329985be2244440980dbcc92d082933]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:22.410928 12534 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d60a634e40049c7949e9b3338ec8ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:22.410418 12675 tablet_service.cc:1467] Processing CreateTablet for tablet 9d60a634e40049c7949e9b3338ec8ed6 (DEFAULT_TABLE table=test-table [id=f329985be2244440980dbcc92d082933]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:22.411073 12819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d60a634e40049c7949e9b3338ec8ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:22.411795 12675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d60a634e40049c7949e9b3338ec8ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:22.425442 12909 tablet_bootstrap.cc:492] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6: Bootstrap starting.
I20260806 09:14:22.427476 12910 tablet_bootstrap.cc:492] T 9d60a634e40049c7949e9b3338ec8ed6 P 7f13d3bc57b24c5eb8b7b02ea4853b05: Bootstrap starting.
I20260806 09:14:22.430126 12909 tablet_bootstrap.cc:654] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:22.431232 12911 tablet_bootstrap.cc:492] T 9d60a634e40049c7949e9b3338ec8ed6 P 75e561d75c464b2f9fac6f4fc858bff5: Bootstrap starting.
I20260806 09:14:22.432760 12910 tablet_bootstrap.cc:654] T 9d60a634e40049c7949e9b3338ec8ed6 P 7f13d3bc57b24c5eb8b7b02ea4853b05: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:22.433086 12909 log.cc:824] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:22.434294 12910 log.cc:824] T 9d60a634e40049c7949e9b3338ec8ed6 P 7f13d3bc57b24c5eb8b7b02ea4853b05: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:22.434878 12911 tablet_bootstrap.cc:654] T 9d60a634e40049c7949e9b3338ec8ed6 P 75e561d75c464b2f9fac6f4fc858bff5: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:22.436326 12911 log.cc:824] T 9d60a634e40049c7949e9b3338ec8ed6 P 75e561d75c464b2f9fac6f4fc858bff5: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:22.437104 12909 tablet_bootstrap.cc:492] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6: No bootstrap required, opened a new log
I20260806 09:14:22.437461 12909 ts_tablet_manager.cc:1397] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260806 09:14:22.437997 12910 tablet_bootstrap.cc:492] T 9d60a634e40049c7949e9b3338ec8ed6 P 7f13d3bc57b24c5eb8b7b02ea4853b05: No bootstrap required, opened a new log
I20260806 09:14:22.438369 12910 ts_tablet_manager.cc:1397] T 9d60a634e40049c7949e9b3338ec8ed6 P 7f13d3bc57b24c5eb8b7b02ea4853b05: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.007s
I20260806 09:14:22.439601 12911 tablet_bootstrap.cc:492] T 9d60a634e40049c7949e9b3338ec8ed6 P 75e561d75c464b2f9fac6f4fc858bff5: No bootstrap required, opened a new log
I20260806 09:14:22.439949 12911 ts_tablet_manager.cc:1397] T 9d60a634e40049c7949e9b3338ec8ed6 P 75e561d75c464b2f9fac6f4fc858bff5: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.006s
I20260806 09:14:22.447966 12911 raft_consensus.cc:348] T 9d60a634e40049c7949e9b3338ec8ed6 P 75e561d75c464b2f9fac6f4fc858bff5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } }
I20260806 09:14:22.448414 12911 raft_consensus.cc:374] T 9d60a634e40049c7949e9b3338ec8ed6 P 75e561d75c464b2f9fac6f4fc858bff5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:22.448562 12911 raft_consensus.cc:729] T 9d60a634e40049c7949e9b3338ec8ed6 P 75e561d75c464b2f9fac6f4fc858bff5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75e561d75c464b2f9fac6f4fc858bff5, State: Initialized, Role: FOLLOWER
I20260806 09:14:22.449252 12911 consensus_queue.cc:260] T 9d60a634e40049c7949e9b3338ec8ed6 P 75e561d75c464b2f9fac6f4fc858bff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } }
I20260806 09:14:22.450603 12747 heartbeater.cc:503] Master 127.10.255.126:43071 was elected leader, sending a full tablet report...
I20260806 09:14:22.451073 12911 ts_tablet_manager.cc:1428] T 9d60a634e40049c7949e9b3338ec8ed6 P 75e561d75c464b2f9fac6f4fc858bff5: Time spent starting tablet: real 0.011s user 0.009s sys 0.001s
I20260806 09:14:22.452756 12909 raft_consensus.cc:348] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } }
I20260806 09:14:22.452661 12910 raft_consensus.cc:348] T 9d60a634e40049c7949e9b3338ec8ed6 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } }
I20260806 09:14:22.453455 12909 raft_consensus.cc:374] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:22.453430 12910 raft_consensus.cc:374] T 9d60a634e40049c7949e9b3338ec8ed6 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:22.453675 12910 raft_consensus.cc:729] T 9d60a634e40049c7949e9b3338ec8ed6 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f13d3bc57b24c5eb8b7b02ea4853b05, State: Initialized, Role: FOLLOWER
I20260806 09:14:22.453648 12909 raft_consensus.cc:729] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742ab1485d364919a0a06cad9b00cae6, State: Initialized, Role: FOLLOWER
I20260806 09:14:22.454607 12910 consensus_queue.cc:260] T 9d60a634e40049c7949e9b3338ec8ed6 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } }
I20260806 09:14:22.454576 12909 consensus_queue.cc:260] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } }
I20260806 09:14:22.457481 12909 ts_tablet_manager.cc:1428] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6: Time spent starting tablet: real 0.020s user 0.018s sys 0.000s
I20260806 09:14:22.459120 12890 heartbeater.cc:503] Master 127.10.255.126:43071 was elected leader, sending a full tablet report...
I20260806 09:14:22.460831 12910 ts_tablet_manager.cc:1428] T 9d60a634e40049c7949e9b3338ec8ed6 P 7f13d3bc57b24c5eb8b7b02ea4853b05: Time spent starting tablet: real 0.022s user 0.019s sys 0.002s
W20260806 09:14:22.549096 12891 tablet.cc:2369] T 9d60a634e40049c7949e9b3338ec8ed6 P 7f13d3bc57b24c5eb8b7b02ea4853b05: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 09:14:22.556237 12605 tablet.cc:2369] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 09:14:22.681634 12748 tablet.cc:2369] T 9d60a634e40049c7949e9b3338ec8ed6 P 75e561d75c464b2f9fac6f4fc858bff5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:14:22.716957 12917 raft_consensus.cc:482] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:14:22.717641 12917 raft_consensus.cc:504] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } }
I20260806 09:14:22.720435 12917 leader_election.cc:288] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f13d3bc57b24c5eb8b7b02ea4853b05 (127.10.255.67:45899), 75e561d75c464b2f9fac6f4fc858bff5 (127.10.255.66:36845)
I20260806 09:14:22.736382 12904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:22.721351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:49167 (local address 127.10.255.67:45899)
0806 09:14:22.721651 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:22.721660 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:22.722672 (+ 1012us) server_negotiation.cc:407] Connection header received
0806 09:14:22.722953 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:22.722959 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:22.723131 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:22.723270 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:22.724792 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.725997 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.731571 (+ 5574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.733560 (+ 1989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.734269 (+ 709us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:22.734374 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:22.735860 (+ 1486us) server_negotiation.cc:299] Negotiation successful
0806 09:14:22.736042 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260806 09:14:22.736505 12906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:22.723391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:54507 (local address 127.10.255.66:36845)
0806 09:14:22.723624 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:22.723629 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:22.724121 (+ 492us) server_negotiation.cc:407] Connection header received
0806 09:14:22.724420 (+ 299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:22.724425 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:22.724547 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:22.724645 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:22.725732 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.727023 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.732163 (+ 5140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.734329 (+ 2166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.734577 (+ 248us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:22.734637 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:22.735829 (+ 1192us) server_negotiation.cc:299] Negotiation successful
0806 09:14:22.736030 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260806 09:14:22.737006 12920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:22.722377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:36845 (local address 127.10.255.65:54507)
0806 09:14:22.723955 (+ 1578us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:22.723983 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:22.724220 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:22.724701 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:22.724709 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:22.724737 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:22.725449 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:22.725460 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.727333 (+ 1873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.727350 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:22.731780 (+ 4430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:22.731799 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.734972 (+ 3173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.734977 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:22.735466 (+ 489us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:22.735493 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 09:14:22.735644 (+ 151us) client_negotiation.cc:240] Negotiation successful
0806 09:14:22.735938 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1229,"mutex_wait_us":89,"thread_start_us":800,"threads_started":1}
I20260806 09:14:22.737452 12919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:22.720997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:45899 (local address 127.10.255.65:49167)
0806 09:14:22.722547 (+ 1550us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:22.722567 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:22.722787 (+ 220us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:22.723573 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:22.723579 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:22.723632 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:22.724558 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:22.724572 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.726197 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.726201 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:22.731108 (+ 4907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:22.731155 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.734857 (+ 3702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.734873 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:22.735448 (+ 575us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:22.735493 (+ 45us) client_negotiation.cc:769] Sending connection context
0806 09:14:22.735650 (+ 157us) client_negotiation.cc:240] Negotiation successful
0806 09:14:22.735938 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1166,"mutex_wait_us":222,"thread_start_us":734,"threads_started":1}
I20260806 09:14:22.738899 12844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d60a634e40049c7949e9b3338ec8ed6" candidate_uuid: "742ab1485d364919a0a06cad9b00cae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" is_pre_election: true
I20260806 09:14:22.738891 12701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d60a634e40049c7949e9b3338ec8ed6" candidate_uuid: "742ab1485d364919a0a06cad9b00cae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75e561d75c464b2f9fac6f4fc858bff5" is_pre_election: true
I20260806 09:14:22.739820 12844 raft_consensus.cc:2454] T 9d60a634e40049c7949e9b3338ec8ed6 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 742ab1485d364919a0a06cad9b00cae6 in term 0.
I20260806 09:14:22.740013 12701 raft_consensus.cc:2454] T 9d60a634e40049c7949e9b3338ec8ed6 P 75e561d75c464b2f9fac6f4fc858bff5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 742ab1485d364919a0a06cad9b00cae6 in term 0.
I20260806 09:14:22.740911 12486 leader_election.cc:302] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742ab1485d364919a0a06cad9b00cae6, 7f13d3bc57b24c5eb8b7b02ea4853b05; no voters:
I20260806 09:14:22.741582 12917 raft_consensus.cc:2781] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:14:22.741878 12917 raft_consensus.cc:482] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:14:22.742146 12917 raft_consensus.cc:3037] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:22.746394 12917 raft_consensus.cc:504] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } }
I20260806 09:14:22.747679 12917 leader_election.cc:288] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6 [CANDIDATE]: Term 1 election: Requested vote from peers 7f13d3bc57b24c5eb8b7b02ea4853b05 (127.10.255.67:45899), 75e561d75c464b2f9fac6f4fc858bff5 (127.10.255.66:36845)
I20260806 09:14:22.748586 12701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d60a634e40049c7949e9b3338ec8ed6" candidate_uuid: "742ab1485d364919a0a06cad9b00cae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75e561d75c464b2f9fac6f4fc858bff5"
I20260806 09:14:22.748607 12844 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d60a634e40049c7949e9b3338ec8ed6" candidate_uuid: "742ab1485d364919a0a06cad9b00cae6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05"
I20260806 09:14:22.748972 12844 raft_consensus.cc:3037] T 9d60a634e40049c7949e9b3338ec8ed6 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:22.748968 12701 raft_consensus.cc:3037] T 9d60a634e40049c7949e9b3338ec8ed6 P 75e561d75c464b2f9fac6f4fc858bff5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:22.752504 12701 raft_consensus.cc:2454] T 9d60a634e40049c7949e9b3338ec8ed6 P 75e561d75c464b2f9fac6f4fc858bff5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742ab1485d364919a0a06cad9b00cae6 in term 1.
I20260806 09:14:22.752553 12844 raft_consensus.cc:2454] T 9d60a634e40049c7949e9b3338ec8ed6 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742ab1485d364919a0a06cad9b00cae6 in term 1.
I20260806 09:14:22.753183 12486 leader_election.cc:302] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742ab1485d364919a0a06cad9b00cae6, 75e561d75c464b2f9fac6f4fc858bff5; no voters:
I20260806 09:14:22.753631 12917 raft_consensus.cc:2781] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:14:22.754683 12917 raft_consensus.cc:686] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6 [term 1 LEADER]: Becoming Leader. State: Replica: 742ab1485d364919a0a06cad9b00cae6, State: Running, Role: LEADER
I20260806 09:14:22.755632 12917 consensus_queue.cc:237] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } }
I20260806 09:14:22.762823 12397 catalog_manager.cc:5495] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 742ab1485d364919a0a06cad9b00cae6 (127.10.255.65). New cstate: current_term: 1 leader_uuid: "742ab1485d364919a0a06cad9b00cae6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } health_report { overall_health: HEALTHY } } }
I20260806 09:14:22.884219 12908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:22.875133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34476 (local address 127.10.255.65:45749)
0806 09:14:22.875630 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:22.875640 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:22.876179 (+ 539us) server_negotiation.cc:407] Connection header received
0806 09:14:22.876579 (+ 400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:22.876585 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:22.876691 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:22.876835 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:14:22.877685 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.878560 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.880885 (+ 2325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:22.881546 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:22.881683 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:22.882668 (+ 985us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:14:22.883342 (+ 674us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:14:22.883494 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:22.883670 (+ 176us) server_negotiation.cc:299] Negotiation successful
0806 09:14:22.883758 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260806 09:14:22.896562 12844 raft_consensus.cc:1261] T 9d60a634e40049c7949e9b3338ec8ed6 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 1 FOLLOWER]: Refusing update from remote peer 742ab1485d364919a0a06cad9b00cae6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:14:22.896795 12701 raft_consensus.cc:1261] T 9d60a634e40049c7949e9b3338ec8ed6 P 75e561d75c464b2f9fac6f4fc858bff5 [term 1 FOLLOWER]: Refusing update from remote peer 742ab1485d364919a0a06cad9b00cae6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:14:22.897969 12921 consensus_queue.cc:1035] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:14:22.898554 12917 consensus_queue.cc:1035] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:14:22.913216 12925 mvcc.cc:205] Tried to move back new op lower bound from 7315487387211968512 to 7315487386653540352. Current Snapshot: MvccSnapshot[applied={T|T < 7315487387211968512}]
I20260806 09:14:22.916564 12926 mvcc.cc:205] Tried to move back new op lower bound from 7315487387211968512 to 7315487386653540352. Current Snapshot: MvccSnapshot[applied={T|T < 7315487387211968512}]
I20260806 09:14:22.947083 12396 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33134:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:14:22.947576 12396 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33134:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:14:22.953027 12396 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b: Sending DeleteTablet for 3 replicas of tablet 9d60a634e40049c7949e9b3338ec8ed6
I20260806 09:14:22.954738 12819 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d60a634e40049c7949e9b3338ec8ed6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:14:22 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:51758
I20260806 09:14:22.954996 12675 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d60a634e40049c7949e9b3338ec8ed6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:14:22 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:32900
I20260806 09:14:22.956707 12534 tablet_service.cc:1514] Processing DeleteTablet for tablet 9d60a634e40049c7949e9b3338ec8ed6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:14:22 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:34474
I20260806 09:14:22.956743 12396 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33134:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:14:22.957858 12396 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:14:22.969892 12817 tablet_service.cc:1467] Processing CreateTablet for tablet 3f0fb59de760417fa750048ae9f3ee85 (DEFAULT_TABLE table=test-table [id=05466720665d4997b144308a4f0a8970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:22.970209 12674 tablet_service.cc:1467] Processing CreateTablet for tablet 3f0fb59de760417fa750048ae9f3ee85 (DEFAULT_TABLE table=test-table [id=05466720665d4997b144308a4f0a8970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:22.970516 12817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f0fb59de760417fa750048ae9f3ee85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:22.970917 12674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f0fb59de760417fa750048ae9f3ee85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:22.970871 12936 tablet_replica.cc:330] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6: stopping tablet replica
I20260806 09:14:22.971705 12936 raft_consensus.cc:2229] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6 [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:14:22.972908 12936 raft_consensus.cc:2258] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:14:22.980930 12935 tablet_replica.cc:330] T 9d60a634e40049c7949e9b3338ec8ed6 P 75e561d75c464b2f9fac6f4fc858bff5: stopping tablet replica
I20260806 09:14:22.981850 12533 tablet_service.cc:1467] Processing CreateTablet for tablet 3f0fb59de760417fa750048ae9f3ee85 (DEFAULT_TABLE table=test-table [id=05466720665d4997b144308a4f0a8970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:22.982518 12533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3f0fb59de760417fa750048ae9f3ee85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:22.982697 12937 tablet_bootstrap.cc:492] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05: Bootstrap starting.
I20260806 09:14:22.984545 12934 tablet_replica.cc:330] T 9d60a634e40049c7949e9b3338ec8ed6 P 7f13d3bc57b24c5eb8b7b02ea4853b05: stopping tablet replica
I20260806 09:14:22.981743 12935 raft_consensus.cc:2229] T 9d60a634e40049c7949e9b3338ec8ed6 P 75e561d75c464b2f9fac6f4fc858bff5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:14:22.985183 12934 raft_consensus.cc:2229] T 9d60a634e40049c7949e9b3338ec8ed6 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:14:22.985392 12935 raft_consensus.cc:2258] T 9d60a634e40049c7949e9b3338ec8ed6 P 75e561d75c464b2f9fac6f4fc858bff5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:14:22.985795 12934 raft_consensus.cc:2258] T 9d60a634e40049c7949e9b3338ec8ed6 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:14:22.987105 12936 ts_tablet_manager.cc:1905] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:14:22.988013 12935 ts_tablet_manager.cc:1905] T 9d60a634e40049c7949e9b3338ec8ed6 P 75e561d75c464b2f9fac6f4fc858bff5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:14:22.988212 12937 tablet_bootstrap.cc:654] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:22.990728 12934 ts_tablet_manager.cc:1905] T 9d60a634e40049c7949e9b3338ec8ed6 P 7f13d3bc57b24c5eb8b7b02ea4853b05: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:14:22.997763 12938 tablet_bootstrap.cc:492] T 3f0fb59de760417fa750048ae9f3ee85 P 75e561d75c464b2f9fac6f4fc858bff5: Bootstrap starting.
I20260806 09:14:23.000330 12934 ts_tablet_manager.cc:1918] T 9d60a634e40049c7949e9b3338ec8ed6 P 7f13d3bc57b24c5eb8b7b02ea4853b05: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:14:23.000689 12934 log.cc:1196] T 9d60a634e40049c7949e9b3338ec8ed6 P 7f13d3bc57b24c5eb8b7b02ea4853b05: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/9d60a634e40049c7949e9b3338ec8ed6
I20260806 09:14:23.001628 12934 ts_tablet_manager.cc:1939] T 9d60a634e40049c7949e9b3338ec8ed6 P 7f13d3bc57b24c5eb8b7b02ea4853b05: Deleting consensus metadata
I20260806 09:14:23.001852 12938 tablet_bootstrap.cc:654] T 3f0fb59de760417fa750048ae9f3ee85 P 75e561d75c464b2f9fac6f4fc858bff5: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:23.004222 12383 catalog_manager.cc:4841] TS 7f13d3bc57b24c5eb8b7b02ea4853b05 (127.10.255.67:45899): tablet 9d60a634e40049c7949e9b3338ec8ed6 (table test-table [id=f329985be2244440980dbcc92d082933]) successfully deleted
I20260806 09:14:23.005611 12939 tablet_bootstrap.cc:492] T 3f0fb59de760417fa750048ae9f3ee85 P 742ab1485d364919a0a06cad9b00cae6: Bootstrap starting.
I20260806 09:14:23.008024 12935 ts_tablet_manager.cc:1918] T 9d60a634e40049c7949e9b3338ec8ed6 P 75e561d75c464b2f9fac6f4fc858bff5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:14:23.008258 12935 log.cc:1196] T 9d60a634e40049c7949e9b3338ec8ed6 P 75e561d75c464b2f9fac6f4fc858bff5: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/9d60a634e40049c7949e9b3338ec8ed6
I20260806 09:14:23.009521 12935 ts_tablet_manager.cc:1939] T 9d60a634e40049c7949e9b3338ec8ed6 P 75e561d75c464b2f9fac6f4fc858bff5: Deleting consensus metadata
I20260806 09:14:23.010210 12937 tablet_bootstrap.cc:492] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05: No bootstrap required, opened a new log
I20260806 09:14:23.010491 12937 ts_tablet_manager.cc:1397] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.003s
I20260806 09:14:23.011822 12937 raft_consensus.cc:348] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } }
I20260806 09:14:23.012212 12383 catalog_manager.cc:4841] TS 75e561d75c464b2f9fac6f4fc858bff5 (127.10.255.66:36845): tablet 9d60a634e40049c7949e9b3338ec8ed6 (table test-table [id=f329985be2244440980dbcc92d082933]) successfully deleted
I20260806 09:14:23.012262 12937 raft_consensus.cc:374] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:23.012391 12937 raft_consensus.cc:729] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f13d3bc57b24c5eb8b7b02ea4853b05, State: Initialized, Role: FOLLOWER
I20260806 09:14:23.012569 12938 tablet_bootstrap.cc:492] T 3f0fb59de760417fa750048ae9f3ee85 P 75e561d75c464b2f9fac6f4fc858bff5: No bootstrap required, opened a new log
I20260806 09:14:23.012877 12938 ts_tablet_manager.cc:1397] T 3f0fb59de760417fa750048ae9f3ee85 P 75e561d75c464b2f9fac6f4fc858bff5: Time spent bootstrapping tablet: real 0.015s user 0.012s sys 0.000s
I20260806 09:14:23.013029 12937 consensus_queue.cc:260] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } }
I20260806 09:14:23.014364 12938 raft_consensus.cc:348] T 3f0fb59de760417fa750048ae9f3ee85 P 75e561d75c464b2f9fac6f4fc858bff5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } }
I20260806 09:14:23.014832 12938 raft_consensus.cc:374] T 3f0fb59de760417fa750048ae9f3ee85 P 75e561d75c464b2f9fac6f4fc858bff5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:23.015091 12937 ts_tablet_manager.cc:1428] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260806 09:14:23.015240 12938 raft_consensus.cc:729] T 3f0fb59de760417fa750048ae9f3ee85 P 75e561d75c464b2f9fac6f4fc858bff5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75e561d75c464b2f9fac6f4fc858bff5, State: Initialized, Role: FOLLOWER
I20260806 09:14:23.015825 12936 ts_tablet_manager.cc:1918] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:14:23.015645 12938 consensus_queue.cc:260] T 3f0fb59de760417fa750048ae9f3ee85 P 75e561d75c464b2f9fac6f4fc858bff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } }
I20260806 09:14:23.016278 12936 log.cc:1196] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-0/wal/wals/9d60a634e40049c7949e9b3338ec8ed6
I20260806 09:14:23.017318 12938 ts_tablet_manager.cc:1428] T 3f0fb59de760417fa750048ae9f3ee85 P 75e561d75c464b2f9fac6f4fc858bff5: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260806 09:14:23.017592 12936 ts_tablet_manager.cc:1939] T 9d60a634e40049c7949e9b3338ec8ed6 P 742ab1485d364919a0a06cad9b00cae6: Deleting consensus metadata
I20260806 09:14:23.018718 12939 tablet_bootstrap.cc:654] T 3f0fb59de760417fa750048ae9f3ee85 P 742ab1485d364919a0a06cad9b00cae6: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:23.020758 12383 catalog_manager.cc:4841] TS 742ab1485d364919a0a06cad9b00cae6 (127.10.255.65:45749): tablet 9d60a634e40049c7949e9b3338ec8ed6 (table test-table [id=f329985be2244440980dbcc92d082933]) successfully deleted
I20260806 09:14:23.024159 12939 tablet_bootstrap.cc:492] T 3f0fb59de760417fa750048ae9f3ee85 P 742ab1485d364919a0a06cad9b00cae6: No bootstrap required, opened a new log
I20260806 09:14:23.024371 12939 ts_tablet_manager.cc:1397] T 3f0fb59de760417fa750048ae9f3ee85 P 742ab1485d364919a0a06cad9b00cae6: Time spent bootstrapping tablet: real 0.019s user 0.004s sys 0.004s
I20260806 09:14:23.025627 12939 raft_consensus.cc:348] T 3f0fb59de760417fa750048ae9f3ee85 P 742ab1485d364919a0a06cad9b00cae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } }
I20260806 09:14:23.026036 12939 raft_consensus.cc:374] T 3f0fb59de760417fa750048ae9f3ee85 P 742ab1485d364919a0a06cad9b00cae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:23.026208 12939 raft_consensus.cc:729] T 3f0fb59de760417fa750048ae9f3ee85 P 742ab1485d364919a0a06cad9b00cae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742ab1485d364919a0a06cad9b00cae6, State: Initialized, Role: FOLLOWER
I20260806 09:14:23.026619 12939 consensus_queue.cc:260] T 3f0fb59de760417fa750048ae9f3ee85 P 742ab1485d364919a0a06cad9b00cae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } }
I20260806 09:14:23.027488 12939 ts_tablet_manager.cc:1428] T 3f0fb59de760417fa750048ae9f3ee85 P 742ab1485d364919a0a06cad9b00cae6: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260806 09:14:23.284873 12918 raft_consensus.cc:482] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:14:23.285154 12918 raft_consensus.cc:504] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } }
I20260806 09:14:23.287362 12918 leader_election.cc:288] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 742ab1485d364919a0a06cad9b00cae6 (127.10.255.65:45749), 75e561d75c464b2f9fac6f4fc858bff5 (127.10.255.66:36845)
I20260806 09:14:23.302255 12908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:23.287698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:58033 (local address 127.10.255.65:45749)
0806 09:14:23.288032 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:23.288039 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:23.288598 (+ 559us) server_negotiation.cc:407] Connection header received
0806 09:14:23.288734 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:23.288741 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:23.288905 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:23.289063 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:23.290218 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:23.291945 (+ 1727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:23.295423 (+ 3478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:23.298092 (+ 2669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:23.298320 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:23.298428 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:23.301269 (+ 2841us) server_negotiation.cc:299] Negotiation successful
0806 09:14:23.301436 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 09:14:23.303980 12943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:23.287642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:45749 (local address 127.10.255.67:58033)
0806 09:14:23.288292 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:23.288314 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:23.288474 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:23.289435 (+ 961us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:23.289441 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:23.289497 (+ 56us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:23.289877 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:23.289902 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:23.292220 (+ 2318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:23.292236 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:23.295063 (+ 2827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:23.295091 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:23.300314 (+ 5223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:23.300327 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:23.300921 (+ 594us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:23.300974 (+ 53us) client_negotiation.cc:769] Sending connection context
0806 09:14:23.303011 (+ 2037us) client_negotiation.cc:240] Negotiation successful
0806 09:14:23.303203 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":381,"threads_started":1}
I20260806 09:14:23.306921 12558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f0fb59de760417fa750048ae9f3ee85" candidate_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742ab1485d364919a0a06cad9b00cae6" is_pre_election: true
I20260806 09:14:23.307760 12558 raft_consensus.cc:2454] T 3f0fb59de760417fa750048ae9f3ee85 P 742ab1485d364919a0a06cad9b00cae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f13d3bc57b24c5eb8b7b02ea4853b05 in term 0.
I20260806 09:14:23.309322 12770 leader_election.cc:302] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742ab1485d364919a0a06cad9b00cae6, 7f13d3bc57b24c5eb8b7b02ea4853b05; no voters:
I20260806 09:14:23.310210 12918 raft_consensus.cc:2781] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:14:23.310626 12918 raft_consensus.cc:482] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:14:23.310880 12918 raft_consensus.cc:3037] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:23.311477 12945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:23.288790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:43813 (local address 127.10.255.66:36845)
0806 09:14:23.300193 (+ 11403us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:23.300200 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:23.300970 (+ 770us) server_negotiation.cc:407] Connection header received
0806 09:14:23.301064 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:23.301069 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:23.301153 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:23.301252 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:23.302178 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:23.303310 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:23.306620 (+ 3310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:23.308589 (+ 1969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:23.308865 (+ 276us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:23.308949 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:23.310529 (+ 1580us) server_negotiation.cc:299] Negotiation successful
0806 09:14:23.310796 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10794,"thread_start_us":10648,"threads_started":1}
I20260806 09:14:23.312755 12944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:23.288526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:36845 (local address 127.10.255.67:43813)
0806 09:14:23.300592 (+ 12066us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:23.300644 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:23.300829 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:23.301501 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:23.301506 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:23.301543 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:23.301969 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:23.301983 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:23.303559 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:23.303565 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:23.306309 (+ 2744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:23.306336 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:23.309327 (+ 2991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:23.309337 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:23.309753 (+ 416us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:23.309800 (+ 47us) client_negotiation.cc:769] Sending connection context
0806 09:14:23.309945 (+ 145us) client_negotiation.cc:240] Negotiation successful
0806 09:14:23.310165 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11878,"thread_start_us":11436,"threads_started":1}
I20260806 09:14:23.314230 12701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f0fb59de760417fa750048ae9f3ee85" candidate_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75e561d75c464b2f9fac6f4fc858bff5" is_pre_election: true
I20260806 09:14:23.314826 12701 raft_consensus.cc:2454] T 3f0fb59de760417fa750048ae9f3ee85 P 75e561d75c464b2f9fac6f4fc858bff5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f13d3bc57b24c5eb8b7b02ea4853b05 in term 0.
I20260806 09:14:23.317646 12918 raft_consensus.cc:504] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } }
I20260806 09:14:23.319459 12918 leader_election.cc:288] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [CANDIDATE]: Term 1 election: Requested vote from peers 742ab1485d364919a0a06cad9b00cae6 (127.10.255.65:45749), 75e561d75c464b2f9fac6f4fc858bff5 (127.10.255.66:36845)
I20260806 09:14:23.320822 12558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f0fb59de760417fa750048ae9f3ee85" candidate_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742ab1485d364919a0a06cad9b00cae6"
I20260806 09:14:23.321215 12558 raft_consensus.cc:3037] T 3f0fb59de760417fa750048ae9f3ee85 P 742ab1485d364919a0a06cad9b00cae6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:23.326560 12558 raft_consensus.cc:2454] T 3f0fb59de760417fa750048ae9f3ee85 P 742ab1485d364919a0a06cad9b00cae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f13d3bc57b24c5eb8b7b02ea4853b05 in term 1.
I20260806 09:14:23.327896 12701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3f0fb59de760417fa750048ae9f3ee85" candidate_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75e561d75c464b2f9fac6f4fc858bff5"
I20260806 09:14:23.328181 12701 raft_consensus.cc:3037] T 3f0fb59de760417fa750048ae9f3ee85 P 75e561d75c464b2f9fac6f4fc858bff5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:23.332605 12701 raft_consensus.cc:2454] T 3f0fb59de760417fa750048ae9f3ee85 P 75e561d75c464b2f9fac6f4fc858bff5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f13d3bc57b24c5eb8b7b02ea4853b05 in term 1.
I20260806 09:14:23.333665 12770 leader_election.cc:302] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75e561d75c464b2f9fac6f4fc858bff5, 7f13d3bc57b24c5eb8b7b02ea4853b05; no voters:
I20260806 09:14:23.334373 12918 raft_consensus.cc:2781] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:14:23.336922 12918 raft_consensus.cc:686] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 1 LEADER]: Becoming Leader. State: Replica: 7f13d3bc57b24c5eb8b7b02ea4853b05, State: Running, Role: LEADER
I20260806 09:14:23.337620 12918 consensus_queue.cc:237] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } }
I20260806 09:14:23.343122 12396 catalog_manager.cc:5495] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f13d3bc57b24c5eb8b7b02ea4853b05 (127.10.255.67). New cstate: current_term: 1 leader_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } health_report { overall_health: HEALTHY } } }
Aug 06 09:14:23 dist-test-slave-mvvj krb5kdc[12352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007660, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:23.508977 12953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:23.482543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:43071 (local address 127.0.0.1:33146)
0806 09:14:23.483726 (+ 1183us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:23.483762 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:23.484312 (+ 550us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:23.485377 (+ 1065us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:23.485382 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:23.487125 (+ 1743us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:23.487455 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:23.487469 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:23.489837 (+ 2368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:23.489842 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:23.490969 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:23.490984 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:23.492723 (+ 1739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:23.492729 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:23.492871 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:23.493743 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:23.493763 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:23.496768 (+ 3005us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:23.504658 (+ 7890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:23.504679 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:23.504687 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:23.505328 (+ 641us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:23.506325 (+ 997us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:23.506330 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:23.506333 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:23.506608 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:23.507908 (+ 1300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:23.507921 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:23.508137 (+ 216us) client_negotiation.cc:769] Sending connection context
0806 09:14:23.508330 (+ 193us) client_negotiation.cc:240] Negotiation successful
0806 09:14:23.508627 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":919,"thread_start_us":666,"threads_started":1}
I20260806 09:14:23.509548 12954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:23.482925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33146 (local address 127.10.255.126:43071)
0806 09:14:23.484852 (+ 1927us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:23.484859 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:23.484931 (+ 72us) server_negotiation.cc:407] Connection header received
0806 09:14:23.485001 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:23.485006 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:23.485101 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:23.485299 (+ 198us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:23.487750 (+ 2451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:23.489623 (+ 1873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:23.491176 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:23.492499 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:23.492679 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:23.497235 (+ 4556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:23.497246 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:23.497252 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:23.497330 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:23.504391 (+ 7061us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:23.505551 (+ 1160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:23.505558 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:23.505562 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:23.505921 (+ 359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:23.506772 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:23.506778 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:23.506781 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:23.507607 (+ 826us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:23.507826 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:23.508528 (+ 702us) server_negotiation.cc:299] Negotiation successful
0806 09:14:23.508850 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1671,"thread_start_us":1307,"threads_started":1}
I20260806 09:14:23.518682 12396 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:33146:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 09:14:23.520690 12396 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:14:23.530130 12533 tablet_service.cc:1467] Processing CreateTablet for tablet 75a5b27b80ed48d59cf221055c7efb52 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c998de2a0af54d6a9dc338e10f74e29c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 09:14:23.530824 12533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75a5b27b80ed48d59cf221055c7efb52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:23.536576 12674 tablet_service.cc:1467] Processing CreateTablet for tablet 75a5b27b80ed48d59cf221055c7efb52 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c998de2a0af54d6a9dc338e10f74e29c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 09:14:23.537369 12674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75a5b27b80ed48d59cf221055c7efb52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:23.538156 12819 tablet_service.cc:1467] Processing CreateTablet for tablet 75a5b27b80ed48d59cf221055c7efb52 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c998de2a0af54d6a9dc338e10f74e29c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 09:14:23.538954 12819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75a5b27b80ed48d59cf221055c7efb52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:23.549773 12955 tablet_bootstrap.cc:492] T 75a5b27b80ed48d59cf221055c7efb52 P 742ab1485d364919a0a06cad9b00cae6: Bootstrap starting.
I20260806 09:14:23.555944 12956 tablet_bootstrap.cc:492] T 75a5b27b80ed48d59cf221055c7efb52 P 75e561d75c464b2f9fac6f4fc858bff5: Bootstrap starting.
I20260806 09:14:23.556988 12955 tablet_bootstrap.cc:654] T 75a5b27b80ed48d59cf221055c7efb52 P 742ab1485d364919a0a06cad9b00cae6: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:23.560706 12957 tablet_bootstrap.cc:492] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05: Bootstrap starting.
I20260806 09:14:23.565032 12957 tablet_bootstrap.cc:654] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:23.567704 12956 tablet_bootstrap.cc:654] T 75a5b27b80ed48d59cf221055c7efb52 P 75e561d75c464b2f9fac6f4fc858bff5: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:23.569486 12955 tablet_bootstrap.cc:492] T 75a5b27b80ed48d59cf221055c7efb52 P 742ab1485d364919a0a06cad9b00cae6: No bootstrap required, opened a new log
I20260806 09:14:23.569880 12955 ts_tablet_manager.cc:1397] T 75a5b27b80ed48d59cf221055c7efb52 P 742ab1485d364919a0a06cad9b00cae6: Time spent bootstrapping tablet: real 0.020s user 0.010s sys 0.006s
I20260806 09:14:23.571219 12957 tablet_bootstrap.cc:492] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05: No bootstrap required, opened a new log
I20260806 09:14:23.571630 12957 ts_tablet_manager.cc:1397] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260806 09:14:23.571969 12955 raft_consensus.cc:348] T 75a5b27b80ed48d59cf221055c7efb52 P 742ab1485d364919a0a06cad9b00cae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } }
I20260806 09:14:23.572510 12955 raft_consensus.cc:374] T 75a5b27b80ed48d59cf221055c7efb52 P 742ab1485d364919a0a06cad9b00cae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:23.572587 12956 tablet_bootstrap.cc:492] T 75a5b27b80ed48d59cf221055c7efb52 P 75e561d75c464b2f9fac6f4fc858bff5: No bootstrap required, opened a new log
I20260806 09:14:23.572810 12955 raft_consensus.cc:729] T 75a5b27b80ed48d59cf221055c7efb52 P 742ab1485d364919a0a06cad9b00cae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742ab1485d364919a0a06cad9b00cae6, State: Initialized, Role: FOLLOWER
I20260806 09:14:23.573145 12956 ts_tablet_manager.cc:1397] T 75a5b27b80ed48d59cf221055c7efb52 P 75e561d75c464b2f9fac6f4fc858bff5: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.000s
I20260806 09:14:23.573606 12955 consensus_queue.cc:260] T 75a5b27b80ed48d59cf221055c7efb52 P 742ab1485d364919a0a06cad9b00cae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } }
I20260806 09:14:23.573822 12957 raft_consensus.cc:348] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } }
I20260806 09:14:23.574416 12957 raft_consensus.cc:374] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:23.574716 12957 raft_consensus.cc:729] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f13d3bc57b24c5eb8b7b02ea4853b05, State: Initialized, Role: FOLLOWER
I20260806 09:14:23.575099 12957 consensus_queue.cc:260] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } }
I20260806 09:14:23.576802 12956 raft_consensus.cc:348] T 75a5b27b80ed48d59cf221055c7efb52 P 75e561d75c464b2f9fac6f4fc858bff5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } }
I20260806 09:14:23.577288 12956 raft_consensus.cc:374] T 75a5b27b80ed48d59cf221055c7efb52 P 75e561d75c464b2f9fac6f4fc858bff5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:23.577445 12956 raft_consensus.cc:729] T 75a5b27b80ed48d59cf221055c7efb52 P 75e561d75c464b2f9fac6f4fc858bff5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75e561d75c464b2f9fac6f4fc858bff5, State: Initialized, Role: FOLLOWER
I20260806 09:14:23.577925 12956 consensus_queue.cc:260] T 75a5b27b80ed48d59cf221055c7efb52 P 75e561d75c464b2f9fac6f4fc858bff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } }
I20260806 09:14:23.575645 12918 tablet_replica.cc:439] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } } }
I20260806 09:14:23.579535 12918 tablet_replica.cc:442] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 09:14:23.580842 12957 ts_tablet_manager.cc:1428] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20260806 09:14:23.586112 12955 ts_tablet_manager.cc:1428] T 75a5b27b80ed48d59cf221055c7efb52 P 742ab1485d364919a0a06cad9b00cae6: Time spent starting tablet: real 0.016s user 0.002s sys 0.013s
I20260806 09:14:23.587378 12961 tablet_replica.cc:439] T 75a5b27b80ed48d59cf221055c7efb52 P 742ab1485d364919a0a06cad9b00cae6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } } }
I20260806 09:14:23.589712 12956 ts_tablet_manager.cc:1428] T 75a5b27b80ed48d59cf221055c7efb52 P 75e561d75c464b2f9fac6f4fc858bff5: Time spent starting tablet: real 0.016s user 0.003s sys 0.009s
I20260806 09:14:23.590850 12962 tablet_replica.cc:439] T 75a5b27b80ed48d59cf221055c7efb52 P 75e561d75c464b2f9fac6f4fc858bff5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } } }
I20260806 09:14:23.591491 12962 tablet_replica.cc:442] T 75a5b27b80ed48d59cf221055c7efb52 P 75e561d75c464b2f9fac6f4fc858bff5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 09:14:23.591869 12961 tablet_replica.cc:442] T 75a5b27b80ed48d59cf221055c7efb52 P 742ab1485d364919a0a06cad9b00cae6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 09:14:23.625379 12918 raft_consensus.cc:482] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:14:23.625785 12918 raft_consensus.cc:504] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } }
I20260806 09:14:23.626760 12918 leader_election.cc:288] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 742ab1485d364919a0a06cad9b00cae6 (127.10.255.65:45749), 75e561d75c464b2f9fac6f4fc858bff5 (127.10.255.66:36845)
I20260806 09:14:23.627737 12701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a5b27b80ed48d59cf221055c7efb52" candidate_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75e561d75c464b2f9fac6f4fc858bff5" is_pre_election: true
I20260806 09:14:23.627779 12558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a5b27b80ed48d59cf221055c7efb52" candidate_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742ab1485d364919a0a06cad9b00cae6" is_pre_election: true
I20260806 09:14:23.628111 12701 raft_consensus.cc:2454] T 75a5b27b80ed48d59cf221055c7efb52 P 75e561d75c464b2f9fac6f4fc858bff5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f13d3bc57b24c5eb8b7b02ea4853b05 in term 0.
I20260806 09:14:23.628240 12558 raft_consensus.cc:2454] T 75a5b27b80ed48d59cf221055c7efb52 P 742ab1485d364919a0a06cad9b00cae6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f13d3bc57b24c5eb8b7b02ea4853b05 in term 0.
I20260806 09:14:23.628765 12770 leader_election.cc:302] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742ab1485d364919a0a06cad9b00cae6, 7f13d3bc57b24c5eb8b7b02ea4853b05; no voters:
I20260806 09:14:23.629216 12918 raft_consensus.cc:2781] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:14:23.629431 12918 raft_consensus.cc:482] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:14:23.629721 12918 raft_consensus.cc:3037] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:23.635123 12918 raft_consensus.cc:504] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } }
I20260806 09:14:23.636433 12918 leader_election.cc:288] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [CANDIDATE]: Term 1 election: Requested vote from peers 742ab1485d364919a0a06cad9b00cae6 (127.10.255.65:45749), 75e561d75c464b2f9fac6f4fc858bff5 (127.10.255.66:36845)
I20260806 09:14:23.636993 12558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a5b27b80ed48d59cf221055c7efb52" candidate_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742ab1485d364919a0a06cad9b00cae6"
I20260806 09:14:23.637079 12701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75a5b27b80ed48d59cf221055c7efb52" candidate_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75e561d75c464b2f9fac6f4fc858bff5"
I20260806 09:14:23.637436 12558 raft_consensus.cc:3037] T 75a5b27b80ed48d59cf221055c7efb52 P 742ab1485d364919a0a06cad9b00cae6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:23.637566 12701 raft_consensus.cc:3037] T 75a5b27b80ed48d59cf221055c7efb52 P 75e561d75c464b2f9fac6f4fc858bff5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:23.641489 12558 raft_consensus.cc:2454] T 75a5b27b80ed48d59cf221055c7efb52 P 742ab1485d364919a0a06cad9b00cae6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f13d3bc57b24c5eb8b7b02ea4853b05 in term 1.
I20260806 09:14:23.642050 12770 leader_election.cc:302] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 742ab1485d364919a0a06cad9b00cae6, 7f13d3bc57b24c5eb8b7b02ea4853b05; no voters:
I20260806 09:14:23.642396 12701 raft_consensus.cc:2454] T 75a5b27b80ed48d59cf221055c7efb52 P 75e561d75c464b2f9fac6f4fc858bff5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f13d3bc57b24c5eb8b7b02ea4853b05 in term 1.
I20260806 09:14:23.642992 12918 raft_consensus.cc:2781] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:14:23.643560 12918 raft_consensus.cc:686] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 1 LEADER]: Becoming Leader. State: Replica: 7f13d3bc57b24c5eb8b7b02ea4853b05, State: Running, Role: LEADER
I20260806 09:14:23.643977 12918 consensus_queue.cc:237] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } }
I20260806 09:14:23.647171 12946 tablet_replica.cc:439] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05: TxnStatusTablet state changed. Reason: New leader 7f13d3bc57b24c5eb8b7b02ea4853b05. Latest consensus state: current_term: 1 leader_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } } }
I20260806 09:14:23.648322 12946 tablet_replica.cc:442] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05: This TxnStatusTablet replica's current role is: LEADER
I20260806 09:14:23.649335 12396 catalog_manager.cc:5495] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f13d3bc57b24c5eb8b7b02ea4853b05 (127.10.255.67). New cstate: current_term: 1 leader_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } health_report { overall_health: HEALTHY } } }
I20260806 09:14:23.650606 12964 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 09:14:23.650954 12964 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 09:14:23.726770 12967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:23.695319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51764 (local address 127.10.255.67:45899)
0806 09:14:23.712517 (+ 17198us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:23.712536 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:23.712611 (+ 75us) server_negotiation.cc:407] Connection header received
0806 09:14:23.712808 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:23.712815 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:23.713020 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:23.714936 (+ 1916us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:14:23.715640 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:23.718054 (+ 2414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:23.721398 (+ 3344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:23.722782 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:23.722966 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:23.724266 (+ 1300us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:14:23.725371 (+ 1105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:14:23.725555 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:23.725808 (+ 253us) server_negotiation.cc:299] Negotiation successful
0806 09:14:23.725926 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16830,"thread_start_us":18174,"threads_started":1}
I20260806 09:14:23.726804 12953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:23.695612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:45899 (local address 127.0.0.1:51764)
0806 09:14:23.696076 (+ 464us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:23.696108 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:23.696343 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:23.713839 (+ 17496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:23.713846 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:23.713866 (+ 20us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 09:14:23.714431 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:23.714449 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:23.718420 (+ 3971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:23.718432 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:23.720983 (+ 2551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:23.721016 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:23.723160 (+ 2144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:23.723171 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:23.723664 (+ 493us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:23.723797 (+ 133us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 09:14:23.725562 (+ 1765us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 09:14:23.725597 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 09:14:23.725740 (+ 143us) client_negotiation.cc:240] Negotiation successful
0806 09:14:23.726000 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260806 09:14:23.736779 12701 raft_consensus.cc:1261] T 75a5b27b80ed48d59cf221055c7efb52 P 75e561d75c464b2f9fac6f4fc858bff5 [term 1 FOLLOWER]: Refusing update from remote peer 7f13d3bc57b24c5eb8b7b02ea4853b05: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:14:23.736796 12558 raft_consensus.cc:1261] T 75a5b27b80ed48d59cf221055c7efb52 P 742ab1485d364919a0a06cad9b00cae6 [term 1 FOLLOWER]: Refusing update from remote peer 7f13d3bc57b24c5eb8b7b02ea4853b05: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:14:23.738034 12946 consensus_queue.cc:1035] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:14:23.738708 12918 consensus_queue.cc:1035] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:14:23.761516 12962 tablet_replica.cc:439] T 75a5b27b80ed48d59cf221055c7efb52 P 75e561d75c464b2f9fac6f4fc858bff5: TxnStatusTablet state changed. Reason: New leader 7f13d3bc57b24c5eb8b7b02ea4853b05. Latest consensus state: current_term: 1 leader_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } } }
I20260806 09:14:23.762305 12962 tablet_replica.cc:442] T 75a5b27b80ed48d59cf221055c7efb52 P 75e561d75c464b2f9fac6f4fc858bff5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 09:14:23.771982 12968 mvcc.cc:205] Tried to move back new op lower bound from 7315487390650638336 to 7315487390289707008. Current Snapshot: MvccSnapshot[applied={T|T < 7315487390650638336}]
I20260806 09:14:23.777637 12961 tablet_replica.cc:439] T 75a5b27b80ed48d59cf221055c7efb52 P 742ab1485d364919a0a06cad9b00cae6: TxnStatusTablet state changed. Reason: New leader 7f13d3bc57b24c5eb8b7b02ea4853b05. Latest consensus state: current_term: 1 leader_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } } }
I20260806 09:14:23.779036 12961 tablet_replica.cc:442] T 75a5b27b80ed48d59cf221055c7efb52 P 742ab1485d364919a0a06cad9b00cae6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 09:14:23.780043 12962 tablet_replica.cc:439] T 75a5b27b80ed48d59cf221055c7efb52 P 75e561d75c464b2f9fac6f4fc858bff5: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } } }
I20260806 09:14:23.780447 12962 tablet_replica.cc:442] T 75a5b27b80ed48d59cf221055c7efb52 P 75e561d75c464b2f9fac6f4fc858bff5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 09:14:23.775333 12918 tablet_replica.cc:439] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } } }
I20260806 09:14:23.781776 12918 tablet_replica.cc:442] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05: This TxnStatusTablet replica's current role is: LEADER
I20260806 09:14:23.812359 12918 tablet_replica.cc:439] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } } }
I20260806 09:14:23.812817 12918 tablet_replica.cc:442] T 75a5b27b80ed48d59cf221055c7efb52 P 7f13d3bc57b24c5eb8b7b02ea4853b05: This TxnStatusTablet replica's current role is: LEADER
I20260806 09:14:23.818367 12961 tablet_replica.cc:439] T 75a5b27b80ed48d59cf221055c7efb52 P 742ab1485d364919a0a06cad9b00cae6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 } } peers { permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 } } peers { permanent_uuid: "7f13d3bc57b24c5eb8b7b02ea4853b05" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45899 } } }
I20260806 09:14:23.818662 12961 tablet_replica.cc:442] T 75a5b27b80ed48d59cf221055c7efb52 P 742ab1485d364919a0a06cad9b00cae6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 09:14:23.831409 12975 consensus_queue.cc:1035] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75e561d75c464b2f9fac6f4fc858bff5" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 36845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:14:23.832322 12967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:23.806569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51776 (local address 127.10.255.67:45899)
0806 09:14:23.806824 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:23.806833 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:23.820252 (+ 13419us) server_negotiation.cc:407] Connection header received
0806 09:14:23.820509 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:23.820516 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:23.820611 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:23.820733 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:14:23.821867 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:23.824750 (+ 2883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:23.828556 (+ 3806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:23.829770 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:23.829893 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:23.831114 (+ 1221us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:14:23.831315 (+ 201us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:14:23.831410 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:23.831739 (+ 329us) server_negotiation.cc:299] Negotiation successful
0806 09:14:23.831864 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 09:14:23.840006 12976 consensus_queue.cc:1035] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "742ab1485d364919a0a06cad9b00cae6" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45749 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260806 09:14:23.865485 12967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:23.855732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:49029 (local address 127.10.255.67:45899)
0806 09:14:23.856019 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:23.856024 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:23.857289 (+ 1265us) server_negotiation.cc:407] Connection header received
0806 09:14:23.857546 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:23.857553 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:23.857706 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:23.857832 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:14:23.858604 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:23.859826 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:23.862513 (+ 2687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:23.863330 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:23.863498 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:23.864196 (+ 698us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:14:23.864314 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:14:23.864425 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:23.864584 (+ 159us) server_negotiation.cc:299] Negotiation successful
0806 09:14:23.864784 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":90,"server-negotiator.queue_time_us":60}
I20260806 09:14:23.865911 12984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:23.855985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:45899 (local address 127.10.255.67:49029)
0806 09:14:23.857162 (+ 1177us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:23.857180 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:23.857392 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:23.857849 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:23.857853 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:23.857863 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 09:14:23.858414 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:23.858426 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:23.860103 (+ 1677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:23.860114 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:23.862328 (+ 2214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:23.862347 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:23.863573 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:23.863581 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:23.863782 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:23.863936 (+ 154us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 09:14:23.864425 (+ 489us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 09:14:23.864437 (+ 12us) client_negotiation.cc:769] Sending connection context
0806 09:14:23.864562 (+ 125us) client_negotiation.cc:240] Negotiation successful
0806 09:14:23.864858 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":929,"mutex_wait_us":42,"thread_start_us":653,"threads_started":1}
I20260806 09:14:23.972656 12396 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33134:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:14:23.972986 12396 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33134:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:14:23.977248 12396 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ff43d84fe1e4471e88eda96e1163934b: Sending DeleteTablet for 3 replicas of tablet 3f0fb59de760417fa750048ae9f3ee85
I20260806 09:14:23.978526 12533 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f0fb59de760417fa750048ae9f3ee85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:14:23 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:34474
I20260806 09:14:23.978796 12674 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f0fb59de760417fa750048ae9f3ee85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:14:23 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:32900
I20260806 09:14:23.979219 12817 tablet_service.cc:1514] Processing DeleteTablet for tablet 3f0fb59de760417fa750048ae9f3ee85 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:14:23 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:51758
I20260806 09:14:23.989336 12988 tablet_replica.cc:330] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05: stopping tablet replica
I20260806 09:14:23.990121 12988 raft_consensus.cc:2229] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:14:23.991204 12986 tablet_replica.cc:330] T 3f0fb59de760417fa750048ae9f3ee85 P 742ab1485d364919a0a06cad9b00cae6: stopping tablet replica
I20260806 09:14:23.991567 12986 raft_consensus.cc:2229] T 3f0fb59de760417fa750048ae9f3ee85 P 742ab1485d364919a0a06cad9b00cae6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:14:23.992092 12986 raft_consensus.cc:2258] T 3f0fb59de760417fa750048ae9f3ee85 P 742ab1485d364919a0a06cad9b00cae6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:14:23.992900 12987 tablet_replica.cc:330] T 3f0fb59de760417fa750048ae9f3ee85 P 75e561d75c464b2f9fac6f4fc858bff5: stopping tablet replica
I20260806 09:14:23.992069 12988 raft_consensus.cc:2258] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:14:23.993745 12986 ts_tablet_manager.cc:1905] T 3f0fb59de760417fa750048ae9f3ee85 P 742ab1485d364919a0a06cad9b00cae6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:14:23.994343 12988 ts_tablet_manager.cc:1905] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:14:23.994683 12987 raft_consensus.cc:2229] T 3f0fb59de760417fa750048ae9f3ee85 P 75e561d75c464b2f9fac6f4fc858bff5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:14:23.995119 12987 raft_consensus.cc:2258] T 3f0fb59de760417fa750048ae9f3ee85 P 75e561d75c464b2f9fac6f4fc858bff5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:14:24.009811 12987 ts_tablet_manager.cc:1905] T 3f0fb59de760417fa750048ae9f3ee85 P 75e561d75c464b2f9fac6f4fc858bff5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:14:24.018898 12986 ts_tablet_manager.cc:1918] T 3f0fb59de760417fa750048ae9f3ee85 P 742ab1485d364919a0a06cad9b00cae6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 09:14:24.019107 12986 log.cc:1196] T 3f0fb59de760417fa750048ae9f3ee85 P 742ab1485d364919a0a06cad9b00cae6: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-0/wal/wals/3f0fb59de760417fa750048ae9f3ee85
I20260806 09:14:24.021596 12986 ts_tablet_manager.cc:1939] T 3f0fb59de760417fa750048ae9f3ee85 P 742ab1485d364919a0a06cad9b00cae6: Deleting consensus metadata
I20260806 09:14:24.022593 12987 ts_tablet_manager.cc:1918] T 3f0fb59de760417fa750048ae9f3ee85 P 75e561d75c464b2f9fac6f4fc858bff5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 09:14:24.022848 12987 log.cc:1196] T 3f0fb59de760417fa750048ae9f3ee85 P 75e561d75c464b2f9fac6f4fc858bff5: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/3f0fb59de760417fa750048ae9f3ee85
I20260806 09:14:24.023685 12383 catalog_manager.cc:4841] TS 742ab1485d364919a0a06cad9b00cae6 (127.10.255.65:45749): tablet 3f0fb59de760417fa750048ae9f3ee85 (table test-table [id=05466720665d4997b144308a4f0a8970]) successfully deleted
I20260806 09:14:24.025453 12987 ts_tablet_manager.cc:1939] T 3f0fb59de760417fa750048ae9f3ee85 P 75e561d75c464b2f9fac6f4fc858bff5: Deleting consensus metadata
I20260806 09:14:24.025465 12988 ts_tablet_manager.cc:1918] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 09:14:24.025808 12988 log.cc:1196] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/3f0fb59de760417fa750048ae9f3ee85
I20260806 09:14:24.026866 12988 ts_tablet_manager.cc:1939] T 3f0fb59de760417fa750048ae9f3ee85 P 7f13d3bc57b24c5eb8b7b02ea4853b05: Deleting consensus metadata
I20260806 09:14:24.027451 12383 catalog_manager.cc:4841] TS 75e561d75c464b2f9fac6f4fc858bff5 (127.10.255.66:36845): tablet 3f0fb59de760417fa750048ae9f3ee85 (table test-table [id=05466720665d4997b144308a4f0a8970]) successfully deleted
I20260806 09:14:24.028355 12383 catalog_manager.cc:4841] TS 7f13d3bc57b24c5eb8b7b02ea4853b05 (127.10.255.67:45899): tablet 3f0fb59de760417fa750048ae9f3ee85 (table test-table [id=05466720665d4997b144308a4f0a8970]) successfully deleted
Aug 06 09:14:24 dist-test-slave-mvvj krb5kdc[12352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007662, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.255.65@KRBTEST.COM
I20260806 09:14:24.051112 12990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:23.996469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34490 (local address 127.10.255.65:45749)
0806 09:14:24.017371 (+ 20902us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:24.017385 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:24.020581 (+ 3196us) server_negotiation.cc:407] Connection header received
0806 09:14:24.020916 (+ 335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:24.020921 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:24.021013 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:24.021189 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:24.026847 (+ 5658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:24.028665 (+ 1818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:24.030733 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:24.031767 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:24.031984 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:24.039124 (+ 7140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:24.039150 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:24.039175 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:24.039233 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:24.045918 (+ 6685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:24.047278 (+ 1360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:24.047291 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:24.047294 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:24.047669 (+ 375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:24.048415 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:24.048423 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:24.048427 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:24.049150 (+ 723us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:24.049620 (+ 470us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:24.050078 (+ 458us) server_negotiation.cc:299] Negotiation successful
0806 09:14:24.050468 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20618,"thread_start_us":20944,"threads_started":1}
W20260806 09:14:24.052945 12599 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34490
I20260806 09:14:24.088614 12993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:24.061370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33158 (local address 127.10.255.126:43071)
0806 09:14:24.062253 (+ 883us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:24.062260 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:24.063186 (+ 926us) server_negotiation.cc:407] Connection header received
0806 09:14:24.063423 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:24.063444 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:24.063565 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:24.063716 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:24.066896 (+ 3180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:24.068531 (+ 1635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:24.070833 (+ 2302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:24.071884 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:24.072042 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:24.077237 (+ 5195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:24.077247 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:24.077264 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:24.077410 (+ 146us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:24.083805 (+ 6395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:24.085223 (+ 1418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:24.085242 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:24.085247 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:24.085519 (+ 272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:24.086103 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:24.086121 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:24.086125 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:24.086625 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:24.086949 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:24.087675 (+ 726us) server_negotiation.cc:299] Negotiation successful
0806 09:14:24.088039 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":726,"thread_start_us":558,"threads_started":1}
W20260806 09:14:24.089432 12396 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:33158
I20260806 09:14:24.092455 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 12468
I20260806 09:14:24.111728 12990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:24.094261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34504 (local address 127.10.255.65:45749)
0806 09:14:24.094491 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:24.094496 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:24.094512 (+ 16us) server_negotiation.cc:407] Connection header received
0806 09:14:24.094591 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:24.094596 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:24.094674 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:24.094786 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:24.096308 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:24.097005 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:24.098553 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:24.098983 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:24.099133 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:24.102619 (+ 3486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:24.102625 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:24.102628 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:24.102669 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:24.107637 (+ 4968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:24.108817 (+ 1180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:24.108826 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:24.108834 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:24.109087 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:24.109726 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:24.109731 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:24.109734 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:24.110051 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:24.110376 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:24.110817 (+ 441us) server_negotiation.cc:299] Negotiation successful
0806 09:14:24.111139 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260806 09:14:24.112520 12599 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34504
W20260806 09:14:24.113736 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 12468: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 09:14:24.114151 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 12468
I20260806 09:14:24.144274 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 12608
Aug 06 09:14:24 dist-test-slave-mvvj krb5kdc[12352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007662, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.255.66@KRBTEST.COM
I20260806 09:14:24.170347 12997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:24.145722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32910 (local address 127.10.255.66:36845)
0806 09:14:24.146759 (+ 1037us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:24.146764 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:24.146782 (+ 18us) server_negotiation.cc:407] Connection header received
0806 09:14:24.146841 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:24.146844 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:24.146909 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:24.147064 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:24.148877 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:24.149984 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:24.152547 (+ 2563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:24.153715 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:24.153873 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:24.161433 (+ 7560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:24.161470 (+ 37us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:24.161489 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:24.161546 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:24.165460 (+ 3914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:24.166832 (+ 1372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:24.166842 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:24.166844 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:24.167042 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:24.167807 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:24.167812 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:24.167815 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:24.168524 (+ 709us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:24.168810 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:24.169314 (+ 504us) server_negotiation.cc:299] Negotiation successful
0806 09:14:24.169727 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":919,"thread_start_us":720,"threads_started":1}
W20260806 09:14:24.171443 12742 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:32910
W20260806 09:14:24.172963 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 12608: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 09:14:24.173529 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 12608
I20260806 09:14:24.195181 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 12751
Aug 06 09:14:24 dist-test-slave-mvvj krb5kdc[12352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007662, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.255.67@KRBTEST.COM
I20260806 09:14:24.214561 12967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:24.196106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51786 (local address 127.10.255.67:45899)
0806 09:14:24.196311 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:24.196318 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:24.196339 (+ 21us) server_negotiation.cc:407] Connection header received
0806 09:14:24.196554 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:24.196624 (+ 70us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:24.196704 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:24.196835 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:24.198111 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:24.198892 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:24.200441 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:24.200961 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:24.201140 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:24.206380 (+ 5240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:24.206397 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:24.206419 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:24.206471 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:24.210945 (+ 4474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:24.211935 (+ 990us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:24.211951 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:24.211955 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:24.212174 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:24.212639 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:24.212650 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:24.212653 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:24.213213 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:24.213570 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:24.213896 (+ 326us) server_negotiation.cc:299] Negotiation successful
0806 09:14:24.214173 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
W20260806 09:14:24.215600 12885 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51786
W20260806 09:14:24.216558 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 12751: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 09:14:24.216763 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 12751
I20260806 09:14:24.239625 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 12365
I20260806 09:14:24.241010 12437 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:24.364970 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 12365
2026-08-06T09:14:24Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (5959 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:14:24 dist-test-slave-mvvj krb5kdc[13001](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:14:24 dist-test-slave-mvvj krb5kdc[13001](info): set up 2 sockets
Aug 06 09:14:24 dist-test-slave-mvvj krb5kdc[13001](info): commencing operation
krb5kdc: starting...
W20260806 09:14:25.494637 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.085s user 0.000s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:14:25 dist-test-slave-mvvj krb5kdc[13001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007665, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:14:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:14:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:14:25.717906 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:45321
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:45321
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:26.073848 13014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:26.074213 13014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:26.074383 13014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:26.082186 13014 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:14:26.082324 13014 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 09:14:26.082368 13014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:26.082463 13014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:26.082551 13014 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:14:26.082636 13014 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:14:26.093317 13014 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:45321
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:45321
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:26.094785 13014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:26.096278 13014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:26.109853 13019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:26.109930 13022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:26.109880 13020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:26.111622 13014 server_base.cc:1034] running on GCE node
I20260806 09:14:26.112569 13014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:26.114173 13014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:26.115460 13014 hybrid_clock.cc:648] HybridClock initialized: now 1786007666115404 us; error 43 us; skew 500 ppm
I20260806 09:14:26.115940 13014 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:26 dist-test-slave-mvvj krb5kdc[13001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007666, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:26.126622 13014 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:14:26.128603 13014 webserver.cc:460] Webserver started at http://127.10.255.126:37207/ using document root <none> and password file <none>
I20260806 09:14:26.129406 13014 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:26.129557 13014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:26.129978 13014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:26.133460 13014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "38848f6ce966465caebcad7105ed3d79"
format_stamp: "Formatted at 2026-08-06 09:14:26 on dist-test-slave-mvvj"
server_key: "e339648163234d3d82ef391877604954"
server_key_iv: "ca27c27b235b5fa3b77a42179c3118f2"
server_key_version: "encryptionkey@0"
I20260806 09:14:26.134374 13014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "38848f6ce966465caebcad7105ed3d79"
format_stamp: "Formatted at 2026-08-06 09:14:26 on dist-test-slave-mvvj"
server_key: "e339648163234d3d82ef391877604954"
server_key_iv: "ca27c27b235b5fa3b77a42179c3118f2"
server_key_version: "encryptionkey@0"
I20260806 09:14:26.140681 13014 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260806 09:14:26.145414 13029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:26.147272 13014 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260806 09:14:26.147590 13014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "38848f6ce966465caebcad7105ed3d79"
format_stamp: "Formatted at 2026-08-06 09:14:26 on dist-test-slave-mvvj"
server_key: "e339648163234d3d82ef391877604954"
server_key_iv: "ca27c27b235b5fa3b77a42179c3118f2"
server_key_version: "encryptionkey@0"
I20260806 09:14:26.147900 13014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:26.168910 13014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:26.173755 13014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:26.173995 13014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:26.198727 13014 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:45321
I20260806 09:14:26.198752 13091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:45321 every 8 connection(s)
I20260806 09:14:26.200282 13014 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:14:26.202910 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 13014
I20260806 09:14:26.203162 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:14:26.204108 11261 external_mini_cluster.cc:1428] Setting key c9134eab49096717a8c513325d4a637e
I20260806 09:14:26.205369 13092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 09:14:26 dist-test-slave-mvvj krb5kdc[13001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007665, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:26.220036 13092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79: Bootstrap starting.
I20260806 09:14:26.224895 13092 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:26.226337 13092 log.cc:824] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:26.230342 13092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79: No bootstrap required, opened a new log
I20260806 09:14:26.230458 13095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:26.206648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37356 (local address 127.10.255.126:45321)
0806 09:14:26.207575 (+ 927us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:26.207590 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:26.207634 (+ 44us) server_negotiation.cc:407] Connection header received
0806 09:14:26.209398 (+ 1764us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:26.209429 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:26.209935 (+ 506us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:26.210398 (+ 463us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:26.212126 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:26.213553 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:26.214918 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:26.215671 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:26.215944 (+ 273us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:26.220668 (+ 4724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:26.220680 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:26.220703 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:26.220756 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:26.225131 (+ 4375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:26.226116 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:26.226128 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:26.226139 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:26.226401 (+ 262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:26.226911 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:26.226918 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:26.226923 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:26.227689 (+ 766us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:26.228066 (+ 377us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:26.228506 (+ 440us) server_negotiation.cc:299] Negotiation successful
0806 09:14:26.229016 (+ 510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":414,"threads_started":1}
I20260806 09:14:26.238590 13092 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38848f6ce966465caebcad7105ed3d79" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 45321 } }
I20260806 09:14:26.239003 13092 raft_consensus.cc:374] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:26.239070 13092 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38848f6ce966465caebcad7105ed3d79, State: Initialized, Role: FOLLOWER
I20260806 09:14:26.239634 13092 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38848f6ce966465caebcad7105ed3d79" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 45321 } }
I20260806 09:14:26.239907 13092 raft_consensus.cc:388] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:14:26.240039 13092 raft_consensus.cc:482] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:14:26.240190 13092 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:26.242448 13092 raft_consensus.cc:504] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38848f6ce966465caebcad7105ed3d79" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 45321 } }
I20260806 09:14:26.243090 13092 leader_election.cc:302] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 38848f6ce966465caebcad7105ed3d79; no voters:
I20260806 09:14:26.243953 13092 leader_election.cc:288] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:14:26.244112 13097 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:14:26.244897 13097 raft_consensus.cc:686] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79 [term 1 LEADER]: Becoming Leader. State: Replica: 38848f6ce966465caebcad7105ed3d79, State: Running, Role: LEADER
I20260806 09:14:26.245517 13097 consensus_queue.cc:237] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38848f6ce966465caebcad7105ed3d79" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 45321 } }
I20260806 09:14:26.246227 13092 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:14:26.248697 13099 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 38848f6ce966465caebcad7105ed3d79. Latest consensus state: current_term: 1 leader_uuid: "38848f6ce966465caebcad7105ed3d79" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38848f6ce966465caebcad7105ed3d79" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 45321 } } }
I20260806 09:14:26.249871 13099 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79 [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:26.249135 13098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "38848f6ce966465caebcad7105ed3d79" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "38848f6ce966465caebcad7105ed3d79" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 45321 } } }
I20260806 09:14:26.251204 13098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79 [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:26.261999 13105 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:14:26.267941 13105 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:14:26.278734 13105 catalog_manager.cc:1347] Generated new cluster ID: 905b4df75265451a843e6ad6473dd3c5
I20260806 09:14:26.278872 13105 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:14:26.300415 13105 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:14:26.301898 13105 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:14:26.314536 13105 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79: Generated new TSK 0
I20260806 09:14:26.315747 13105 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.255.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
I20260806 09:14:26.389295 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:45321
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:26.759296 13118 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:26.759632 13118 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:26.759742 13118 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:26.767480 13118 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:26.767608 13118 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:26.767695 13118 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 09:14:26.767748 13118 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 09:14:26.767822 13118 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:14:26.778296 13118 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.255.126:45321
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:26.779629 13118 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:26.781052 13118 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:26.795457 13123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:26.795495 13124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:26.795415 13126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:26.796383 13118 server_base.cc:1034] running on GCE node
I20260806 09:14:26.797097 13118 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:26.798075 13118 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:26.799328 13118 hybrid_clock.cc:648] HybridClock initialized: now 1786007666799248 us; error 72 us; skew 500 ppm
I20260806 09:14:26.799738 13118 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:26 dist-test-slave-mvvj krb5kdc[13001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007666, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:26.803411 13118 init.cc:377] Logged in from keytab as kudu/127.10.255.65@KRBTEST.COM (short username kudu)
I20260806 09:14:26.805171 13118 webserver.cc:460] Webserver started at http://127.10.255.65:40373/ using document root <none> and password file <none>
I20260806 09:14:26.805876 13118 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:26.805987 13118 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:26.806270 13118 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:26.809492 13118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "3c43409b300a4cb2abf72f8b260a1671"
format_stamp: "Formatted at 2026-08-06 09:14:26 on dist-test-slave-mvvj"
server_key: "8ab77538643855962807b532112ac25a"
server_key_iv: "d7742a66db9a46fffdf2977e2b6f5f62"
server_key_version: "encryptionkey@0"
I20260806 09:14:26.810247 13118 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "3c43409b300a4cb2abf72f8b260a1671"
format_stamp: "Formatted at 2026-08-06 09:14:26 on dist-test-slave-mvvj"
server_key: "8ab77538643855962807b532112ac25a"
server_key_iv: "d7742a66db9a46fffdf2977e2b6f5f62"
server_key_version: "encryptionkey@0"
I20260806 09:14:26.816200 13118 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 09:14:26.820466 13133 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:26.822256 13118 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:14:26.822423 13118 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "3c43409b300a4cb2abf72f8b260a1671"
format_stamp: "Formatted at 2026-08-06 09:14:26 on dist-test-slave-mvvj"
server_key: "8ab77538643855962807b532112ac25a"
server_key_iv: "d7742a66db9a46fffdf2977e2b6f5f62"
server_key_version: "encryptionkey@0"
I20260806 09:14:26.822773 13118 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:26.847200 13118 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:26.852851 13118 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:26.853298 13118 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:26.856451 13118 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:26.856622 13118 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:26.856765 13118 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:26.856863 13118 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 09:14:26 dist-test-slave-mvvj krb5kdc[13001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007666, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:26.886870 13143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:26.857377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:49971 (local address 127.10.255.126:45321)
0806 09:14:26.857893 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:26.857898 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:26.859541 (+ 1643us) server_negotiation.cc:407] Connection header received
0806 09:14:26.862184 (+ 2643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:26.862190 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:26.862293 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:26.862455 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:26.865618 (+ 3163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:26.866458 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:26.870821 (+ 4363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:26.871508 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:26.871717 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:26.877383 (+ 5666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:26.877392 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:26.877399 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:26.877455 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:26.881468 (+ 4013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:26.883155 (+ 1687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:26.883161 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:26.883163 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:26.883312 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:26.884161 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:26.884169 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:26.884176 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:26.884610 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:26.884812 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:26.886351 (+ 1539us) server_negotiation.cc:299] Negotiation successful
0806 09:14:26.886595 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":299,"threads_started":1}
I20260806 09:14:26.889827 13144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:26.858310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:45321 (local address 127.10.255.65:49971)
0806 09:14:26.859331 (+ 1021us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:26.859376 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:26.861798 (+ 2422us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:26.862888 (+ 1090us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:26.862905 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:26.864087 (+ 1182us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:26.865310 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:26.865351 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:26.866706 (+ 1355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:26.866716 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:26.870493 (+ 3777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:26.870524 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:26.871895 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:26.871906 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:26.872224 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:26.873360 (+ 1136us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:26.873404 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:26.876942 (+ 3538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:26.881691 (+ 4749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:26.881709 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:26.881745 (+ 36us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:26.882918 (+ 1173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:26.883460 (+ 542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:26.883468 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:26.883475 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:26.883944 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:26.884784 (+ 840us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:26.884804 (+ 20us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:26.885657 (+ 853us) client_negotiation.cc:769] Sending connection context
0806 09:14:26.886164 (+ 507us) client_negotiation.cc:240] Negotiation successful
0806 09:14:26.887280 (+ 1116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":731,"thread_start_us":453,"threads_started":1}
I20260806 09:14:26.914202 13118 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:40711
I20260806 09:14:26.914202 13255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:40711 every 8 connection(s)
I20260806 09:14:26.915762 13118 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:14:26.915944 13143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:26.898878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:48719 (local address 127.10.255.126:45321)
0806 09:14:26.899132 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:26.899141 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:26.899476 (+ 335us) server_negotiation.cc:407] Connection header received
0806 09:14:26.899814 (+ 338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:26.899821 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:26.899965 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:26.900056 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:26.902168 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:26.903166 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:26.905336 (+ 2170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:26.905824 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:26.905981 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:26.908316 (+ 2335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:26.908325 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:26.908333 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:26.908391 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:26.912352 (+ 3961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:26.913410 (+ 1058us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:26.913417 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:26.913420 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:26.913594 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:26.914050 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:26.914058 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:26.914063 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:26.914540 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:26.914741 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:26.915215 (+ 474us) server_negotiation.cc:299] Negotiation successful
0806 09:14:26.915482 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260806 09:14:26.916095 13229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:26.898625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:45321 (local address 127.10.255.65:48719)
0806 09:14:26.899321 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:26.899348 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:26.899561 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:26.900303 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:26.900308 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:26.901053 (+ 745us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:26.901854 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:26.901887 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:26.903416 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:26.903423 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:26.905153 (+ 1730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:26.905171 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:26.906048 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:26.906057 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:26.906225 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:26.907069 (+ 844us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:26.907090 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:26.908052 (+ 962us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:26.912551 (+ 4499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:26.912558 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:26.912562 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:26.913247 (+ 685us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:26.913736 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:26.913745 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:26.913749 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:26.913910 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:26.914682 (+ 772us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:26.914688 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:26.914916 (+ 228us) client_negotiation.cc:769] Sending connection context
0806 09:14:26.915089 (+ 173us) client_negotiation.cc:240] Negotiation successful
0806 09:14:26.915489 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":373,"threads_started":1}
I20260806 09:14:26.919813 13256 heartbeater.cc:347] Connected to a master server at 127.10.255.126:45321
I20260806 09:14:26.920328 13256 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:26.921250 13256 heartbeater.cc:511] Master 127.10.255.126:45321 requested a full tablet report, sending...
I20260806 09:14:26.923517 13046 ts_manager.cc:194] Registered new tserver with Master: 3c43409b300a4cb2abf72f8b260a1671 (127.10.255.65:40711)
I20260806 09:14:26.924923 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 13118
I20260806 09:14:26.925148 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:14:26.925175 13046 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.65@KRBTEST.COM'} at 127.10.255.65:49971
I20260806 09:14:26.925845 11261 external_mini_cluster.cc:1428] Setting key a09d5f124e127fbc022d9f183b00e870
WARNING: no policy specified for kudu/127.10.255.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
I20260806 09:14:26.972160 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:45321
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:27.339282 13260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:27.339811 13260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:27.340160 13260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:27.349150 13260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:27.349370 13260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:27.349524 13260 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 09:14:27.349638 13260 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 09:14:27.349772 13260 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:14:27.361927 13260 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.255.126:45321
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:27.364180 13260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:27.365885 13260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:27.383787 13268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:27.383903 13266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:27.384164 13265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:27.385324 13260 server_base.cc:1034] running on GCE node
I20260806 09:14:27.386251 13260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:27.387715 13260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:27.388988 13260 hybrid_clock.cc:648] HybridClock initialized: now 1786007667388931 us; error 55 us; skew 500 ppm
I20260806 09:14:27.389797 13260 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:27 dist-test-slave-mvvj krb5kdc[13001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007667, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:27.394871 13260 init.cc:377] Logged in from keytab as kudu/127.10.255.66@KRBTEST.COM (short username kudu)
I20260806 09:14:27.397519 13260 webserver.cc:460] Webserver started at http://127.10.255.66:35817/ using document root <none> and password file <none>
I20260806 09:14:27.398465 13260 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:27.398658 13260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:27.399063 13260 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:27.403568 13260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "2e3b885b4dcc49f49fd433b6b47bafe3"
format_stamp: "Formatted at 2026-08-06 09:14:27 on dist-test-slave-mvvj"
server_key: "c7a933149a639abb932d822f315a89e2"
server_key_iv: "e17617cd1a549abcdf55306e9dfba77b"
server_key_version: "encryptionkey@0"
I20260806 09:14:27.404654 13260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "2e3b885b4dcc49f49fd433b6b47bafe3"
format_stamp: "Formatted at 2026-08-06 09:14:27 on dist-test-slave-mvvj"
server_key: "c7a933149a639abb932d822f315a89e2"
server_key_iv: "e17617cd1a549abcdf55306e9dfba77b"
server_key_version: "encryptionkey@0"
I20260806 09:14:27.411423 13260 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260806 09:14:27.416065 13276 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:27.417914 13260 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260806 09:14:27.418145 13260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "2e3b885b4dcc49f49fd433b6b47bafe3"
format_stamp: "Formatted at 2026-08-06 09:14:27 on dist-test-slave-mvvj"
server_key: "c7a933149a639abb932d822f315a89e2"
server_key_iv: "e17617cd1a549abcdf55306e9dfba77b"
server_key_version: "encryptionkey@0"
I20260806 09:14:27.418467 13260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:27.438928 13260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:27.444717 13260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:27.445076 13260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:27.448499 13260 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:27.448653 13260 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:27.448820 13260 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:27.448933 13260 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 09:14:27 dist-test-slave-mvvj krb5kdc[13001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007667, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:27.479601 13285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:27.449340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:41503 (local address 127.10.255.126:45321)
0806 09:14:27.449995 (+ 655us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:27.450002 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:27.451733 (+ 1731us) server_negotiation.cc:407] Connection header received
0806 09:14:27.457998 (+ 6265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:27.458046 (+ 48us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:27.458235 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:27.459199 (+ 964us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:27.462255 (+ 3056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:27.463645 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:27.466164 (+ 2519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:27.466888 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:27.466982 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:27.472488 (+ 5506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:27.472495 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:27.472498 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:27.472538 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:27.475697 (+ 3159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:27.476857 (+ 1160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:27.476864 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:27.476868 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:27.477027 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:27.477554 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:27.477563 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:27.477565 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:27.477852 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:27.478042 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:27.478901 (+ 859us) server_negotiation.cc:299] Negotiation successful
0806 09:14:27.479178 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":396,"threads_started":1}
I20260806 09:14:27.481127 13286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:27.450161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:45321 (local address 127.10.255.66:41503)
0806 09:14:27.451280 (+ 1119us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:27.451335 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:27.454983 (+ 3648us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:27.459199 (+ 4216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:27.459216 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:27.460435 (+ 1219us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:27.461771 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:27.461810 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:27.463954 (+ 2144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:27.463959 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:27.465910 (+ 1951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:27.465930 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:27.467300 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:27.467305 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:27.467695 (+ 390us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:27.468739 (+ 1044us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:27.468770 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:27.472150 (+ 3380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:27.475998 (+ 3848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:27.476017 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:27.476055 (+ 38us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:27.476649 (+ 594us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:27.477165 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:27.477173 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:27.477181 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:27.477406 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:27.477998 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:27.478008 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:27.478457 (+ 449us) client_negotiation.cc:769] Sending connection context
0806 09:14:27.478752 (+ 295us) client_negotiation.cc:240] Negotiation successful
0806 09:14:27.479392 (+ 640us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":699,"thread_start_us":424,"threads_started":1}
I20260806 09:14:27.508489 13336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:27.489339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:45321 (local address 127.10.255.66:46697)
0806 09:14:27.490109 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:27.490127 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:27.490268 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:27.490836 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:27.490840 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:27.491342 (+ 502us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:27.491749 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:27.491760 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:27.493538 (+ 1778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:27.493549 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:27.495329 (+ 1780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:27.495346 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:27.496742 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:27.496752 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:27.497024 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:27.497881 (+ 857us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:27.497915 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:27.499311 (+ 1396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:27.504565 (+ 5254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:27.504579 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:27.504584 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:27.505430 (+ 846us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:27.506045 (+ 615us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:27.506053 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:27.506060 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:27.506308 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:27.507101 (+ 793us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:27.507107 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:27.507343 (+ 236us) client_negotiation.cc:769] Sending connection context
0806 09:14:27.507603 (+ 260us) client_negotiation.cc:240] Negotiation successful
0806 09:14:27.508103 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":391,"threads_started":1}
I20260806 09:14:27.508760 13285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:27.489492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:46697 (local address 127.10.255.126:45321)
0806 09:14:27.489767 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:27.489776 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:27.490232 (+ 456us) server_negotiation.cc:407] Connection header received
0806 09:14:27.490388 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:27.490397 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:27.490633 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:27.490792 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:27.491946 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:27.493334 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:27.495519 (+ 2185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:27.496373 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:27.496576 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:27.499654 (+ 3078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:27.499666 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:27.499674 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:27.499737 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:27.504263 (+ 4526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:27.505666 (+ 1403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:27.505671 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:27.505674 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:27.505828 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:27.506470 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:27.506477 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:27.506481 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:27.506936 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:27.507157 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:27.507753 (+ 596us) server_negotiation.cc:299] Negotiation successful
0806 09:14:27.508249 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260806 09:14:27.524760 13260 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:37443
I20260806 09:14:27.524890 13397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:37443 every 8 connection(s)
I20260806 09:14:27.526268 13260 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:14:27.529353 13398 heartbeater.cc:347] Connected to a master server at 127.10.255.126:45321
I20260806 09:14:27.529721 13398 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:27.530516 13398 heartbeater.cc:511] Master 127.10.255.126:45321 requested a full tablet report, sending...
I20260806 09:14:27.532385 13046 ts_manager.cc:194] Registered new tserver with Master: 2e3b885b4dcc49f49fd433b6b47bafe3 (127.10.255.66:37443)
I20260806 09:14:27.533336 13046 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.66@KRBTEST.COM'} at 127.10.255.66:41503
I20260806 09:14:27.536336 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 13260
I20260806 09:14:27.536528 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:14:27.537003 11261 external_mini_cluster.cc:1428] Setting key ed83193eb049b091b907a8051b70a3c8
WARNING: no policy specified for kudu/127.10.255.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.67@KRBTEST.COM" created.
I20260806 09:14:27.928885 13256 heartbeater.cc:503] Master 127.10.255.126:45321 was elected leader, sending a full tablet report...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
W20260806 09:14:28.346608 11261 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.10.255.67: real 0.806s user 0.010s sys 0.000s
I20260806 09:14:28.347728 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:45321
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38455
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:14:28.536751 13398 heartbeater.cc:503] Master 127.10.255.126:45321 was elected leader, sending a full tablet report...
W20260806 09:14:28.738314 13402 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:28.738673 13402 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:28.738785 13402 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:28.746953 13402 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:28.747097 13402 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:28.747298 13402 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 09:14:28.747366 13402 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 09:14:28.747484 13402 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:14:28.758893 13402 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38455
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.255.126:45321
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:28.760605 13402 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:28.762313 13402 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:28.778573 13407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:28.778679 13408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:28.778573 13410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:28.780342 13402 server_base.cc:1034] running on GCE node
I20260806 09:14:28.781214 13402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:28.782503 13402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:28.783779 13402 hybrid_clock.cc:648] HybridClock initialized: now 1786007668783706 us; error 52 us; skew 500 ppm
I20260806 09:14:28.784255 13402 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:28 dist-test-slave-mvvj krb5kdc[13001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007668, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:28.788261 13402 init.cc:377] Logged in from keytab as kudu/127.10.255.67@KRBTEST.COM (short username kudu)
I20260806 09:14:28.790416 13402 webserver.cc:460] Webserver started at http://127.10.255.67:34895/ using document root <none> and password file <none>
I20260806 09:14:28.791245 13402 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:28.791430 13402 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:28.791875 13402 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:28.795776 13402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "6fa3d435c395490899fa88cfa4b4ff6a"
format_stamp: "Formatted at 2026-08-06 09:14:28 on dist-test-slave-mvvj"
server_key: "292f56f310ae085f6b2eaa63ba002486"
server_key_iv: "f9f136ce1d6ed5eabd967e3d7fb8a61e"
server_key_version: "encryptionkey@0"
I20260806 09:14:28.796907 13402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "6fa3d435c395490899fa88cfa4b4ff6a"
format_stamp: "Formatted at 2026-08-06 09:14:28 on dist-test-slave-mvvj"
server_key: "292f56f310ae085f6b2eaa63ba002486"
server_key_iv: "f9f136ce1d6ed5eabd967e3d7fb8a61e"
server_key_version: "encryptionkey@0"
I20260806 09:14:28.803529 13402 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260806 09:14:28.808357 13417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:28.810204 13402 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 09:14:28.810477 13402 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "6fa3d435c395490899fa88cfa4b4ff6a"
format_stamp: "Formatted at 2026-08-06 09:14:28 on dist-test-slave-mvvj"
server_key: "292f56f310ae085f6b2eaa63ba002486"
server_key_iv: "f9f136ce1d6ed5eabd967e3d7fb8a61e"
server_key_version: "encryptionkey@0"
I20260806 09:14:28.810756 13402 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:28.826290 13402 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:28.833416 13402 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:28.834040 13402 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:28.837638 13402 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:28.837824 13402 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:28.837982 13402 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:28.838088 13402 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 09:14:28 dist-test-slave-mvvj krb5kdc[13001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007668, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:28.872834 13426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:28.838559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:60097 (local address 127.10.255.126:45321)
0806 09:14:28.839203 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:28.839210 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:28.840754 (+ 1544us) server_negotiation.cc:407] Connection header received
0806 09:14:28.844176 (+ 3422us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:28.844185 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:28.844296 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:28.844428 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:28.848186 (+ 3758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:28.849540 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:28.853722 (+ 4182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:28.854217 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:28.854407 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:28.861612 (+ 7205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:28.861626 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:28.861635 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:28.861703 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:28.866487 (+ 4784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:28.867825 (+ 1338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:28.867874 (+ 49us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:28.867880 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:28.868093 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:28.868967 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:28.868976 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:28.868982 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:28.869468 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:28.869654 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:28.871703 (+ 2049us) server_negotiation.cc:299] Negotiation successful
0806 09:14:28.872283 (+ 580us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":329,"threads_started":1}
I20260806 09:14:28.875077 13427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:28.839418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:45321 (local address 127.10.255.67:60097)
0806 09:14:28.840490 (+ 1072us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:28.840553 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:28.843674 (+ 3121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:28.845154 (+ 1480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:28.845171 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:28.846317 (+ 1146us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:28.847864 (+ 1547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:28.847911 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:28.850019 (+ 2108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:28.850026 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:28.853349 (+ 3323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:28.853382 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:28.854572 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:28.854583 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:28.855104 (+ 521us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:28.856244 (+ 1140us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:28.856299 (+ 55us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:28.861131 (+ 4832us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:28.866769 (+ 5638us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:28.866780 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:28.866810 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:28.867603 (+ 793us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:28.868316 (+ 713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:28.868320 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:28.868328 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:28.868759 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:28.869785 (+ 1026us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:28.869798 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:28.870592 (+ 794us) client_negotiation.cc:769] Sending connection context
0806 09:14:28.871434 (+ 842us) client_negotiation.cc:240] Negotiation successful
0806 09:14:28.872423 (+ 989us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":688,"thread_start_us":440,"threads_started":1}
I20260806 09:14:28.888262 13402 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:38489
I20260806 09:14:28.888329 13538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:38489 every 8 connection(s)
I20260806 09:14:28.889936 13402 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:14:28.892930 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 13402
I20260806 09:14:28.892993 13539 heartbeater.cc:347] Connected to a master server at 127.10.255.126:45321
I20260806 09:14:28.893172 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:14:28.893309 13539 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:28.893783 11261 external_mini_cluster.cc:1428] Setting key 03057cd93a84227541048049902a0eac
I20260806 09:14:28.894294 13539 heartbeater.cc:511] Master 127.10.255.126:45321 requested a full tablet report, sending...
I20260806 09:14:28.896284 13045 ts_manager.cc:194] Registered new tserver with Master: 6fa3d435c395490899fa88cfa4b4ff6a (127.10.255.67:38489)
I20260806 09:14:28.897835 13045 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.67@KRBTEST.COM'} at 127.10.255.67:60097
I20260806 09:14:28.898726 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 09:14:28.902521 13426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:28.884861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:46879 (local address 127.10.255.126:45321)
0806 09:14:28.885124 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:28.885133 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:28.885704 (+ 571us) server_negotiation.cc:407] Connection header received
0806 09:14:28.885948 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:28.885954 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:28.886046 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:28.886162 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:28.887516 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:28.888669 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:28.890776 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:28.891559 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:28.891733 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:28.894546 (+ 2813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:28.894557 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:28.894563 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:28.894611 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:28.898959 (+ 4348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:28.899992 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:28.899999 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:28.900002 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:28.900195 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:28.900706 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:28.900712 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:28.900715 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:28.901098 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:28.901271 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:28.901875 (+ 604us) server_negotiation.cc:299] Negotiation successful
0806 09:14:28.902150 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260806 09:14:28.902989 13533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:28.884209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:45321 (local address 127.10.255.67:46879)
0806 09:14:28.885559 (+ 1350us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:28.885578 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:28.885795 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:28.886205 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:28.886212 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:28.886780 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:28.887296 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:28.887317 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:28.888855 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:28.888862 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:28.890404 (+ 1542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:28.890422 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:28.891797 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:28.891804 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:28.892018 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:28.892992 (+ 974us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:28.893021 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:28.894250 (+ 1229us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:28.899158 (+ 4908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:28.899165 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:28.899169 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:28.899785 (+ 616us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:28.900333 (+ 548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:28.900338 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:28.900342 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:28.900521 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:28.901255 (+ 734us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:28.901263 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:28.901547 (+ 284us) client_negotiation.cc:769] Sending connection context
0806 09:14:28.901716 (+ 169us) client_negotiation.cc:240] Negotiation successful
0806 09:14:28.902170 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1181,"mutex_wait_us":27,"thread_start_us":1044,"threads_started":1}
Aug 06 09:14:28 dist-test-slave-mvvj krb5kdc[13001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007668, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
W20260806 09:14:29.021533 11261 mini_kdc.cc:317] Time spent kinit for test-admin: real 0.120s user 0.006s sys 0.006s
Aug 06 09:14:29 dist-test-slave-mvvj krb5kdc[13001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007668, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:29.044174 13426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.026840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38760 (local address 127.10.255.126:45321)
0806 09:14:29.027146 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:29.027153 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:29.027875 (+ 722us) server_negotiation.cc:407] Connection header received
0806 09:14:29.028150 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:29.028161 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:29.028234 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:29.028353 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:29.029897 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.030808 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.032264 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.032724 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.032881 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.037612 (+ 4731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:29.037619 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:29.037622 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:29.037669 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:29.040715 (+ 3046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:29.041564 (+ 849us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:29.041570 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:29.041574 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:29.041727 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:29.042163 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:29.042167 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:29.042169 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:29.042475 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:29.042768 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:29.043499 (+ 731us) server_negotiation.cc:299] Negotiation successful
0806 09:14:29.043751 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260806 09:14:29.049368 13045 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38760:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:14:29.057307 13045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:14:29.099025 13557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.073837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58378 (local address 127.10.255.66:37443)
0806 09:14:29.089311 (+ 15474us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:29.089322 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:29.089358 (+ 36us) server_negotiation.cc:407] Connection header received
0806 09:14:29.089476 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:29.089485 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:29.089733 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:29.090015 (+ 282us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:29.090984 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.092497 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.096415 (+ 3918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.097654 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.097836 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.098076 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:29.098474 (+ 398us) server_negotiation.cc:299] Negotiation successful
0806 09:14:29.098674 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15287,"thread_start_us":15137,"threads_started":1}
I20260806 09:14:29.099349 13552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.072358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:38489 (local address 127.0.0.1:42798)
0806 09:14:29.085391 (+ 13033us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:29.085463 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:29.085732 (+ 269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:29.090016 (+ 4284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:29.090025 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:29.090087 (+ 62us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:29.090695 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:29.090712 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.092949 (+ 2237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.092961 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:29.095680 (+ 2719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:29.095695 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.098282 (+ 2587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.098290 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:29.098528 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.098561 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 09:14:29.098658 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 09:14:29.098834 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12634,"mutex_wait_us":133,"spinlock_wait_cycles":4352,"thread_start_us":13624,"threads_started":1}
I20260806 09:14:29.100088 13554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.072751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42798 (local address 127.10.255.67:38489)
0806 09:14:29.089453 (+ 16702us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:29.089460 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:29.089489 (+ 29us) server_negotiation.cc:407] Connection header received
0806 09:14:29.089571 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:29.089576 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:29.089750 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:29.089986 (+ 236us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:29.090972 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.092750 (+ 1778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.095927 (+ 3177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.097679 (+ 1752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.097825 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.098108 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:29.099051 (+ 943us) server_negotiation.cc:299] Negotiation successful
0806 09:14:29.099710 (+ 659us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16543,"thread_start_us":16498,"threads_started":1}
I20260806 09:14:29.100205 13555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.072736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:40711 (local address 127.0.0.1:42926)
0806 09:14:29.087372 (+ 14636us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:29.087400 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:29.087572 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:29.091298 (+ 3726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:29.091305 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:29.091334 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:29.091743 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:29.091758 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.094065 (+ 2307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.094073 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:29.096402 (+ 2329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:29.096417 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.098797 (+ 2380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.098807 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:29.099055 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.099092 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 09:14:29.099182 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 09:14:29.099342 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14436,"mutex_wait_us":69,"thread_start_us":15165,"threads_started":1}
I20260806 09:14:29.100597 13553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.073086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:37443 (local address 127.0.0.1:58378)
0806 09:14:29.088221 (+ 15135us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:29.088244 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:29.088369 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:29.090019 (+ 1650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:29.090038 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:29.090100 (+ 62us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:29.090752 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:29.090767 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.092638 (+ 1871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.092646 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:29.096202 (+ 3556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:29.096217 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.097904 (+ 1687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.097911 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:29.098177 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.098227 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 09:14:29.098408 (+ 181us) client_negotiation.cc:240] Negotiation successful
0806 09:14:29.098652 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14975,"mutex_wait_us":270,"spinlock_wait_cycles":9600,"thread_start_us":13880,"threads_started":1}
I20260806 09:14:29.101428 13556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.073500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42926 (local address 127.10.255.65:40711)
0806 09:14:29.090555 (+ 17055us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:29.090564 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:29.090598 (+ 34us) server_negotiation.cc:407] Connection header received
0806 09:14:29.090736 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:29.090748 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:29.091041 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:29.092007 (+ 966us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:29.092232 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.093911 (+ 1679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.096596 (+ 2685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.098250 (+ 1654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.098419 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.098630 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:29.100891 (+ 2261us) server_negotiation.cc:299] Negotiation successful
0806 09:14:29.101132 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16856,"thread_start_us":15511,"threads_started":1}
I20260806 09:14:29.104207 13468 tablet_service.cc:1467] Processing CreateTablet for tablet beddefaf1cf34dd481bf7db01252b35d (DEFAULT_TABLE table=test-table [id=0341e52f42af4ac2bd0e581f86872b6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:29.104269 13329 tablet_service.cc:1467] Processing CreateTablet for tablet beddefaf1cf34dd481bf7db01252b35d (DEFAULT_TABLE table=test-table [id=0341e52f42af4ac2bd0e581f86872b6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:29.105849 13329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet beddefaf1cf34dd481bf7db01252b35d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:29.106009 13468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet beddefaf1cf34dd481bf7db01252b35d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:29.105615 13185 tablet_service.cc:1467] Processing CreateTablet for tablet beddefaf1cf34dd481bf7db01252b35d (DEFAULT_TABLE table=test-table [id=0341e52f42af4ac2bd0e581f86872b6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:29.107134 13185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet beddefaf1cf34dd481bf7db01252b35d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:29.129040 13559 tablet_bootstrap.cc:492] T beddefaf1cf34dd481bf7db01252b35d P 2e3b885b4dcc49f49fd433b6b47bafe3: Bootstrap starting.
I20260806 09:14:29.129916 13558 tablet_bootstrap.cc:492] T beddefaf1cf34dd481bf7db01252b35d P 6fa3d435c395490899fa88cfa4b4ff6a: Bootstrap starting.
I20260806 09:14:29.133383 13558 tablet_bootstrap.cc:654] T beddefaf1cf34dd481bf7db01252b35d P 6fa3d435c395490899fa88cfa4b4ff6a: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:29.133813 13560 tablet_bootstrap.cc:492] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671: Bootstrap starting.
I20260806 09:14:29.134760 13558 log.cc:824] T beddefaf1cf34dd481bf7db01252b35d P 6fa3d435c395490899fa88cfa4b4ff6a: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:29.137430 13560 tablet_bootstrap.cc:654] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:29.137439 13559 tablet_bootstrap.cc:654] T beddefaf1cf34dd481bf7db01252b35d P 2e3b885b4dcc49f49fd433b6b47bafe3: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:29.138705 13558 tablet_bootstrap.cc:492] T beddefaf1cf34dd481bf7db01252b35d P 6fa3d435c395490899fa88cfa4b4ff6a: No bootstrap required, opened a new log
I20260806 09:14:29.138900 13560 log.cc:824] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:29.138922 13559 log.cc:824] T beddefaf1cf34dd481bf7db01252b35d P 2e3b885b4dcc49f49fd433b6b47bafe3: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:29.139113 13558 ts_tablet_manager.cc:1397] T beddefaf1cf34dd481bf7db01252b35d P 6fa3d435c395490899fa88cfa4b4ff6a: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.000s
I20260806 09:14:29.142056 13560 tablet_bootstrap.cc:492] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671: No bootstrap required, opened a new log
I20260806 09:14:29.142371 13560 ts_tablet_manager.cc:1397] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260806 09:14:29.148164 13558 raft_consensus.cc:348] T beddefaf1cf34dd481bf7db01252b35d P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } } peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } }
I20260806 09:14:29.148695 13558 raft_consensus.cc:374] T beddefaf1cf34dd481bf7db01252b35d P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:29.148802 13558 raft_consensus.cc:729] T beddefaf1cf34dd481bf7db01252b35d P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fa3d435c395490899fa88cfa4b4ff6a, State: Initialized, Role: FOLLOWER
I20260806 09:14:29.149549 13558 consensus_queue.cc:260] T beddefaf1cf34dd481bf7db01252b35d P 6fa3d435c395490899fa88cfa4b4ff6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } } peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } }
I20260806 09:14:29.149787 13559 tablet_bootstrap.cc:492] T beddefaf1cf34dd481bf7db01252b35d P 2e3b885b4dcc49f49fd433b6b47bafe3: No bootstrap required, opened a new log
I20260806 09:14:29.150313 13559 ts_tablet_manager.cc:1397] T beddefaf1cf34dd481bf7db01252b35d P 2e3b885b4dcc49f49fd433b6b47bafe3: Time spent bootstrapping tablet: real 0.022s user 0.011s sys 0.000s
I20260806 09:14:29.151115 13539 heartbeater.cc:503] Master 127.10.255.126:45321 was elected leader, sending a full tablet report...
I20260806 09:14:29.151121 13560 raft_consensus.cc:348] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } } peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } }
I20260806 09:14:29.151615 13560 raft_consensus.cc:374] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:29.151746 13560 raft_consensus.cc:729] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c43409b300a4cb2abf72f8b260a1671, State: Initialized, Role: FOLLOWER
I20260806 09:14:29.151968 13558 ts_tablet_manager.cc:1428] T beddefaf1cf34dd481bf7db01252b35d P 6fa3d435c395490899fa88cfa4b4ff6a: Time spent starting tablet: real 0.013s user 0.012s sys 0.001s
I20260806 09:14:29.152577 13560 consensus_queue.cc:260] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } } peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } }
I20260806 09:14:29.154666 13560 ts_tablet_manager.cc:1428] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
I20260806 09:14:29.161705 13559 raft_consensus.cc:348] T beddefaf1cf34dd481bf7db01252b35d P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } } peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } }
I20260806 09:14:29.162150 13559 raft_consensus.cc:374] T beddefaf1cf34dd481bf7db01252b35d P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:29.162271 13559 raft_consensus.cc:729] T beddefaf1cf34dd481bf7db01252b35d P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e3b885b4dcc49f49fd433b6b47bafe3, State: Initialized, Role: FOLLOWER
I20260806 09:14:29.162953 13559 consensus_queue.cc:260] T beddefaf1cf34dd481bf7db01252b35d P 2e3b885b4dcc49f49fd433b6b47bafe3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } } peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } }
I20260806 09:14:29.164752 13559 ts_tablet_manager.cc:1428] T beddefaf1cf34dd481bf7db01252b35d P 2e3b885b4dcc49f49fd433b6b47bafe3: Time spent starting tablet: real 0.014s user 0.012s sys 0.000s
W20260806 09:14:29.171021 13257 tablet.cc:2369] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:14:29.191448 13565 raft_consensus.cc:482] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:14:29.191794 13565 raft_consensus.cc:504] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } } peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } }
I20260806 09:14:29.194262 13565 leader_election.cc:288] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fa3d435c395490899fa88cfa4b4ff6a (127.10.255.67:38489), 2e3b885b4dcc49f49fd433b6b47bafe3 (127.10.255.66:37443)
I20260806 09:14:29.203148 13557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.194709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:37965 (local address 127.10.255.66:37443)
0806 09:14:29.194925 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:29.194931 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:29.196188 (+ 1257us) server_negotiation.cc:407] Connection header received
0806 09:14:29.196437 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:29.196445 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:29.196507 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:29.196666 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:29.197283 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.198164 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.200720 (+ 2556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.202027 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.202225 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.202310 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:29.202722 (+ 412us) server_negotiation.cc:299] Negotiation successful
0806 09:14:29.202883 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 09:14:29.203415 13554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.194670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:54859 (local address 127.10.255.67:38489)
0806 09:14:29.194903 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:29.194910 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:29.196141 (+ 1231us) server_negotiation.cc:407] Connection header received
0806 09:14:29.196383 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:29.196389 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:29.196485 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:29.196563 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:29.197358 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.198094 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.201077 (+ 2983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.202383 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.202594 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.202678 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:29.203000 (+ 322us) server_negotiation.cc:299] Negotiation successful
0806 09:14:29.203149 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 09:14:29.203589 13568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.194769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:38489 (local address 127.10.255.65:54859)
0806 09:14:29.196000 (+ 1231us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:29.196035 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:29.196219 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:29.196621 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:29.196628 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:29.196658 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:29.197185 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:29.197220 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.198378 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.198382 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:29.200903 (+ 2521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:29.200919 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.202630 (+ 1711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.202637 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:29.202827 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.202858 (+ 31us) client_negotiation.cc:769] Sending connection context
0806 09:14:29.202968 (+ 110us) client_negotiation.cc:240] Negotiation successful
0806 09:14:29.203127 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1002,"mutex_wait_us":23,"spinlock_wait_cycles":1920,"thread_start_us":930,"threads_started":1}
I20260806 09:14:29.204094 13567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.194925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:37443 (local address 127.10.255.65:37965)
0806 09:14:29.196044 (+ 1119us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:29.196065 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:29.196251 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:29.196703 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:29.196708 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:29.196734 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:29.197114 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:29.197127 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.198328 (+ 1201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.198335 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:29.200512 (+ 2177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:29.200528 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.202286 (+ 1758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.202292 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:29.202479 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.202514 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 09:14:29.203471 (+ 957us) client_negotiation.cc:240] Negotiation successful
0806 09:14:29.203647 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":977,"mutex_wait_us":84,"spinlock_wait_cycles":36224,"thread_start_us":576,"threads_started":1}
I20260806 09:14:29.204716 13488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beddefaf1cf34dd481bf7db01252b35d" candidate_uuid: "3c43409b300a4cb2abf72f8b260a1671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" is_pre_election: true
I20260806 09:14:29.205186 13353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beddefaf1cf34dd481bf7db01252b35d" candidate_uuid: "3c43409b300a4cb2abf72f8b260a1671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" is_pre_election: true
I20260806 09:14:29.205380 13488 raft_consensus.cc:2454] T beddefaf1cf34dd481bf7db01252b35d P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c43409b300a4cb2abf72f8b260a1671 in term 0.
I20260806 09:14:29.205765 13353 raft_consensus.cc:2454] T beddefaf1cf34dd481bf7db01252b35d P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c43409b300a4cb2abf72f8b260a1671 in term 0.
I20260806 09:14:29.206183 13135 leader_election.cc:302] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c43409b300a4cb2abf72f8b260a1671, 6fa3d435c395490899fa88cfa4b4ff6a; no voters:
I20260806 09:14:29.206701 13565 raft_consensus.cc:2781] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:14:29.206866 13565 raft_consensus.cc:482] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:14:29.206959 13565 raft_consensus.cc:3037] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:29.210299 13565 raft_consensus.cc:504] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } } peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } }
I20260806 09:14:29.211107 13565 leader_election.cc:288] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671 [CANDIDATE]: Term 1 election: Requested vote from peers 6fa3d435c395490899fa88cfa4b4ff6a (127.10.255.67:38489), 2e3b885b4dcc49f49fd433b6b47bafe3 (127.10.255.66:37443)
I20260806 09:14:29.211668 13488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beddefaf1cf34dd481bf7db01252b35d" candidate_uuid: "3c43409b300a4cb2abf72f8b260a1671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fa3d435c395490899fa88cfa4b4ff6a"
I20260806 09:14:29.211675 13353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "beddefaf1cf34dd481bf7db01252b35d" candidate_uuid: "3c43409b300a4cb2abf72f8b260a1671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3"
I20260806 09:14:29.211918 13353 raft_consensus.cc:3037] T beddefaf1cf34dd481bf7db01252b35d P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:29.211923 13488 raft_consensus.cc:3037] T beddefaf1cf34dd481bf7db01252b35d P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:29.214411 13488 raft_consensus.cc:2454] T beddefaf1cf34dd481bf7db01252b35d P 6fa3d435c395490899fa88cfa4b4ff6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c43409b300a4cb2abf72f8b260a1671 in term 1.
I20260806 09:14:29.215006 13135 leader_election.cc:302] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c43409b300a4cb2abf72f8b260a1671, 6fa3d435c395490899fa88cfa4b4ff6a; no voters:
I20260806 09:14:29.215227 13353 raft_consensus.cc:2454] T beddefaf1cf34dd481bf7db01252b35d P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c43409b300a4cb2abf72f8b260a1671 in term 1.
I20260806 09:14:29.215377 13565 raft_consensus.cc:2781] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:14:29.216182 13565 raft_consensus.cc:686] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671 [term 1 LEADER]: Becoming Leader. State: Replica: 3c43409b300a4cb2abf72f8b260a1671, State: Running, Role: LEADER
I20260806 09:14:29.216840 13565 consensus_queue.cc:237] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } } peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } }
I20260806 09:14:29.222065 13045 catalog_manager.cc:5495] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c43409b300a4cb2abf72f8b260a1671 (127.10.255.65). New cstate: current_term: 1 leader_uuid: "3c43409b300a4cb2abf72f8b260a1671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } health_report { overall_health: UNKNOWN } } }
W20260806 09:14:29.279606 13399 tablet.cc:2369] T beddefaf1cf34dd481bf7db01252b35d P 2e3b885b4dcc49f49fd433b6b47bafe3: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 09:14:29 dist-test-slave-mvvj krb5kdc[13001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007666, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:29.298468 13576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.282845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:45321 (local address 127.0.0.1:38774)
0806 09:14:29.283601 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:29.283630 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:29.283849 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:29.284313 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:29.284317 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:29.285202 (+ 885us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:29.285472 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:29.285482 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.286619 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.286624 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:29.287675 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:29.287689 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.288597 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.288602 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:29.288736 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.289412 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:29.289431 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:29.291821 (+ 2390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:29.295359 (+ 3538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:29.295376 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:29.295382 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:29.296080 (+ 698us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:29.296630 (+ 550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:29.296634 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:29.296637 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:29.296783 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:29.297438 (+ 655us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:29.297445 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:29.297634 (+ 189us) client_negotiation.cc:769] Sending connection context
0806 09:14:29.297793 (+ 159us) client_negotiation.cc:240] Negotiation successful
0806 09:14:29.298055 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":461,"threads_started":1}
I20260806 09:14:29.298471 13426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.282805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38774 (local address 127.10.255.126:45321)
0806 09:14:29.283152 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:29.283159 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:29.283752 (+ 593us) server_negotiation.cc:407] Connection header received
0806 09:14:29.284075 (+ 323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:29.284079 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:29.284143 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:29.284235 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:29.285683 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.286429 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.287891 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.288398 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.288501 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.292092 (+ 3591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:29.292098 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:29.292101 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:29.292134 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:29.295159 (+ 3025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:29.296258 (+ 1099us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:29.296264 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:29.296267 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:29.296418 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:29.296947 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:29.296951 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:29.296954 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:29.297274 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:29.297401 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:29.297970 (+ 569us) server_negotiation.cc:299] Negotiation successful
0806 09:14:29.298171 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154}
I20260806 09:14:29.305058 13045 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:38774:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 09:14:29.306318 13045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:14:29.314877 13185 tablet_service.cc:1467] Processing CreateTablet for tablet d2db99d5b799474e8ab80e0b4fc71e8c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=89f5c7c2b1c74dcbb2d01f7f5b72f43e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 09:14:29.315064 13468 tablet_service.cc:1467] Processing CreateTablet for tablet d2db99d5b799474e8ab80e0b4fc71e8c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=89f5c7c2b1c74dcbb2d01f7f5b72f43e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 09:14:29.314857 13329 tablet_service.cc:1467] Processing CreateTablet for tablet d2db99d5b799474e8ab80e0b4fc71e8c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=89f5c7c2b1c74dcbb2d01f7f5b72f43e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 09:14:29.315945 13468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2db99d5b799474e8ab80e0b4fc71e8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:29.315945 13329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2db99d5b799474e8ab80e0b4fc71e8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:29.318250 13185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d2db99d5b799474e8ab80e0b4fc71e8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:29.323746 13558 tablet_bootstrap.cc:492] T d2db99d5b799474e8ab80e0b4fc71e8c P 6fa3d435c395490899fa88cfa4b4ff6a: Bootstrap starting.
I20260806 09:14:29.323771 13559 tablet_bootstrap.cc:492] T d2db99d5b799474e8ab80e0b4fc71e8c P 2e3b885b4dcc49f49fd433b6b47bafe3: Bootstrap starting.
I20260806 09:14:29.325110 13560 tablet_bootstrap.cc:492] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671: Bootstrap starting.
I20260806 09:14:29.325666 13558 tablet_bootstrap.cc:654] T d2db99d5b799474e8ab80e0b4fc71e8c P 6fa3d435c395490899fa88cfa4b4ff6a: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:29.325666 13559 tablet_bootstrap.cc:654] T d2db99d5b799474e8ab80e0b4fc71e8c P 2e3b885b4dcc49f49fd433b6b47bafe3: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:29.326716 13560 tablet_bootstrap.cc:654] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:29.331300 13560 tablet_bootstrap.cc:492] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671: No bootstrap required, opened a new log
I20260806 09:14:29.331498 13560 ts_tablet_manager.cc:1397] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.005s
I20260806 09:14:29.332465 13560 raft_consensus.cc:348] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:29.332768 13560 raft_consensus.cc:374] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:29.332872 13560 raft_consensus.cc:729] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c43409b300a4cb2abf72f8b260a1671, State: Initialized, Role: FOLLOWER
I20260806 09:14:29.333138 13560 consensus_queue.cc:260] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:29.333518 13558 tablet_bootstrap.cc:492] T d2db99d5b799474e8ab80e0b4fc71e8c P 6fa3d435c395490899fa88cfa4b4ff6a: No bootstrap required, opened a new log
I20260806 09:14:29.333693 13558 ts_tablet_manager.cc:1397] T d2db99d5b799474e8ab80e0b4fc71e8c P 6fa3d435c395490899fa88cfa4b4ff6a: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.005s
I20260806 09:14:29.333799 13560 ts_tablet_manager.cc:1428] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 09:14:29.333810 13559 tablet_bootstrap.cc:492] T d2db99d5b799474e8ab80e0b4fc71e8c P 2e3b885b4dcc49f49fd433b6b47bafe3: No bootstrap required, opened a new log
I20260806 09:14:29.333608 13565 tablet_replica.cc:439] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } } }
I20260806 09:14:29.333956 13565 tablet_replica.cc:442] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 09:14:29.333964 13559 ts_tablet_manager.cc:1397] T d2db99d5b799474e8ab80e0b4fc71e8c P 2e3b885b4dcc49f49fd433b6b47bafe3: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.007s
I20260806 09:14:29.334568 13558 raft_consensus.cc:348] T d2db99d5b799474e8ab80e0b4fc71e8c P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:29.334867 13558 raft_consensus.cc:374] T d2db99d5b799474e8ab80e0b4fc71e8c P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:29.334961 13558 raft_consensus.cc:729] T d2db99d5b799474e8ab80e0b4fc71e8c P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fa3d435c395490899fa88cfa4b4ff6a, State: Initialized, Role: FOLLOWER
I20260806 09:14:29.335289 13558 consensus_queue.cc:260] T d2db99d5b799474e8ab80e0b4fc71e8c P 6fa3d435c395490899fa88cfa4b4ff6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:29.336032 13558 ts_tablet_manager.cc:1428] T d2db99d5b799474e8ab80e0b4fc71e8c P 6fa3d435c395490899fa88cfa4b4ff6a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 09:14:29.335913 13564 tablet_replica.cc:439] T d2db99d5b799474e8ab80e0b4fc71e8c P 6fa3d435c395490899fa88cfa4b4ff6a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } } }
I20260806 09:14:29.336338 13564 tablet_replica.cc:442] T d2db99d5b799474e8ab80e0b4fc71e8c P 6fa3d435c395490899fa88cfa4b4ff6a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 09:14:29.334774 13559 raft_consensus.cc:348] T d2db99d5b799474e8ab80e0b4fc71e8c P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:29.336553 13559 raft_consensus.cc:374] T d2db99d5b799474e8ab80e0b4fc71e8c P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:29.336679 13559 raft_consensus.cc:729] T d2db99d5b799474e8ab80e0b4fc71e8c P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e3b885b4dcc49f49fd433b6b47bafe3, State: Initialized, Role: FOLLOWER
I20260806 09:14:29.337785 13559 consensus_queue.cc:260] T d2db99d5b799474e8ab80e0b4fc71e8c P 2e3b885b4dcc49f49fd433b6b47bafe3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:29.339190 13559 ts_tablet_manager.cc:1428] T d2db99d5b799474e8ab80e0b4fc71e8c P 2e3b885b4dcc49f49fd433b6b47bafe3: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s
I20260806 09:14:29.339061 13566 tablet_replica.cc:439] T d2db99d5b799474e8ab80e0b4fc71e8c P 2e3b885b4dcc49f49fd433b6b47bafe3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } } }
I20260806 09:14:29.339519 13566 tablet_replica.cc:442] T d2db99d5b799474e8ab80e0b4fc71e8c P 2e3b885b4dcc49f49fd433b6b47bafe3: This TxnStatusTablet replica's current role is: FOLLOWER
W20260806 09:14:29.392304 13540 tablet.cc:2369] T beddefaf1cf34dd481bf7db01252b35d P 6fa3d435c395490899fa88cfa4b4ff6a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:14:29.429232 13565 raft_consensus.cc:482] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:14:29.429577 13565 raft_consensus.cc:504] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:29.430433 13565 leader_election.cc:288] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e3b885b4dcc49f49fd433b6b47bafe3 (127.10.255.66:37443), 6fa3d435c395490899fa88cfa4b4ff6a (127.10.255.67:38489)
I20260806 09:14:29.431169 13353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2db99d5b799474e8ab80e0b4fc71e8c" candidate_uuid: "3c43409b300a4cb2abf72f8b260a1671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" is_pre_election: true
I20260806 09:14:29.431304 13488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2db99d5b799474e8ab80e0b4fc71e8c" candidate_uuid: "3c43409b300a4cb2abf72f8b260a1671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" is_pre_election: true
I20260806 09:14:29.431531 13353 raft_consensus.cc:2454] T d2db99d5b799474e8ab80e0b4fc71e8c P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c43409b300a4cb2abf72f8b260a1671 in term 0.
I20260806 09:14:29.431589 13488 raft_consensus.cc:2454] T d2db99d5b799474e8ab80e0b4fc71e8c P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c43409b300a4cb2abf72f8b260a1671 in term 0.
I20260806 09:14:29.432175 13137 leader_election.cc:302] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e3b885b4dcc49f49fd433b6b47bafe3, 3c43409b300a4cb2abf72f8b260a1671; no voters:
I20260806 09:14:29.432580 13565 raft_consensus.cc:2781] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:14:29.432706 13565 raft_consensus.cc:482] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:14:29.432891 13565 raft_consensus.cc:3037] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:29.435379 13565 raft_consensus.cc:504] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:29.436194 13565 leader_election.cc:288] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671 [CANDIDATE]: Term 1 election: Requested vote from peers 2e3b885b4dcc49f49fd433b6b47bafe3 (127.10.255.66:37443), 6fa3d435c395490899fa88cfa4b4ff6a (127.10.255.67:38489)
I20260806 09:14:29.436882 13353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2db99d5b799474e8ab80e0b4fc71e8c" candidate_uuid: "3c43409b300a4cb2abf72f8b260a1671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3"
I20260806 09:14:29.436882 13488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d2db99d5b799474e8ab80e0b4fc71e8c" candidate_uuid: "3c43409b300a4cb2abf72f8b260a1671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fa3d435c395490899fa88cfa4b4ff6a"
I20260806 09:14:29.437165 13488 raft_consensus.cc:3037] T d2db99d5b799474e8ab80e0b4fc71e8c P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:29.437165 13353 raft_consensus.cc:3037] T d2db99d5b799474e8ab80e0b4fc71e8c P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:29.440366 13353 raft_consensus.cc:2454] T d2db99d5b799474e8ab80e0b4fc71e8c P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c43409b300a4cb2abf72f8b260a1671 in term 1.
I20260806 09:14:29.440366 13488 raft_consensus.cc:2454] T d2db99d5b799474e8ab80e0b4fc71e8c P 6fa3d435c395490899fa88cfa4b4ff6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c43409b300a4cb2abf72f8b260a1671 in term 1.
I20260806 09:14:29.441004 13135 leader_election.cc:302] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2e3b885b4dcc49f49fd433b6b47bafe3, 3c43409b300a4cb2abf72f8b260a1671, 6fa3d435c395490899fa88cfa4b4ff6a; no voters:
I20260806 09:14:29.441435 13565 raft_consensus.cc:2781] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:14:29.441705 13565 raft_consensus.cc:686] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671 [term 1 LEADER]: Becoming Leader. State: Replica: 3c43409b300a4cb2abf72f8b260a1671, State: Running, Role: LEADER
I20260806 09:14:29.441995 13565 consensus_queue.cc:237] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:29.443920 13569 tablet_replica.cc:439] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671: TxnStatusTablet state changed. Reason: New leader 3c43409b300a4cb2abf72f8b260a1671. Latest consensus state: current_term: 1 leader_uuid: "3c43409b300a4cb2abf72f8b260a1671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } } }
I20260806 09:14:29.444300 13569 tablet_replica.cc:442] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671: This TxnStatusTablet replica's current role is: LEADER
I20260806 09:14:29.445220 13582 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 09:14:29.445537 13582 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 09:14:29.445712 13046 catalog_manager.cc:5495] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c43409b300a4cb2abf72f8b260a1671 (127.10.255.65). New cstate: current_term: 1 leader_uuid: "3c43409b300a4cb2abf72f8b260a1671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } health_report { overall_health: UNKNOWN } } }
I20260806 09:14:29.488413 13556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.482236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42938 (local address 127.10.255.65:40711)
0806 09:14:29.482426 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:29.482432 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:29.482652 (+ 220us) server_negotiation.cc:407] Connection header received
0806 09:14:29.483000 (+ 348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:29.483004 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:29.483100 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:29.483264 (+ 164us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:14:29.483713 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.484561 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.485924 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.486375 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.486520 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.487080 (+ 560us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:14:29.487680 (+ 600us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:14:29.487880 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:29.487983 (+ 103us) server_negotiation.cc:299] Negotiation successful
0806 09:14:29.488080 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 09:14:29.488448 13576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.482252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:40711 (local address 127.0.0.1:42938)
0806 09:14:29.482555 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:29.482572 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:29.482752 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:29.483308 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:29.483313 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:29.483328 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 09:14:29.483536 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:29.483585 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.484730 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.484738 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:29.485771 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:29.485783 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.486554 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.486560 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:29.486764 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.486833 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 09:14:29.487804 (+ 971us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 09:14:29.487871 (+ 67us) client_negotiation.cc:769] Sending connection context
0806 09:14:29.487961 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 09:14:29.488132 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96}
I20260806 09:14:29.498006 13353 raft_consensus.cc:1261] T d2db99d5b799474e8ab80e0b4fc71e8c P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 1 FOLLOWER]: Refusing update from remote peer 3c43409b300a4cb2abf72f8b260a1671: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:14:29.498144 13488 raft_consensus.cc:1261] T d2db99d5b799474e8ab80e0b4fc71e8c P 6fa3d435c395490899fa88cfa4b4ff6a [term 1 FOLLOWER]: Refusing update from remote peer 3c43409b300a4cb2abf72f8b260a1671: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:14:29.499315 13565 consensus_queue.cc:1035] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:14:29.499823 13569 consensus_queue.cc:1035] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:14:29.513370 13566 tablet_replica.cc:439] T d2db99d5b799474e8ab80e0b4fc71e8c P 2e3b885b4dcc49f49fd433b6b47bafe3: TxnStatusTablet state changed. Reason: New leader 3c43409b300a4cb2abf72f8b260a1671. Latest consensus state: current_term: 1 leader_uuid: "3c43409b300a4cb2abf72f8b260a1671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } } }
I20260806 09:14:29.513721 13566 tablet_replica.cc:442] T d2db99d5b799474e8ab80e0b4fc71e8c P 2e3b885b4dcc49f49fd433b6b47bafe3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 09:14:29.516187 13586 mvcc.cc:205] Tried to move back new op lower bound from 7315487414253101056 to 7315487414037204992. Current Snapshot: MvccSnapshot[applied={T|T < 7315487414253101056}]
I20260806 09:14:29.517239 13564 tablet_replica.cc:439] T d2db99d5b799474e8ab80e0b4fc71e8c P 6fa3d435c395490899fa88cfa4b4ff6a: TxnStatusTablet state changed. Reason: New leader 3c43409b300a4cb2abf72f8b260a1671. Latest consensus state: current_term: 1 leader_uuid: "3c43409b300a4cb2abf72f8b260a1671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } } }
I20260806 09:14:29.517534 13564 tablet_replica.cc:442] T d2db99d5b799474e8ab80e0b4fc71e8c P 6fa3d435c395490899fa88cfa4b4ff6a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 09:14:29.523275 13587 mvcc.cc:205] Tried to move back new op lower bound from 7315487414253101056 to 7315487414037204992. Current Snapshot: MvccSnapshot[applied={T|T < 7315487414253101056}]
I20260806 09:14:29.533672 13564 tablet_replica.cc:439] T d2db99d5b799474e8ab80e0b4fc71e8c P 6fa3d435c395490899fa88cfa4b4ff6a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3c43409b300a4cb2abf72f8b260a1671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } } }
I20260806 09:14:29.534004 13564 tablet_replica.cc:442] T d2db99d5b799474e8ab80e0b4fc71e8c P 6fa3d435c395490899fa88cfa4b4ff6a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 09:14:29.540493 13565 tablet_replica.cc:439] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3c43409b300a4cb2abf72f8b260a1671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } } }
I20260806 09:14:29.540982 13565 tablet_replica.cc:442] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671: This TxnStatusTablet replica's current role is: LEADER
I20260806 09:14:29.541319 13565 tablet_replica.cc:439] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3c43409b300a4cb2abf72f8b260a1671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } } }
I20260806 09:14:29.541697 13565 tablet_replica.cc:442] T d2db99d5b799474e8ab80e0b4fc71e8c P 3c43409b300a4cb2abf72f8b260a1671: This TxnStatusTablet replica's current role is: LEADER
I20260806 09:14:29.553009 13566 tablet_replica.cc:439] T d2db99d5b799474e8ab80e0b4fc71e8c P 2e3b885b4dcc49f49fd433b6b47bafe3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3c43409b300a4cb2abf72f8b260a1671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } } }
I20260806 09:14:29.553325 13566 tablet_replica.cc:442] T d2db99d5b799474e8ab80e0b4fc71e8c P 2e3b885b4dcc49f49fd433b6b47bafe3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 09:14:29.567051 13556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.560093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42944 (local address 127.10.255.65:40711)
0806 09:14:29.560278 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:29.560285 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:29.560443 (+ 158us) server_negotiation.cc:407] Connection header received
0806 09:14:29.560751 (+ 308us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:29.560757 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:29.560867 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:29.560976 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:14:29.561526 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.562773 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.564892 (+ 2119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.565588 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.565738 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.566190 (+ 452us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:14:29.566365 (+ 175us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:14:29.566468 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:29.566620 (+ 152us) server_negotiation.cc:299] Negotiation successful
0806 09:14:29.566714 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 09:14:29.587600 13556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.580278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:54883 (local address 127.10.255.65:40711)
0806 09:14:29.580481 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:29.580488 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:29.581255 (+ 767us) server_negotiation.cc:407] Connection header received
0806 09:14:29.581505 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:29.581510 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:29.581586 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:29.581683 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:14:29.582250 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.583049 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.584778 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.585817 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.586090 (+ 273us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.586685 (+ 595us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:14:29.586817 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:14:29.586925 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:29.587093 (+ 168us) server_negotiation.cc:299] Negotiation successful
0806 09:14:29.587204 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":64}
I20260806 09:14:29.587742 13598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.580331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:40711 (local address 127.10.255.65:54883)
0806 09:14:29.581140 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:29.581158 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:29.581353 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:29.581696 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:29.581700 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:29.581710 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 09:14:29.582098 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:29.582108 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.583200 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.583206 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:29.584597 (+ 1391us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:29.584613 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.586196 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.586202 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:29.586350 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.586429 (+ 79us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 09:14:29.586926 (+ 497us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 09:14:29.586939 (+ 13us) client_negotiation.cc:769] Sending connection context
0806 09:14:29.587071 (+ 132us) client_negotiation.cc:240] Negotiation successful
0806 09:14:29.587283 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"mutex_wait_us":48,"thread_start_us":450,"threads_started":1}
I20260806 09:14:29.600484 13353 raft_consensus.cc:1261] T beddefaf1cf34dd481bf7db01252b35d P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 1 FOLLOWER]: Refusing update from remote peer 3c43409b300a4cb2abf72f8b260a1671: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:14:29.600639 13487 raft_consensus.cc:1261] T beddefaf1cf34dd481bf7db01252b35d P 6fa3d435c395490899fa88cfa4b4ff6a [term 1 FOLLOWER]: Refusing update from remote peer 3c43409b300a4cb2abf72f8b260a1671: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:14:29.601217 13599 consensus_queue.cc:1035] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:14:29.601637 13565 consensus_queue.cc:1035] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:14:29.691298 13045 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:14:29.691671 13045 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:14:29.699108 13045 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79: Sending DeleteTablet for 3 replicas of tablet beddefaf1cf34dd481bf7db01252b35d
I20260806 09:14:29.700560 13185 tablet_service.cc:1514] Processing DeleteTablet for tablet beddefaf1cf34dd481bf7db01252b35d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:14:29 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:42926
I20260806 09:14:29.700573 13468 tablet_service.cc:1514] Processing DeleteTablet for tablet beddefaf1cf34dd481bf7db01252b35d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:14:29 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:42798
I20260806 09:14:29.702927 13329 tablet_service.cc:1514] Processing DeleteTablet for tablet beddefaf1cf34dd481bf7db01252b35d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:14:29 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:58378
I20260806 09:14:29.704921 13045 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38760:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:14:29.705960 13045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:14:29.713258 13606 tablet_replica.cc:330] T beddefaf1cf34dd481bf7db01252b35d P 6fa3d435c395490899fa88cfa4b4ff6a: stopping tablet replica
I20260806 09:14:29.714082 13606 raft_consensus.cc:2229] T beddefaf1cf34dd481bf7db01252b35d P 6fa3d435c395490899fa88cfa4b4ff6a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:14:29.714692 13606 raft_consensus.cc:2258] T beddefaf1cf34dd481bf7db01252b35d P 6fa3d435c395490899fa88cfa4b4ff6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:14:29.720497 13468 tablet_service.cc:1467] Processing CreateTablet for tablet 06d8a305ff8b412fa1f3887b85945663 (DEFAULT_TABLE table=test-table [id=fc92174f3e644e338b454c3f555c4a1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:29.720532 13327 tablet_service.cc:1467] Processing CreateTablet for tablet 06d8a305ff8b412fa1f3887b85945663 (DEFAULT_TABLE table=test-table [id=fc92174f3e644e338b454c3f555c4a1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:29.721083 13327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06d8a305ff8b412fa1f3887b85945663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:29.721001 13184 tablet_service.cc:1467] Processing CreateTablet for tablet 06d8a305ff8b412fa1f3887b85945663 (DEFAULT_TABLE table=test-table [id=fc92174f3e644e338b454c3f555c4a1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:29.721290 13468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06d8a305ff8b412fa1f3887b85945663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:29.721540 13184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 06d8a305ff8b412fa1f3887b85945663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:29.728724 13558 tablet_bootstrap.cc:492] T 06d8a305ff8b412fa1f3887b85945663 P 6fa3d435c395490899fa88cfa4b4ff6a: Bootstrap starting.
I20260806 09:14:29.730391 13560 tablet_bootstrap.cc:492] T 06d8a305ff8b412fa1f3887b85945663 P 3c43409b300a4cb2abf72f8b260a1671: Bootstrap starting.
I20260806 09:14:29.730436 13558 tablet_bootstrap.cc:654] T 06d8a305ff8b412fa1f3887b85945663 P 6fa3d435c395490899fa88cfa4b4ff6a: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:29.731133 13606 ts_tablet_manager.cc:1905] T beddefaf1cf34dd481bf7db01252b35d P 6fa3d435c395490899fa88cfa4b4ff6a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:14:29.732614 13560 tablet_bootstrap.cc:654] T 06d8a305ff8b412fa1f3887b85945663 P 3c43409b300a4cb2abf72f8b260a1671: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:29.735282 13559 tablet_bootstrap.cc:492] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3: Bootstrap starting.
I20260806 09:14:29.737947 13559 tablet_bootstrap.cc:654] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:29.743625 13607 tablet_replica.cc:330] T beddefaf1cf34dd481bf7db01252b35d P 2e3b885b4dcc49f49fd433b6b47bafe3: stopping tablet replica
I20260806 09:14:29.744288 13607 raft_consensus.cc:2229] T beddefaf1cf34dd481bf7db01252b35d P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:14:29.744793 13607 raft_consensus.cc:2258] T beddefaf1cf34dd481bf7db01252b35d P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:14:29.746876 13558 tablet_bootstrap.cc:492] T 06d8a305ff8b412fa1f3887b85945663 P 6fa3d435c395490899fa88cfa4b4ff6a: No bootstrap required, opened a new log
I20260806 09:14:29.747233 13558 ts_tablet_manager.cc:1397] T 06d8a305ff8b412fa1f3887b85945663 P 6fa3d435c395490899fa88cfa4b4ff6a: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.005s
I20260806 09:14:29.748404 13558 raft_consensus.cc:348] T 06d8a305ff8b412fa1f3887b85945663 P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:29.748773 13558 raft_consensus.cc:374] T 06d8a305ff8b412fa1f3887b85945663 P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:29.748860 13558 raft_consensus.cc:729] T 06d8a305ff8b412fa1f3887b85945663 P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fa3d435c395490899fa88cfa4b4ff6a, State: Initialized, Role: FOLLOWER
I20260806 09:14:29.749197 13558 consensus_queue.cc:260] T 06d8a305ff8b412fa1f3887b85945663 P 6fa3d435c395490899fa88cfa4b4ff6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:29.749917 13558 ts_tablet_manager.cc:1428] T 06d8a305ff8b412fa1f3887b85945663 P 6fa3d435c395490899fa88cfa4b4ff6a: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260806 09:14:29.752169 13607 ts_tablet_manager.cc:1905] T beddefaf1cf34dd481bf7db01252b35d P 2e3b885b4dcc49f49fd433b6b47bafe3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:14:29.756057 13606 ts_tablet_manager.cc:1918] T beddefaf1cf34dd481bf7db01252b35d P 6fa3d435c395490899fa88cfa4b4ff6a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 09:14:29.756291 13606 log.cc:1196] T beddefaf1cf34dd481bf7db01252b35d P 6fa3d435c395490899fa88cfa4b4ff6a: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/beddefaf1cf34dd481bf7db01252b35d
I20260806 09:14:29.757134 13559 tablet_bootstrap.cc:492] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3: No bootstrap required, opened a new log
I20260806 09:14:29.757306 13605 tablet_replica.cc:330] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671: stopping tablet replica
I20260806 09:14:29.757515 13559 ts_tablet_manager.cc:1397] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3: Time spent bootstrapping tablet: real 0.022s user 0.005s sys 0.004s
I20260806 09:14:29.757848 13605 raft_consensus.cc:2229] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671 [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:14:29.758553 13559 raft_consensus.cc:348] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:29.758783 13606 ts_tablet_manager.cc:1939] T beddefaf1cf34dd481bf7db01252b35d P 6fa3d435c395490899fa88cfa4b4ff6a: Deleting consensus metadata
I20260806 09:14:29.758944 13559 raft_consensus.cc:374] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:29.759088 13559 raft_consensus.cc:729] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e3b885b4dcc49f49fd433b6b47bafe3, State: Initialized, Role: FOLLOWER
I20260806 09:14:29.759236 13605 raft_consensus.cc:2258] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:14:29.759531 13559 consensus_queue.cc:260] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:29.761276 13031 catalog_manager.cc:4841] TS 6fa3d435c395490899fa88cfa4b4ff6a (127.10.255.67:38489): tablet beddefaf1cf34dd481bf7db01252b35d (table test-table [id=0341e52f42af4ac2bd0e581f86872b6f]) successfully deleted
I20260806 09:14:29.762640 13559 ts_tablet_manager.cc:1428] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260806 09:14:29.763320 13605 ts_tablet_manager.cc:1905] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:14:29.765607 13607 ts_tablet_manager.cc:1918] T beddefaf1cf34dd481bf7db01252b35d P 2e3b885b4dcc49f49fd433b6b47bafe3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 09:14:29.765810 13607 log.cc:1196] T beddefaf1cf34dd481bf7db01252b35d P 2e3b885b4dcc49f49fd433b6b47bafe3: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/beddefaf1cf34dd481bf7db01252b35d
I20260806 09:14:29.766388 13607 ts_tablet_manager.cc:1939] T beddefaf1cf34dd481bf7db01252b35d P 2e3b885b4dcc49f49fd433b6b47bafe3: Deleting consensus metadata
I20260806 09:14:29.768318 13560 tablet_bootstrap.cc:492] T 06d8a305ff8b412fa1f3887b85945663 P 3c43409b300a4cb2abf72f8b260a1671: No bootstrap required, opened a new log
I20260806 09:14:29.768242 13032 catalog_manager.cc:4841] TS 2e3b885b4dcc49f49fd433b6b47bafe3 (127.10.255.66:37443): tablet beddefaf1cf34dd481bf7db01252b35d (table test-table [id=0341e52f42af4ac2bd0e581f86872b6f]) successfully deleted
I20260806 09:14:29.768631 13560 ts_tablet_manager.cc:1397] T 06d8a305ff8b412fa1f3887b85945663 P 3c43409b300a4cb2abf72f8b260a1671: Time spent bootstrapping tablet: real 0.038s user 0.004s sys 0.007s
I20260806 09:14:29.769402 13560 raft_consensus.cc:348] T 06d8a305ff8b412fa1f3887b85945663 P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:29.769675 13560 raft_consensus.cc:374] T 06d8a305ff8b412fa1f3887b85945663 P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:29.769800 13560 raft_consensus.cc:729] T 06d8a305ff8b412fa1f3887b85945663 P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c43409b300a4cb2abf72f8b260a1671, State: Initialized, Role: FOLLOWER
I20260806 09:14:29.770115 13560 consensus_queue.cc:260] T 06d8a305ff8b412fa1f3887b85945663 P 3c43409b300a4cb2abf72f8b260a1671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:29.770798 13560 ts_tablet_manager.cc:1428] T 06d8a305ff8b412fa1f3887b85945663 P 3c43409b300a4cb2abf72f8b260a1671: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260806 09:14:29.774680 13605 ts_tablet_manager.cc:1918] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 09:14:29.774922 13605 log.cc:1196] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-0/wal/wals/beddefaf1cf34dd481bf7db01252b35d
I20260806 09:14:29.775697 13605 ts_tablet_manager.cc:1939] T beddefaf1cf34dd481bf7db01252b35d P 3c43409b300a4cb2abf72f8b260a1671: Deleting consensus metadata
I20260806 09:14:29.777926 13030 catalog_manager.cc:4841] TS 3c43409b300a4cb2abf72f8b260a1671 (127.10.255.65:40711): tablet beddefaf1cf34dd481bf7db01252b35d (table test-table [id=0341e52f42af4ac2bd0e581f86872b6f]) successfully deleted
I20260806 09:14:29.822993 13566 raft_consensus.cc:482] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:14:29.823278 13566 raft_consensus.cc:504] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:29.825470 13566 leader_election.cc:288] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c43409b300a4cb2abf72f8b260a1671 (127.10.255.65:40711), 6fa3d435c395490899fa88cfa4b4ff6a (127.10.255.67:38489)
I20260806 09:14:29.843573 13556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.826001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:33297 (local address 127.10.255.65:40711)
0806 09:14:29.826232 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:29.826239 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:29.836988 (+ 10749us) server_negotiation.cc:407] Connection header received
0806 09:14:29.837379 (+ 391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:29.837388 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:29.837477 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:29.837545 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:29.838646 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.839411 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.841548 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.842412 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.842631 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.842738 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:29.843064 (+ 326us) server_negotiation.cc:299] Negotiation successful
0806 09:14:29.843237 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260806 09:14:29.843606 13613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.825793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:40711 (local address 127.10.255.66:33297)
0806 09:14:29.836840 (+ 11047us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:29.836870 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:29.837154 (+ 284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:29.837776 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:29.837783 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:29.837816 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:29.838467 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:29.838480 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.839587 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.839595 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:29.841360 (+ 1765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:29.841376 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.842624 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.842633 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:29.842822 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.842861 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 09:14:29.842972 (+ 111us) client_negotiation.cc:240] Negotiation successful
0806 09:14:29.843156 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10283,"mutex_wait_us":33,"spinlock_wait_cycles":9984,"thread_start_us":12153,"threads_started":1}
I20260806 09:14:29.845388 13612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.825926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:38489 (local address 127.10.255.66:48319)
0806 09:14:29.837145 (+ 11219us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:29.837163 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:29.837336 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:29.837853 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:29.837858 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:29.837886 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:29.838360 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:29.838385 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.840147 (+ 1762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.840155 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:29.842679 (+ 2524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:29.842702 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.844423 (+ 1721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.844429 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:29.844601 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.844627 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 09:14:29.844749 (+ 122us) client_negotiation.cc:240] Negotiation successful
0806 09:14:29.844894 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11071,"mutex_wait_us":26,"thread_start_us":10014,"threads_started":1}
I20260806 09:14:29.845444 13614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.826572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:48319 (local address 127.10.255.67:38489)
0806 09:14:29.836633 (+ 10061us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:29.836642 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:29.837244 (+ 602us) server_negotiation.cc:407] Connection header received
0806 09:14:29.837490 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:29.837495 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:29.837592 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:29.837659 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:29.838611 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.839900 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.842885 (+ 2985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.844199 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.844395 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.844474 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:29.844847 (+ 373us) server_negotiation.cc:299] Negotiation successful
0806 09:14:29.845029 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9876,"thread_start_us":9764,"threads_started":1}
I20260806 09:14:29.845481 13205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06d8a305ff8b412fa1f3887b85945663" candidate_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c43409b300a4cb2abf72f8b260a1671" is_pre_election: true
I20260806 09:14:29.846081 13205 raft_consensus.cc:2454] T 06d8a305ff8b412fa1f3887b85945663 P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e3b885b4dcc49f49fd433b6b47bafe3 in term 0.
I20260806 09:14:29.846480 13487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06d8a305ff8b412fa1f3887b85945663" candidate_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" is_pre_election: true
I20260806 09:14:29.846830 13277 leader_election.cc:302] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e3b885b4dcc49f49fd433b6b47bafe3, 3c43409b300a4cb2abf72f8b260a1671; no voters:
I20260806 09:14:29.846896 13487 raft_consensus.cc:2454] T 06d8a305ff8b412fa1f3887b85945663 P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e3b885b4dcc49f49fd433b6b47bafe3 in term 0.
I20260806 09:14:29.847316 13566 raft_consensus.cc:2781] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:14:29.847465 13566 raft_consensus.cc:482] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:14:29.847568 13566 raft_consensus.cc:3037] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:29.849848 13566 raft_consensus.cc:504] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:29.850556 13566 leader_election.cc:288] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3 [CANDIDATE]: Term 1 election: Requested vote from peers 3c43409b300a4cb2abf72f8b260a1671 (127.10.255.65:40711), 6fa3d435c395490899fa88cfa4b4ff6a (127.10.255.67:38489)
I20260806 09:14:29.851109 13205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06d8a305ff8b412fa1f3887b85945663" candidate_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c43409b300a4cb2abf72f8b260a1671"
I20260806 09:14:29.851208 13487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "06d8a305ff8b412fa1f3887b85945663" candidate_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fa3d435c395490899fa88cfa4b4ff6a"
I20260806 09:14:29.851374 13205 raft_consensus.cc:3037] T 06d8a305ff8b412fa1f3887b85945663 P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:29.851447 13487 raft_consensus.cc:3037] T 06d8a305ff8b412fa1f3887b85945663 P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:29.854723 13487 raft_consensus.cc:2454] T 06d8a305ff8b412fa1f3887b85945663 P 6fa3d435c395490899fa88cfa4b4ff6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e3b885b4dcc49f49fd433b6b47bafe3 in term 1.
I20260806 09:14:29.855129 13205 raft_consensus.cc:2454] T 06d8a305ff8b412fa1f3887b85945663 P 3c43409b300a4cb2abf72f8b260a1671 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e3b885b4dcc49f49fd433b6b47bafe3 in term 1.
I20260806 09:14:29.855347 13278 leader_election.cc:302] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e3b885b4dcc49f49fd433b6b47bafe3, 6fa3d435c395490899fa88cfa4b4ff6a; no voters:
I20260806 09:14:29.855754 13566 raft_consensus.cc:2781] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:14:29.856338 13566 raft_consensus.cc:686] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 1 LEADER]: Becoming Leader. State: Replica: 2e3b885b4dcc49f49fd433b6b47bafe3, State: Running, Role: LEADER
I20260806 09:14:29.856820 13566 consensus_queue.cc:237] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:29.862066 13046 catalog_manager.cc:5495] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e3b885b4dcc49f49fd433b6b47bafe3 (127.10.255.66). New cstate: current_term: 1 leader_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } health_report { overall_health: UNKNOWN } } }
I20260806 09:14:29.931185 13617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.912501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58394 (local address 127.10.255.66:37443)
0806 09:14:29.922417 (+ 9916us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:29.922424 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:29.922465 (+ 41us) server_negotiation.cc:407] Connection header received
0806 09:14:29.922607 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:29.922613 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:29.922750 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:29.924072 (+ 1322us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:14:29.924414 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.925628 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.927696 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.928496 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.928644 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.929247 (+ 603us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:14:29.930144 (+ 897us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:14:29.930309 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:29.930451 (+ 142us) server_negotiation.cc:299] Negotiation successful
0806 09:14:29.930559 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9704,"thread_start_us":9520,"threads_started":1}
I20260806 09:14:29.955016 13556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.944570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:34967 (local address 127.10.255.65:40711)
0806 09:14:29.944784 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:29.944791 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:29.947469 (+ 2678us) server_negotiation.cc:407] Connection header received
0806 09:14:29.947742 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:29.947748 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:29.947896 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:29.947997 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:14:29.948789 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.949980 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.952410 (+ 2430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.953201 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.953457 (+ 256us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.954069 (+ 612us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:14:29.954268 (+ 199us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:14:29.954362 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:29.954558 (+ 196us) server_negotiation.cc:299] Negotiation successful
0806 09:14:29.954700 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 09:14:29.955381 13620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:29.944587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:40711 (local address 127.10.255.66:34967)
0806 09:14:29.947320 (+ 2733us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:29.947344 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:29.947540 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:29.948191 (+ 651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:29.948197 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:29.948211 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 09:14:29.948582 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:29.948593 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.950190 (+ 1597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.950198 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:29.952116 (+ 1918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:29.952141 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:29.953517 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:29.953531 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:29.953741 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:29.953843 (+ 102us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 09:14:29.954394 (+ 551us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 09:14:29.954408 (+ 14us) client_negotiation.cc:769] Sending connection context
0806 09:14:29.954510 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 09:14:29.954739 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2512,"thread_start_us":2286,"threads_started":1}
I20260806 09:14:29.966564 13487 raft_consensus.cc:1261] T 06d8a305ff8b412fa1f3887b85945663 P 6fa3d435c395490899fa88cfa4b4ff6a [term 1 FOLLOWER]: Refusing update from remote peer 2e3b885b4dcc49f49fd433b6b47bafe3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:14:29.966730 13205 raft_consensus.cc:1261] T 06d8a305ff8b412fa1f3887b85945663 P 3c43409b300a4cb2abf72f8b260a1671 [term 1 FOLLOWER]: Refusing update from remote peer 2e3b885b4dcc49f49fd433b6b47bafe3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:14:29.967571 13615 consensus_queue.cc:1035] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:14:29.968024 13566 consensus_queue.cc:1035] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:14:29.978116 13589 mvcc.cc:205] Tried to move back new op lower bound from 7315487416176029696 to 7315487415738961920. Current Snapshot: MvccSnapshot[applied={T|T < 7315487416176029696}]
I20260806 09:14:30.008739 13617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:30.001419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:36441 (local address 127.10.255.66:37443)
0806 09:14:30.001626 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:30.001632 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:30.001651 (+ 19us) server_negotiation.cc:407] Connection header received
0806 09:14:30.001720 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:30.001725 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:30.001811 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:30.001910 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:14:30.002420 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:30.003507 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:30.006073 (+ 2566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:30.006531 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:30.006649 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:30.007278 (+ 629us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:14:30.007437 (+ 159us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:14:30.007798 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:30.008218 (+ 420us) server_negotiation.cc:299] Negotiation successful
0806 09:14:30.008332 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 09:14:30.009132 13598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:30.000741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:37443 (local address 127.10.255.65:36441)
0806 09:14:30.001105 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:30.001125 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:30.001234 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:30.001980 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:30.001984 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:30.001995 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 09:14:30.002252 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:30.002266 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:30.003708 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:30.003715 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:30.005803 (+ 2088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:30.005825 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:30.006724 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:30.006730 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:30.006923 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:30.006980 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 09:14:30.008026 (+ 1046us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 09:14:30.008047 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 09:14:30.008166 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 09:14:30.008347 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194}
W20260806 09:14:30.010608 13589 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 09:14:31.637023 13045 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:14:31.637293 13045 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38760:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:14:31.642110 13045 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79: Sending DeleteTablet for 3 replicas of tablet 06d8a305ff8b412fa1f3887b85945663
I20260806 09:14:31.643280 13185 tablet_service.cc:1514] Processing DeleteTablet for tablet 06d8a305ff8b412fa1f3887b85945663 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:14:31 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:42926
I20260806 09:14:31.643281 13468 tablet_service.cc:1514] Processing DeleteTablet for tablet 06d8a305ff8b412fa1f3887b85945663 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:14:31 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:42798
I20260806 09:14:31.643301 13329 tablet_service.cc:1514] Processing DeleteTablet for tablet 06d8a305ff8b412fa1f3887b85945663 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:14:31 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:58378
I20260806 09:14:31.656352 13650 tablet_replica.cc:330] T 06d8a305ff8b412fa1f3887b85945663 P 6fa3d435c395490899fa88cfa4b4ff6a: stopping tablet replica
I20260806 09:14:31.656827 13650 raft_consensus.cc:2229] T 06d8a305ff8b412fa1f3887b85945663 P 6fa3d435c395490899fa88cfa4b4ff6a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:14:31.657287 13650 raft_consensus.cc:2258] T 06d8a305ff8b412fa1f3887b85945663 P 6fa3d435c395490899fa88cfa4b4ff6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:14:31.658103 13651 tablet_replica.cc:330] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3: stopping tablet replica
I20260806 09:14:31.658931 13649 tablet_replica.cc:330] T 06d8a305ff8b412fa1f3887b85945663 P 3c43409b300a4cb2abf72f8b260a1671: stopping tablet replica
I20260806 09:14:31.659158 13649 raft_consensus.cc:2229] T 06d8a305ff8b412fa1f3887b85945663 P 3c43409b300a4cb2abf72f8b260a1671 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:14:31.659168 13650 ts_tablet_manager.cc:1905] T 06d8a305ff8b412fa1f3887b85945663 P 6fa3d435c395490899fa88cfa4b4ff6a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:14:31.659449 13649 raft_consensus.cc:2258] T 06d8a305ff8b412fa1f3887b85945663 P 3c43409b300a4cb2abf72f8b260a1671 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:14:31.659725 13651 raft_consensus.cc:2229] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:14:31.660471 13651 raft_consensus.cc:2258] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:14:31.660989 13649 ts_tablet_manager.cc:1905] T 06d8a305ff8b412fa1f3887b85945663 P 3c43409b300a4cb2abf72f8b260a1671: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:14:31.662537 13651 ts_tablet_manager.cc:1905] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:14:31.667977 13650 ts_tablet_manager.cc:1918] T 06d8a305ff8b412fa1f3887b85945663 P 6fa3d435c395490899fa88cfa4b4ff6a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 09:14:31.668155 13650 log.cc:1196] T 06d8a305ff8b412fa1f3887b85945663 P 6fa3d435c395490899fa88cfa4b4ff6a: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/06d8a305ff8b412fa1f3887b85945663
I20260806 09:14:31.668646 13650 ts_tablet_manager.cc:1939] T 06d8a305ff8b412fa1f3887b85945663 P 6fa3d435c395490899fa88cfa4b4ff6a: Deleting consensus metadata
I20260806 09:14:31.668942 13649 ts_tablet_manager.cc:1918] T 06d8a305ff8b412fa1f3887b85945663 P 3c43409b300a4cb2abf72f8b260a1671: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 09:14:31.669126 13649 log.cc:1196] T 06d8a305ff8b412fa1f3887b85945663 P 3c43409b300a4cb2abf72f8b260a1671: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-0/wal/wals/06d8a305ff8b412fa1f3887b85945663
I20260806 09:14:31.669764 13649 ts_tablet_manager.cc:1939] T 06d8a305ff8b412fa1f3887b85945663 P 3c43409b300a4cb2abf72f8b260a1671: Deleting consensus metadata
I20260806 09:14:31.670348 13031 catalog_manager.cc:4841] TS 6fa3d435c395490899fa88cfa4b4ff6a (127.10.255.67:38489): tablet 06d8a305ff8b412fa1f3887b85945663 (table test-table [id=fc92174f3e644e338b454c3f555c4a1a]) successfully deleted
I20260806 09:14:31.671077 13030 catalog_manager.cc:4841] TS 3c43409b300a4cb2abf72f8b260a1671 (127.10.255.65:40711): tablet 06d8a305ff8b412fa1f3887b85945663 (table test-table [id=fc92174f3e644e338b454c3f555c4a1a]) successfully deleted
I20260806 09:14:31.671517 13651 ts_tablet_manager.cc:1918] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 09:14:31.671705 13651 log.cc:1196] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/06d8a305ff8b412fa1f3887b85945663
I20260806 09:14:31.672219 13651 ts_tablet_manager.cc:1939] T 06d8a305ff8b412fa1f3887b85945663 P 2e3b885b4dcc49f49fd433b6b47bafe3: Deleting consensus metadata
I20260806 09:14:31.673419 13032 catalog_manager.cc:4841] TS 2e3b885b4dcc49f49fd433b6b47bafe3 (127.10.255.66:37443): tablet 06d8a305ff8b412fa1f3887b85945663 (table test-table [id=fc92174f3e644e338b454c3f555c4a1a]) successfully deleted
Aug 06 09:14:31 dist-test-slave-mvvj krb5kdc[13001](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007671, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 09:14:31 dist-test-slave-mvvj krb5kdc[13001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007671, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:31.722992 13659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:31.697899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38780 (local address 127.10.255.126:45321)
0806 09:14:31.698664 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:31.698671 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:31.698700 (+ 29us) server_negotiation.cc:407] Connection header received
0806 09:14:31.698888 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:31.698893 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:31.698966 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:31.699093 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:31.700628 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:31.701470 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:31.702790 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:31.703249 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:31.703416 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:31.716187 (+ 12771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:31.716194 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:31.716198 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:31.716247 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:31.719478 (+ 3231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:31.720612 (+ 1134us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:31.720626 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:31.720630 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:31.720804 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:31.721301 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:31.721306 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:31.721308 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:31.721623 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:31.721915 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:31.722263 (+ 348us) server_negotiation.cc:299] Negotiation successful
0806 09:14:31.722550 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":613,"thread_start_us":419,"threads_started":1}
I20260806 09:14:31.727767 13045 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38780:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:14:31.728533 13045 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:14:31.737216 13185 tablet_service.cc:1467] Processing CreateTablet for tablet d0903b733d624ed6b061cd5fc34b2a66 (DEFAULT_TABLE table=test-table [id=60cd885a73fd450da9e694bd3d577f0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:31.737571 13329 tablet_service.cc:1467] Processing CreateTablet for tablet d0903b733d624ed6b061cd5fc34b2a66 (DEFAULT_TABLE table=test-table [id=60cd885a73fd450da9e694bd3d577f0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:31.737954 13185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0903b733d624ed6b061cd5fc34b2a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:31.737848 13468 tablet_service.cc:1467] Processing CreateTablet for tablet d0903b733d624ed6b061cd5fc34b2a66 (DEFAULT_TABLE table=test-table [id=60cd885a73fd450da9e694bd3d577f0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:31.738209 13329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0903b733d624ed6b061cd5fc34b2a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:31.738487 13468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d0903b733d624ed6b061cd5fc34b2a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:31.744433 13660 tablet_bootstrap.cc:492] T d0903b733d624ed6b061cd5fc34b2a66 P 3c43409b300a4cb2abf72f8b260a1671: Bootstrap starting.
I20260806 09:14:31.746734 13660 tablet_bootstrap.cc:654] T d0903b733d624ed6b061cd5fc34b2a66 P 3c43409b300a4cb2abf72f8b260a1671: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:31.747005 13662 tablet_bootstrap.cc:492] T d0903b733d624ed6b061cd5fc34b2a66 P 6fa3d435c395490899fa88cfa4b4ff6a: Bootstrap starting.
I20260806 09:14:31.748052 13661 tablet_bootstrap.cc:492] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3: Bootstrap starting.
I20260806 09:14:31.749732 13662 tablet_bootstrap.cc:654] T d0903b733d624ed6b061cd5fc34b2a66 P 6fa3d435c395490899fa88cfa4b4ff6a: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:31.750617 13661 tablet_bootstrap.cc:654] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:31.750756 13660 tablet_bootstrap.cc:492] T d0903b733d624ed6b061cd5fc34b2a66 P 3c43409b300a4cb2abf72f8b260a1671: No bootstrap required, opened a new log
I20260806 09:14:31.750982 13660 ts_tablet_manager.cc:1397] T d0903b733d624ed6b061cd5fc34b2a66 P 3c43409b300a4cb2abf72f8b260a1671: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.002s
I20260806 09:14:31.752192 13660 raft_consensus.cc:348] T d0903b733d624ed6b061cd5fc34b2a66 P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:31.752556 13660 raft_consensus.cc:374] T d0903b733d624ed6b061cd5fc34b2a66 P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:31.752674 13660 raft_consensus.cc:729] T d0903b733d624ed6b061cd5fc34b2a66 P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c43409b300a4cb2abf72f8b260a1671, State: Initialized, Role: FOLLOWER
I20260806 09:14:31.753002 13660 consensus_queue.cc:260] T d0903b733d624ed6b061cd5fc34b2a66 P 3c43409b300a4cb2abf72f8b260a1671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:31.755122 13660 ts_tablet_manager.cc:1428] T d0903b733d624ed6b061cd5fc34b2a66 P 3c43409b300a4cb2abf72f8b260a1671: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260806 09:14:31.755759 13662 tablet_bootstrap.cc:492] T d0903b733d624ed6b061cd5fc34b2a66 P 6fa3d435c395490899fa88cfa4b4ff6a: No bootstrap required, opened a new log
I20260806 09:14:31.756186 13662 ts_tablet_manager.cc:1397] T d0903b733d624ed6b061cd5fc34b2a66 P 6fa3d435c395490899fa88cfa4b4ff6a: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20260806 09:14:31.757596 13662 raft_consensus.cc:348] T d0903b733d624ed6b061cd5fc34b2a66 P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:31.757875 13662 raft_consensus.cc:374] T d0903b733d624ed6b061cd5fc34b2a66 P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:31.757987 13662 raft_consensus.cc:729] T d0903b733d624ed6b061cd5fc34b2a66 P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fa3d435c395490899fa88cfa4b4ff6a, State: Initialized, Role: FOLLOWER
I20260806 09:14:31.758263 13661 tablet_bootstrap.cc:492] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3: No bootstrap required, opened a new log
I20260806 09:14:31.758553 13661 ts_tablet_manager.cc:1397] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.005s
I20260806 09:14:31.758373 13662 consensus_queue.cc:260] T d0903b733d624ed6b061cd5fc34b2a66 P 6fa3d435c395490899fa88cfa4b4ff6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:31.760356 13661 raft_consensus.cc:348] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:31.760527 13662 ts_tablet_manager.cc:1428] T d0903b733d624ed6b061cd5fc34b2a66 P 6fa3d435c395490899fa88cfa4b4ff6a: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260806 09:14:31.760640 13661 raft_consensus.cc:374] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:31.760785 13661 raft_consensus.cc:729] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e3b885b4dcc49f49fd433b6b47bafe3, State: Initialized, Role: FOLLOWER
I20260806 09:14:31.761157 13661 consensus_queue.cc:260] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:31.761679 13661 ts_tablet_manager.cc:1428] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260806 09:14:31.828490 13640 raft_consensus.cc:482] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:14:31.828750 13640 raft_consensus.cc:504] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:31.829651 13640 leader_election.cc:288] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c43409b300a4cb2abf72f8b260a1671 (127.10.255.65:40711), 6fa3d435c395490899fa88cfa4b4ff6a (127.10.255.67:38489)
I20260806 09:14:31.830307 13488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0903b733d624ed6b061cd5fc34b2a66" candidate_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" is_pre_election: true
I20260806 09:14:31.830366 13205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0903b733d624ed6b061cd5fc34b2a66" candidate_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c43409b300a4cb2abf72f8b260a1671" is_pre_election: true
I20260806 09:14:31.830597 13488 raft_consensus.cc:2454] T d0903b733d624ed6b061cd5fc34b2a66 P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e3b885b4dcc49f49fd433b6b47bafe3 in term 0.
I20260806 09:14:31.830725 13205 raft_consensus.cc:2454] T d0903b733d624ed6b061cd5fc34b2a66 P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e3b885b4dcc49f49fd433b6b47bafe3 in term 0.
I20260806 09:14:31.831148 13278 leader_election.cc:302] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e3b885b4dcc49f49fd433b6b47bafe3, 6fa3d435c395490899fa88cfa4b4ff6a; no voters:
I20260806 09:14:31.831573 13640 raft_consensus.cc:2781] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:14:31.831794 13640 raft_consensus.cc:482] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:14:31.831933 13640 raft_consensus.cc:3037] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:31.834242 13640 raft_consensus.cc:504] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:31.835008 13640 leader_election.cc:288] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3 [CANDIDATE]: Term 1 election: Requested vote from peers 3c43409b300a4cb2abf72f8b260a1671 (127.10.255.65:40711), 6fa3d435c395490899fa88cfa4b4ff6a (127.10.255.67:38489)
I20260806 09:14:31.835700 13205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0903b733d624ed6b061cd5fc34b2a66" candidate_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c43409b300a4cb2abf72f8b260a1671"
I20260806 09:14:31.835780 13488 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d0903b733d624ed6b061cd5fc34b2a66" candidate_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fa3d435c395490899fa88cfa4b4ff6a"
I20260806 09:14:31.835974 13205 raft_consensus.cc:3037] T d0903b733d624ed6b061cd5fc34b2a66 P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:31.836167 13488 raft_consensus.cc:3037] T d0903b733d624ed6b061cd5fc34b2a66 P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:31.838321 13205 raft_consensus.cc:2454] T d0903b733d624ed6b061cd5fc34b2a66 P 3c43409b300a4cb2abf72f8b260a1671 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e3b885b4dcc49f49fd433b6b47bafe3 in term 1.
I20260806 09:14:31.838665 13488 raft_consensus.cc:2454] T d0903b733d624ed6b061cd5fc34b2a66 P 6fa3d435c395490899fa88cfa4b4ff6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e3b885b4dcc49f49fd433b6b47bafe3 in term 1.
I20260806 09:14:31.838953 13277 leader_election.cc:302] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e3b885b4dcc49f49fd433b6b47bafe3, 3c43409b300a4cb2abf72f8b260a1671; no voters:
I20260806 09:14:31.839383 13640 raft_consensus.cc:2781] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:14:31.839649 13640 raft_consensus.cc:686] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 1 LEADER]: Becoming Leader. State: Replica: 2e3b885b4dcc49f49fd433b6b47bafe3, State: Running, Role: LEADER
I20260806 09:14:31.840018 13640 consensus_queue.cc:237] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:31.843174 13046 catalog_manager.cc:5495] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e3b885b4dcc49f49fd433b6b47bafe3 (127.10.255.66). New cstate: current_term: 1 leader_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } health_report { overall_health: UNKNOWN } } }
I20260806 09:14:31.873824 13669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:31.867315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58396 (local address 127.10.255.66:37443)
0806 09:14:31.868061 (+ 746us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:31.868068 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:31.868096 (+ 28us) server_negotiation.cc:407] Connection header received
0806 09:14:31.868181 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:31.868184 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:31.868252 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:31.868336 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:14:31.868812 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:31.869674 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:31.871355 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:31.871809 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:31.871941 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:31.872793 (+ 852us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:14:31.872963 (+ 170us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:14:31.873052 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:31.873287 (+ 235us) server_negotiation.cc:299] Negotiation successful
0806 09:14:31.873375 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":398,"threads_started":1}
I20260806 09:14:31.884204 13488 raft_consensus.cc:1261] T d0903b733d624ed6b061cd5fc34b2a66 P 6fa3d435c395490899fa88cfa4b4ff6a [term 1 FOLLOWER]: Refusing update from remote peer 2e3b885b4dcc49f49fd433b6b47bafe3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:14:31.884528 13205 raft_consensus.cc:1261] T d0903b733d624ed6b061cd5fc34b2a66 P 3c43409b300a4cb2abf72f8b260a1671 [term 1 FOLLOWER]: Refusing update from remote peer 2e3b885b4dcc49f49fd433b6b47bafe3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:14:31.884833 13639 consensus_queue.cc:1035] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:14:31.885265 13640 consensus_queue.cc:1035] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:14:31.950603 13046 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38780:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:14:31.951046 13046 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38780:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:14:31.955178 13046 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79: Sending DeleteTablet for 3 replicas of tablet d0903b733d624ed6b061cd5fc34b2a66
I20260806 09:14:31.956331 13329 tablet_service.cc:1514] Processing DeleteTablet for tablet d0903b733d624ed6b061cd5fc34b2a66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:14:31 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:58378
I20260806 09:14:31.956435 13185 tablet_service.cc:1514] Processing DeleteTablet for tablet d0903b733d624ed6b061cd5fc34b2a66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:14:31 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:42926
I20260806 09:14:31.956705 13651 tablet_replica.cc:330] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3: stopping tablet replica
I20260806 09:14:31.956698 13468 tablet_service.cc:1514] Processing DeleteTablet for tablet d0903b733d624ed6b061cd5fc34b2a66 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:14:31 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:42798
I20260806 09:14:31.956919 13651 raft_consensus.cc:2229] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:14:31.957140 13649 tablet_replica.cc:330] T d0903b733d624ed6b061cd5fc34b2a66 P 3c43409b300a4cb2abf72f8b260a1671: stopping tablet replica
I20260806 09:14:31.957165 13650 tablet_replica.cc:330] T d0903b733d624ed6b061cd5fc34b2a66 P 6fa3d435c395490899fa88cfa4b4ff6a: stopping tablet replica
I20260806 09:14:31.957266 13651 raft_consensus.cc:2258] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:14:31.957391 13649 raft_consensus.cc:2229] T d0903b733d624ed6b061cd5fc34b2a66 P 3c43409b300a4cb2abf72f8b260a1671 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:14:31.957480 13650 raft_consensus.cc:2229] T d0903b733d624ed6b061cd5fc34b2a66 P 6fa3d435c395490899fa88cfa4b4ff6a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:14:31.957665 13649 raft_consensus.cc:2258] T d0903b733d624ed6b061cd5fc34b2a66 P 3c43409b300a4cb2abf72f8b260a1671 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:14:31.957780 13650 raft_consensus.cc:2258] T d0903b733d624ed6b061cd5fc34b2a66 P 6fa3d435c395490899fa88cfa4b4ff6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:14:31.958621 13651 ts_tablet_manager.cc:1905] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:14:31.959498 13649 ts_tablet_manager.cc:1905] T d0903b733d624ed6b061cd5fc34b2a66 P 3c43409b300a4cb2abf72f8b260a1671: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:14:31.959676 13046 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38780:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:14:31.960454 13046 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:14:31.962066 13650 ts_tablet_manager.cc:1905] T d0903b733d624ed6b061cd5fc34b2a66 P 6fa3d435c395490899fa88cfa4b4ff6a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:14:31.965155 13651 ts_tablet_manager.cc:1918] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 09:14:31.965350 13651 log.cc:1196] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/d0903b733d624ed6b061cd5fc34b2a66
I20260806 09:14:31.965788 13651 ts_tablet_manager.cc:1939] T d0903b733d624ed6b061cd5fc34b2a66 P 2e3b885b4dcc49f49fd433b6b47bafe3: Deleting consensus metadata
I20260806 09:14:31.967054 13032 catalog_manager.cc:4841] TS 2e3b885b4dcc49f49fd433b6b47bafe3 (127.10.255.66:37443): tablet d0903b733d624ed6b061cd5fc34b2a66 (table test-table [id=60cd885a73fd450da9e694bd3d577f0f]) successfully deleted
I20260806 09:14:31.968690 13650 ts_tablet_manager.cc:1918] T d0903b733d624ed6b061cd5fc34b2a66 P 6fa3d435c395490899fa88cfa4b4ff6a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 09:14:31.968876 13650 log.cc:1196] T d0903b733d624ed6b061cd5fc34b2a66 P 6fa3d435c395490899fa88cfa4b4ff6a: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/d0903b733d624ed6b061cd5fc34b2a66
I20260806 09:14:31.969332 13650 ts_tablet_manager.cc:1939] T d0903b733d624ed6b061cd5fc34b2a66 P 6fa3d435c395490899fa88cfa4b4ff6a: Deleting consensus metadata
I20260806 09:14:31.970844 13031 catalog_manager.cc:4841] TS 6fa3d435c395490899fa88cfa4b4ff6a (127.10.255.67:38489): tablet d0903b733d624ed6b061cd5fc34b2a66 (table test-table [id=60cd885a73fd450da9e694bd3d577f0f]) successfully deleted
I20260806 09:14:31.973810 13649 ts_tablet_manager.cc:1918] T d0903b733d624ed6b061cd5fc34b2a66 P 3c43409b300a4cb2abf72f8b260a1671: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 09:14:31.974011 13649 log.cc:1196] T d0903b733d624ed6b061cd5fc34b2a66 P 3c43409b300a4cb2abf72f8b260a1671: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-0/wal/wals/d0903b733d624ed6b061cd5fc34b2a66
I20260806 09:14:31.974526 13649 ts_tablet_manager.cc:1939] T d0903b733d624ed6b061cd5fc34b2a66 P 3c43409b300a4cb2abf72f8b260a1671: Deleting consensus metadata
I20260806 09:14:31.974839 13185 tablet_service.cc:1467] Processing CreateTablet for tablet a7455b8f116b4821b54c32c1b753560b (DEFAULT_TABLE table=test-table [id=058fe7fb73854057a40eea3e59edf1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:31.974898 13468 tablet_service.cc:1467] Processing CreateTablet for tablet a7455b8f116b4821b54c32c1b753560b (DEFAULT_TABLE table=test-table [id=058fe7fb73854057a40eea3e59edf1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:31.975430 13468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7455b8f116b4821b54c32c1b753560b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:31.975478 13185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7455b8f116b4821b54c32c1b753560b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:31.975636 13030 catalog_manager.cc:4841] TS 3c43409b300a4cb2abf72f8b260a1671 (127.10.255.65:40711): tablet d0903b733d624ed6b061cd5fc34b2a66 (table test-table [id=60cd885a73fd450da9e694bd3d577f0f]) successfully deleted
I20260806 09:14:31.977442 13329 tablet_service.cc:1467] Processing CreateTablet for tablet a7455b8f116b4821b54c32c1b753560b (DEFAULT_TABLE table=test-table [id=058fe7fb73854057a40eea3e59edf1fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:31.977911 13329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7455b8f116b4821b54c32c1b753560b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:31.984457 13662 tablet_bootstrap.cc:492] T a7455b8f116b4821b54c32c1b753560b P 6fa3d435c395490899fa88cfa4b4ff6a: Bootstrap starting.
I20260806 09:14:31.984602 13660 tablet_bootstrap.cc:492] T a7455b8f116b4821b54c32c1b753560b P 3c43409b300a4cb2abf72f8b260a1671: Bootstrap starting.
I20260806 09:14:31.985383 13661 tablet_bootstrap.cc:492] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3: Bootstrap starting.
I20260806 09:14:31.986503 13662 tablet_bootstrap.cc:654] T a7455b8f116b4821b54c32c1b753560b P 6fa3d435c395490899fa88cfa4b4ff6a: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:31.986691 13660 tablet_bootstrap.cc:654] T a7455b8f116b4821b54c32c1b753560b P 3c43409b300a4cb2abf72f8b260a1671: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:31.987370 13661 tablet_bootstrap.cc:654] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:31.989604 13660 tablet_bootstrap.cc:492] T a7455b8f116b4821b54c32c1b753560b P 3c43409b300a4cb2abf72f8b260a1671: No bootstrap required, opened a new log
I20260806 09:14:31.989828 13662 tablet_bootstrap.cc:492] T a7455b8f116b4821b54c32c1b753560b P 6fa3d435c395490899fa88cfa4b4ff6a: No bootstrap required, opened a new log
I20260806 09:14:31.989868 13660 ts_tablet_manager.cc:1397] T a7455b8f116b4821b54c32c1b753560b P 3c43409b300a4cb2abf72f8b260a1671: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s
I20260806 09:14:31.990047 13662 ts_tablet_manager.cc:1397] T a7455b8f116b4821b54c32c1b753560b P 6fa3d435c395490899fa88cfa4b4ff6a: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.001s
I20260806 09:14:31.990757 13662 raft_consensus.cc:348] T a7455b8f116b4821b54c32c1b753560b P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:31.991019 13662 raft_consensus.cc:374] T a7455b8f116b4821b54c32c1b753560b P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:31.991101 13662 raft_consensus.cc:729] T a7455b8f116b4821b54c32c1b753560b P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fa3d435c395490899fa88cfa4b4ff6a, State: Initialized, Role: FOLLOWER
I20260806 09:14:31.990954 13660 raft_consensus.cc:348] T a7455b8f116b4821b54c32c1b753560b P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:31.991307 13660 raft_consensus.cc:374] T a7455b8f116b4821b54c32c1b753560b P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:31.991425 13660 raft_consensus.cc:729] T a7455b8f116b4821b54c32c1b753560b P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c43409b300a4cb2abf72f8b260a1671, State: Initialized, Role: FOLLOWER
I20260806 09:14:31.991369 13662 consensus_queue.cc:260] T a7455b8f116b4821b54c32c1b753560b P 6fa3d435c395490899fa88cfa4b4ff6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:31.991760 13660 consensus_queue.cc:260] T a7455b8f116b4821b54c32c1b753560b P 3c43409b300a4cb2abf72f8b260a1671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:31.991991 13662 ts_tablet_manager.cc:1428] T a7455b8f116b4821b54c32c1b753560b P 6fa3d435c395490899fa88cfa4b4ff6a: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 09:14:31.992455 13660 ts_tablet_manager.cc:1428] T a7455b8f116b4821b54c32c1b753560b P 3c43409b300a4cb2abf72f8b260a1671: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 09:14:31.994915 13661 tablet_bootstrap.cc:492] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3: No bootstrap required, opened a new log
I20260806 09:14:31.995143 13661 ts_tablet_manager.cc:1397] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260806 09:14:31.996166 13661 raft_consensus.cc:348] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:31.996462 13661 raft_consensus.cc:374] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:31.996578 13661 raft_consensus.cc:729] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e3b885b4dcc49f49fd433b6b47bafe3, State: Initialized, Role: FOLLOWER
I20260806 09:14:31.996850 13661 consensus_queue.cc:260] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:31.997488 13661 ts_tablet_manager.cc:1428] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 09:14:31.999979 13643 raft_consensus.cc:482] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:14:32.000195 13643 raft_consensus.cc:504] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:32.001061 13643 leader_election.cc:288] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c43409b300a4cb2abf72f8b260a1671 (127.10.255.65:40711), 6fa3d435c395490899fa88cfa4b4ff6a (127.10.255.67:38489)
I20260806 09:14:32.001583 13486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7455b8f116b4821b54c32c1b753560b" candidate_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" is_pre_election: true
I20260806 09:14:32.001609 13205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7455b8f116b4821b54c32c1b753560b" candidate_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c43409b300a4cb2abf72f8b260a1671" is_pre_election: true
I20260806 09:14:32.001889 13486 raft_consensus.cc:2454] T a7455b8f116b4821b54c32c1b753560b P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e3b885b4dcc49f49fd433b6b47bafe3 in term 0.
I20260806 09:14:32.001896 13205 raft_consensus.cc:2454] T a7455b8f116b4821b54c32c1b753560b P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e3b885b4dcc49f49fd433b6b47bafe3 in term 0.
I20260806 09:14:32.002353 13278 leader_election.cc:302] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e3b885b4dcc49f49fd433b6b47bafe3, 6fa3d435c395490899fa88cfa4b4ff6a; no voters:
I20260806 09:14:32.002664 13643 raft_consensus.cc:2781] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:14:32.002794 13643 raft_consensus.cc:482] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:14:32.002862 13643 raft_consensus.cc:3037] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:32.005414 13643 raft_consensus.cc:504] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:32.006137 13643 leader_election.cc:288] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3 [CANDIDATE]: Term 1 election: Requested vote from peers 3c43409b300a4cb2abf72f8b260a1671 (127.10.255.65:40711), 6fa3d435c395490899fa88cfa4b4ff6a (127.10.255.67:38489)
I20260806 09:14:32.006901 13486 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7455b8f116b4821b54c32c1b753560b" candidate_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fa3d435c395490899fa88cfa4b4ff6a"
I20260806 09:14:32.006891 13205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7455b8f116b4821b54c32c1b753560b" candidate_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c43409b300a4cb2abf72f8b260a1671"
I20260806 09:14:32.007194 13486 raft_consensus.cc:3037] T a7455b8f116b4821b54c32c1b753560b P 6fa3d435c395490899fa88cfa4b4ff6a [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:32.007220 13205 raft_consensus.cc:3037] T a7455b8f116b4821b54c32c1b753560b P 3c43409b300a4cb2abf72f8b260a1671 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:32.010165 13205 raft_consensus.cc:2454] T a7455b8f116b4821b54c32c1b753560b P 3c43409b300a4cb2abf72f8b260a1671 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e3b885b4dcc49f49fd433b6b47bafe3 in term 1.
I20260806 09:14:32.010191 13486 raft_consensus.cc:2454] T a7455b8f116b4821b54c32c1b753560b P 6fa3d435c395490899fa88cfa4b4ff6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e3b885b4dcc49f49fd433b6b47bafe3 in term 1.
I20260806 09:14:32.010828 13278 leader_election.cc:302] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e3b885b4dcc49f49fd433b6b47bafe3, 6fa3d435c395490899fa88cfa4b4ff6a; no voters:
I20260806 09:14:32.011349 13643 raft_consensus.cc:2781] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:14:32.011569 13643 raft_consensus.cc:686] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 1 LEADER]: Becoming Leader. State: Replica: 2e3b885b4dcc49f49fd433b6b47bafe3, State: Running, Role: LEADER
I20260806 09:14:32.011941 13643 consensus_queue.cc:237] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } }
I20260806 09:14:32.015471 13046 catalog_manager.cc:5495] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e3b885b4dcc49f49fd433b6b47bafe3 (127.10.255.66). New cstate: current_term: 1 leader_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2e3b885b4dcc49f49fd433b6b47bafe3" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 } health_report { overall_health: UNKNOWN } } }
I20260806 09:14:32.048565 13486 raft_consensus.cc:1261] T a7455b8f116b4821b54c32c1b753560b P 6fa3d435c395490899fa88cfa4b4ff6a [term 1 FOLLOWER]: Refusing update from remote peer 2e3b885b4dcc49f49fd433b6b47bafe3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:14:32.048836 13205 raft_consensus.cc:1261] T a7455b8f116b4821b54c32c1b753560b P 3c43409b300a4cb2abf72f8b260a1671 [term 1 FOLLOWER]: Refusing update from remote peer 2e3b885b4dcc49f49fd433b6b47bafe3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:14:32.049340 13640 consensus_queue.cc:1035] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fa3d435c395490899fa88cfa4b4ff6a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38489 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:14:32.049638 13643 consensus_queue.cc:1035] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c43409b300a4cb2abf72f8b260a1671" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 09:14:32.072067 13631 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 09:14:33.675302 13044 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38780:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:14:33.675645 13044 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38780:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:14:33.683094 13044 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 38848f6ce966465caebcad7105ed3d79: Sending DeleteTablet for 3 replicas of tablet a7455b8f116b4821b54c32c1b753560b
I20260806 09:14:33.684329 13329 tablet_service.cc:1514] Processing DeleteTablet for tablet a7455b8f116b4821b54c32c1b753560b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:14:33 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:58378
I20260806 09:14:33.684346 13185 tablet_service.cc:1514] Processing DeleteTablet for tablet a7455b8f116b4821b54c32c1b753560b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:14:33 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:42926
I20260806 09:14:33.684593 13468 tablet_service.cc:1514] Processing DeleteTablet for tablet a7455b8f116b4821b54c32c1b753560b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:14:33 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:42798
I20260806 09:14:33.685470 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 13118
I20260806 09:14:33.695715 13704 tablet_replica.cc:330] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3: stopping tablet replica
I20260806 09:14:33.696138 13704 raft_consensus.cc:2229] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:14:33.696768 13704 raft_consensus.cc:2258] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:14:33.697536 13706 tablet_replica.cc:330] T a7455b8f116b4821b54c32c1b753560b P 6fa3d435c395490899fa88cfa4b4ff6a: stopping tablet replica
I20260806 09:14:33.698074 13704 ts_tablet_manager.cc:1905] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:14:33.698182 13705 tablet_replica.cc:330] T a7455b8f116b4821b54c32c1b753560b P 3c43409b300a4cb2abf72f8b260a1671: stopping tablet replica
I20260806 09:14:33.698460 13705 raft_consensus.cc:2229] T a7455b8f116b4821b54c32c1b753560b P 3c43409b300a4cb2abf72f8b260a1671 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:14:33.699172 13706 raft_consensus.cc:2229] T a7455b8f116b4821b54c32c1b753560b P 6fa3d435c395490899fa88cfa4b4ff6a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:14:33.699208 13705 raft_consensus.cc:2258] T a7455b8f116b4821b54c32c1b753560b P 3c43409b300a4cb2abf72f8b260a1671 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:14:33.699543 13706 raft_consensus.cc:2258] T a7455b8f116b4821b54c32c1b753560b P 6fa3d435c395490899fa88cfa4b4ff6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:14:33.700924 13705 ts_tablet_manager.cc:1905] T a7455b8f116b4821b54c32c1b753560b P 3c43409b300a4cb2abf72f8b260a1671: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:14:33.701297 13706 ts_tablet_manager.cc:1905] T a7455b8f116b4821b54c32c1b753560b P 6fa3d435c395490899fa88cfa4b4ff6a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:14:33.707095 13704 ts_tablet_manager.cc:1918] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 09:14:33.707382 13704 log.cc:1196] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/a7455b8f116b4821b54c32c1b753560b
I20260806 09:14:33.708007 13704 ts_tablet_manager.cc:1939] T a7455b8f116b4821b54c32c1b753560b P 2e3b885b4dcc49f49fd433b6b47bafe3: Deleting consensus metadata
I20260806 09:14:33.709530 13032 catalog_manager.cc:4841] TS 2e3b885b4dcc49f49fd433b6b47bafe3 (127.10.255.66:37443): tablet a7455b8f116b4821b54c32c1b753560b (table test-table [id=058fe7fb73854057a40eea3e59edf1fc]) successfully deleted
I20260806 09:14:33.711401 13706 ts_tablet_manager.cc:1918] T a7455b8f116b4821b54c32c1b753560b P 6fa3d435c395490899fa88cfa4b4ff6a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 09:14:33.711620 13706 log.cc:1196] T a7455b8f116b4821b54c32c1b753560b P 6fa3d435c395490899fa88cfa4b4ff6a: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/a7455b8f116b4821b54c32c1b753560b
I20260806 09:14:33.712224 13705 ts_tablet_manager.cc:1918] T a7455b8f116b4821b54c32c1b753560b P 3c43409b300a4cb2abf72f8b260a1671: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 09:14:33.712297 13706 ts_tablet_manager.cc:1939] T a7455b8f116b4821b54c32c1b753560b P 6fa3d435c395490899fa88cfa4b4ff6a: Deleting consensus metadata
Aug 06 09:14:33 dist-test-slave-mvvj krb5kdc[13001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007671, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.255.65@KRBTEST.COM
I20260806 09:14:33.712431 13705 log.cc:1196] T a7455b8f116b4821b54c32c1b753560b P 3c43409b300a4cb2abf72f8b260a1671: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786007647474472-11261-0/minicluster-data/ts-0/wal/wals/a7455b8f116b4821b54c32c1b753560b
I20260806 09:14:33.712981 13705 ts_tablet_manager.cc:1939] T a7455b8f116b4821b54c32c1b753560b P 3c43409b300a4cb2abf72f8b260a1671: Deleting consensus metadata
I20260806 09:14:33.714426 13031 catalog_manager.cc:4841] TS 6fa3d435c395490899fa88cfa4b4ff6a (127.10.255.67:38489): tablet a7455b8f116b4821b54c32c1b753560b (table test-table [id=058fe7fb73854057a40eea3e59edf1fc]) successfully deleted
I20260806 09:14:33.714494 13030 catalog_manager.cc:4841] TS 3c43409b300a4cb2abf72f8b260a1671 (127.10.255.65:40711): tablet a7455b8f116b4821b54c32c1b753560b (table test-table [id=058fe7fb73854057a40eea3e59edf1fc]) successfully deleted
I20260806 09:14:33.725728 13708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:33.687710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42952 (local address 127.10.255.65:40711)
0806 09:14:33.697108 (+ 9398us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:33.697118 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:33.697160 (+ 42us) server_negotiation.cc:407] Connection header received
0806 09:14:33.697248 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:33.697253 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:33.697355 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:33.698401 (+ 1046us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:33.700673 (+ 2272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:33.701940 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:33.704600 (+ 2660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:33.705346 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:33.706435 (+ 1089us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:33.714126 (+ 7691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:33.714152 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:33.714178 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:33.714239 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:33.720571 (+ 6332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:33.722057 (+ 1486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:33.722072 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:33.722092 (+ 20us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:33.722445 (+ 353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:33.723221 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:33.723227 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:33.723230 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:33.724223 (+ 993us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:33.724716 (+ 493us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:33.725087 (+ 371us) server_negotiation.cc:299] Negotiation successful
0806 09:14:33.725378 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9187,"thread_start_us":9011,"threads_started":1}
W20260806 09:14:33.726956 13251 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42952
W20260806 09:14:33.728364 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 13118: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 09:14:33.728658 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 13118
I20260806 09:14:33.760473 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 13260
Aug 06 09:14:33 dist-test-slave-mvvj krb5kdc[13001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007671, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.255.66@KRBTEST.COM
I20260806 09:14:33.780153 13709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:33.761588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58400 (local address 127.10.255.66:37443)
0806 09:14:33.762358 (+ 770us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:33.762364 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:33.762387 (+ 23us) server_negotiation.cc:407] Connection header received
0806 09:14:33.762457 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:33.762462 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:33.762550 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:33.762746 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:33.764525 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:33.765560 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:33.767021 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:33.767525 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:33.767705 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:33.772739 (+ 5034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:33.772761 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:33.772779 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:33.772824 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:33.776433 (+ 3609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:33.777407 (+ 974us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:33.777415 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:33.777418 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:33.777655 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:33.778222 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:33.778227 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:33.778230 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:33.778826 (+ 596us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:33.779139 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:33.779494 (+ 355us) server_negotiation.cc:299] Negotiation successful
0806 09:14:33.779758 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":629,"thread_start_us":465,"threads_started":1}
W20260806 09:14:33.780933 13393 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58400
W20260806 09:14:33.781836 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 13260: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 09:14:33.782115 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 13260
I20260806 09:14:33.808430 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 13402
Aug 06 09:14:33 dist-test-slave-mvvj krb5kdc[13001](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007671, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.255.67@KRBTEST.COM
I20260806 09:14:33.829941 13710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:33.809594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42800 (local address 127.10.255.67:38489)
0806 09:14:33.810343 (+ 749us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:33.810348 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:33.810367 (+ 19us) server_negotiation.cc:407] Connection header received
0806 09:14:33.810424 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:33.810428 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:33.810560 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:33.810662 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:33.812367 (+ 1705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:33.813223 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:33.815574 (+ 2351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:33.816404 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:33.816561 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:33.821754 (+ 5193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:33.821775 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:33.821794 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:33.821841 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:33.825797 (+ 3956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:33.827067 (+ 1270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:33.827081 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:33.827083 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:33.827348 (+ 265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:33.827824 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:33.827828 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:33.827890 (+ 62us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:33.828307 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:33.828661 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:33.829230 (+ 569us) server_negotiation.cc:299] Negotiation successful
0806 09:14:33.829515 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":612,"thread_start_us":461,"threads_started":1}
W20260806 09:14:33.831043 13534 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42800
W20260806 09:14:33.831961 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 13402: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 09:14:33.832191 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 13402
I20260806 09:14:33.853075 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 13014
I20260806 09:14:33.854588 13087 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:33.983783 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 13014
2026-08-06T09:14:34Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9626 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:14:34 dist-test-slave-mvvj krb5kdc[13714](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:14:34 dist-test-slave-mvvj krb5kdc[13714](info): set up 2 sockets
Aug 06 09:14:34 dist-test-slave-mvvj krb5kdc[13714](info): commencing operation
krb5kdc: starting...
W20260806 09:14:35.187044 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.151s user 0.002s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:14:35 dist-test-slave-mvvj krb5kdc[13714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007675, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:14:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:14:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:14:35.429540 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:38011
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:37843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:38011
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:35.823029 13727 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:35.823467 13727 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:35.823663 13727 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:35.832137 13727 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:14:35.832324 13727 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:35.832427 13727 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:35.832532 13727 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:14:35.832608 13727 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:14:35.843483 13727 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:37843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:38011
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:38011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:35.845104 13727 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:35.846643 13727 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:35.862139 13732 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:35.862212 13733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:35.862802 13735 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:35.863032 13727 server_base.cc:1034] running on GCE node
I20260806 09:14:35.864087 13727 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:35.865705 13727 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:35.866981 13727 hybrid_clock.cc:648] HybridClock initialized: now 1786007675866919 us; error 55 us; skew 500 ppm
I20260806 09:14:35.867364 13727 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:35 dist-test-slave-mvvj krb5kdc[13714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007675, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:35.871263 13727 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:14:35.873210 13727 webserver.cc:460] Webserver started at http://127.10.255.126:40663/ using document root <none> and password file <none>
I20260806 09:14:35.874306 13727 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:35.874579 13727 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:35.874982 13727 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:35.878894 13727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "e48695cf453b4c8f94e788c43c5266c7"
format_stamp: "Formatted at 2026-08-06 09:14:35 on dist-test-slave-mvvj"
server_key: "495ba00536d5bc52fac6694236f713fd"
server_key_iv: "aae12cceda0d8fd5ed50729f4d618cfc"
server_key_version: "encryptionkey@0"
I20260806 09:14:35.879979 13727 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "e48695cf453b4c8f94e788c43c5266c7"
format_stamp: "Formatted at 2026-08-06 09:14:35 on dist-test-slave-mvvj"
server_key: "495ba00536d5bc52fac6694236f713fd"
server_key_iv: "aae12cceda0d8fd5ed50729f4d618cfc"
server_key_version: "encryptionkey@0"
I20260806 09:14:35.887310 13727 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260806 09:14:35.892181 13742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:35.893947 13727 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:14:35.894214 13727 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "e48695cf453b4c8f94e788c43c5266c7"
format_stamp: "Formatted at 2026-08-06 09:14:35 on dist-test-slave-mvvj"
server_key: "495ba00536d5bc52fac6694236f713fd"
server_key_iv: "aae12cceda0d8fd5ed50729f4d618cfc"
server_key_version: "encryptionkey@0"
I20260806 09:14:35.894446 13727 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:35.942821 13727 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:35.948155 13727 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:35.948509 13727 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:35.970158 13727 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:38011
I20260806 09:14:35.970165 13794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:38011 every 8 connection(s)
I20260806 09:14:35.971892 13727 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:14:35.976666 13795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:35.977110 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 13727
I20260806 09:14:35.977397 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:14:35.978330 11261 external_mini_cluster.cc:1428] Setting key 63718a2f1cff9678d0ec43681cdd39d7
I20260806 09:14:35.994936 13795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e48695cf453b4c8f94e788c43c5266c7: Bootstrap starting.
Aug 06 09:14:35 dist-test-slave-mvvj krb5kdc[13714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007675, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:35.999924 13795 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e48695cf453b4c8f94e788c43c5266c7: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:36.001729 13795 log.cc:824] T 00000000000000000000000000000000 P e48695cf453b4c8f94e788c43c5266c7: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:36.006042 13795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e48695cf453b4c8f94e788c43c5266c7: No bootstrap required, opened a new log
I20260806 09:14:36.010718 13798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:35.980836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53026 (local address 127.10.255.126:38011)
0806 09:14:35.981755 (+ 919us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:35.981767 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:35.981819 (+ 52us) server_negotiation.cc:407] Connection header received
0806 09:14:35.985669 (+ 3850us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:35.985708 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:35.986247 (+ 539us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:35.986678 (+ 431us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:35.988866 (+ 2188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:35.990785 (+ 1919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:35.992964 (+ 2179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:35.993977 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:35.994169 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:35.999940 (+ 5771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:35.999953 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:35.999978 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:36.000053 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:36.004831 (+ 4778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:36.005935 (+ 1104us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:36.005946 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:36.005954 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:36.006247 (+ 293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:36.006774 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:36.006780 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:36.006784 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:36.007480 (+ 696us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:36.008023 (+ 543us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:36.008557 (+ 534us) server_negotiation.cc:299] Negotiation successful
0806 09:14:36.009281 (+ 724us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":687,"thread_start_us":448,"threads_started":1}
I20260806 09:14:36.016714 13795 raft_consensus.cc:348] T 00000000000000000000000000000000 P e48695cf453b4c8f94e788c43c5266c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e48695cf453b4c8f94e788c43c5266c7" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 38011 } }
I20260806 09:14:36.017205 13795 raft_consensus.cc:374] T 00000000000000000000000000000000 P e48695cf453b4c8f94e788c43c5266c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:36.017326 13795 raft_consensus.cc:729] T 00000000000000000000000000000000 P e48695cf453b4c8f94e788c43c5266c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e48695cf453b4c8f94e788c43c5266c7, State: Initialized, Role: FOLLOWER
I20260806 09:14:36.018025 13795 consensus_queue.cc:260] T 00000000000000000000000000000000 P e48695cf453b4c8f94e788c43c5266c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e48695cf453b4c8f94e788c43c5266c7" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 38011 } }
I20260806 09:14:36.018296 13795 raft_consensus.cc:388] T 00000000000000000000000000000000 P e48695cf453b4c8f94e788c43c5266c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:14:36.018456 13795 raft_consensus.cc:482] T 00000000000000000000000000000000 P e48695cf453b4c8f94e788c43c5266c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:14:36.018664 13795 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e48695cf453b4c8f94e788c43c5266c7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:36.021588 13795 raft_consensus.cc:504] T 00000000000000000000000000000000 P e48695cf453b4c8f94e788c43c5266c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e48695cf453b4c8f94e788c43c5266c7" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 38011 } }
I20260806 09:14:36.022235 13795 leader_election.cc:302] T 00000000000000000000000000000000 P e48695cf453b4c8f94e788c43c5266c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e48695cf453b4c8f94e788c43c5266c7; no voters:
I20260806 09:14:36.022894 13795 leader_election.cc:288] T 00000000000000000000000000000000 P e48695cf453b4c8f94e788c43c5266c7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:14:36.023171 13800 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e48695cf453b4c8f94e788c43c5266c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:14:36.023985 13800 raft_consensus.cc:686] T 00000000000000000000000000000000 P e48695cf453b4c8f94e788c43c5266c7 [term 1 LEADER]: Becoming Leader. State: Replica: e48695cf453b4c8f94e788c43c5266c7, State: Running, Role: LEADER
I20260806 09:14:36.024632 13800 consensus_queue.cc:237] T 00000000000000000000000000000000 P e48695cf453b4c8f94e788c43c5266c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e48695cf453b4c8f94e788c43c5266c7" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 38011 } }
I20260806 09:14:36.025219 13795 sys_catalog.cc:564] T 00000000000000000000000000000000 P e48695cf453b4c8f94e788c43c5266c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:14:36.028115 13802 sys_catalog.cc:455] T 00000000000000000000000000000000 P e48695cf453b4c8f94e788c43c5266c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e48695cf453b4c8f94e788c43c5266c7. Latest consensus state: current_term: 1 leader_uuid: "e48695cf453b4c8f94e788c43c5266c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e48695cf453b4c8f94e788c43c5266c7" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 38011 } } }
I20260806 09:14:36.028733 13802 sys_catalog.cc:458] T 00000000000000000000000000000000 P e48695cf453b4c8f94e788c43c5266c7 [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:36.029461 13801 sys_catalog.cc:455] T 00000000000000000000000000000000 P e48695cf453b4c8f94e788c43c5266c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e48695cf453b4c8f94e788c43c5266c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e48695cf453b4c8f94e788c43c5266c7" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 38011 } } }
I20260806 09:14:36.029779 13809 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:14:36.029842 13801 sys_catalog.cc:458] T 00000000000000000000000000000000 P e48695cf453b4c8f94e788c43c5266c7 [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:36.036099 13809 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:14:36.045965 13809 catalog_manager.cc:1347] Generated new cluster ID: 7ed587e999a24d68b230357c26064258
I20260806 09:14:36.046114 13809 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:14:36.064615 13809 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:14:36.066663 13809 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:14:36.076397 13809 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e48695cf453b4c8f94e788c43c5266c7: Generated new TSK 0
I20260806 09:14:36.077942 13809 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.255.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
I20260806 09:14:36.137838 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:38011
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:37843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:36.504118 13821 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:36.504482 13821 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:36.504598 13821 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:36.512969 13821 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:36.513108 13821 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:36.513228 13821 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:14:36.524407 13821 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:37843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:38011
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:36.525952 13821 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:36.527704 13821 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:36.544703 13827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:36.544718 13829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:36.544678 13826 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:36.550441 13821 server_base.cc:1034] running on GCE node
I20260806 09:14:36.551517 13821 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:36.553000 13821 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:36.554294 13821 hybrid_clock.cc:648] HybridClock initialized: now 1786007676554227 us; error 45 us; skew 500 ppm
I20260806 09:14:36.554754 13821 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:36 dist-test-slave-mvvj krb5kdc[13714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007676, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:36.559082 13821 init.cc:377] Logged in from keytab as kudu/127.10.255.65@KRBTEST.COM (short username kudu)
I20260806 09:14:36.561358 13821 webserver.cc:460] Webserver started at http://127.10.255.65:33917/ using document root <none> and password file <none>
I20260806 09:14:36.562258 13821 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:36.562387 13821 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:36.562702 13821 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:36.566669 13821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "844ffc64f9204172b17c592b4096c214"
format_stamp: "Formatted at 2026-08-06 09:14:36 on dist-test-slave-mvvj"
server_key: "106b9700cf56973ce740f8649acae62c"
server_key_iv: "e1ece69482ce88519f6b6fde8b13762b"
server_key_version: "encryptionkey@0"
I20260806 09:14:36.567744 13821 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "844ffc64f9204172b17c592b4096c214"
format_stamp: "Formatted at 2026-08-06 09:14:36 on dist-test-slave-mvvj"
server_key: "106b9700cf56973ce740f8649acae62c"
server_key_iv: "e1ece69482ce88519f6b6fde8b13762b"
server_key_version: "encryptionkey@0"
I20260806 09:14:36.574892 13821 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.004s
I20260806 09:14:36.579654 13836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:36.581557 13821 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:14:36.581820 13821 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "844ffc64f9204172b17c592b4096c214"
format_stamp: "Formatted at 2026-08-06 09:14:36 on dist-test-slave-mvvj"
server_key: "106b9700cf56973ce740f8649acae62c"
server_key_iv: "e1ece69482ce88519f6b6fde8b13762b"
server_key_version: "encryptionkey@0"
I20260806 09:14:36.582139 13821 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:36.596558 13821 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:36.602937 13821 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:36.603410 13821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:36.604844 13821 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:14:36.606554 13821 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:36.606642 13821 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:36.606742 13821 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:36.606791 13821 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:36.646090 13821 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:34145
I20260806 09:14:36.646129 13949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:34145 every 8 connection(s)
I20260806 09:14:36.647795 13821 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:14:36.651914 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 13821
I20260806 09:14:36.652205 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:14:36.652915 11261 external_mini_cluster.cc:1428] Setting key 3a41bd2ae57cbd16cd6ad24eb0e0cc06
Aug 06 09:14:36 dist-test-slave-mvvj krb5kdc[13714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007676, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:36.672794 13952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:36.651010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:45661 (local address 127.10.255.126:38011)
0806 09:14:36.651623 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:36.651632 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:36.652822 (+ 1190us) server_negotiation.cc:407] Connection header received
0806 09:14:36.655146 (+ 2324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:36.655151 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:36.655250 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:36.655385 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:36.657318 (+ 1933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:36.658098 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:36.659928 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:36.660545 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:36.660709 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:36.665531 (+ 4822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:36.665537 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:36.665540 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:36.665582 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:36.668951 (+ 3369us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:36.669973 (+ 1022us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:36.669978 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:36.669981 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:36.670129 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:36.670683 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:36.670688 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:36.670690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:36.671003 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:36.671183 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:36.672101 (+ 918us) server_negotiation.cc:299] Negotiation successful
0806 09:14:36.672389 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":273,"threads_started":1}
WARNING: no policy specified for kudu/127.10.255.66@KRBTEST.COM; defaulting to no policy
I20260806 09:14:36.674124 13953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:36.651652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:38011 (local address 127.10.255.65:45661)
0806 09:14:36.652612 (+ 960us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:36.652663 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:36.654803 (+ 2140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:36.655701 (+ 898us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:36.655712 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:36.656418 (+ 706us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:36.657105 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:36.657128 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:36.658293 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:36.658298 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:36.659700 (+ 1402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:36.659723 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:36.660844 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:36.660850 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:36.661149 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:36.662015 (+ 866us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:36.662065 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:36.665205 (+ 3140us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:36.669194 (+ 3989us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:36.669207 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:36.669232 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:36.669795 (+ 563us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:36.670274 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:36.670280 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:36.670284 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:36.670535 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:36.671158 (+ 623us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:36.671168 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:36.671606 (+ 438us) client_negotiation.cc:769] Sending connection context
0806 09:14:36.671979 (+ 373us) client_negotiation.cc:240] Negotiation successful
0806 09:14:36.672688 (+ 709us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"thread_start_us":439,"threads_started":1}
I20260806 09:14:36.676355 13950 heartbeater.cc:347] Connected to a master server at 127.10.255.126:38011
I20260806 09:14:36.676733 13950 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:36.677665 13950 heartbeater.cc:511] Master 127.10.255.126:38011 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.66@KRBTEST.COM" created.
I20260806 09:14:36.680876 13759 ts_manager.cc:194] Registered new tserver with Master: 844ffc64f9204172b17c592b4096c214 (127.10.255.65:34145)
I20260806 09:14:36.683609 13759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.65@KRBTEST.COM'} at 127.10.255.65:45661
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
I20260806 09:14:36.709650 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:38011
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:37843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:37.101074 13956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:37.101433 13956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:37.101538 13956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:37.110709 13956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:37.110883 13956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:37.111016 13956 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:14:37.122165 13956 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:37843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:38011
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:37.123651 13956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:37.125419 13956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:37.140987 13961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:37.141024 13962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:37.141053 13964 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:37.141896 13956 server_base.cc:1034] running on GCE node
I20260806 09:14:37.142652 13956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:37.144129 13956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:37.145390 13956 hybrid_clock.cc:648] HybridClock initialized: now 1786007677145213 us; error 178 us; skew 500 ppm
I20260806 09:14:37.145782 13956 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:37 dist-test-slave-mvvj krb5kdc[13714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007677, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:37.157351 13956 init.cc:377] Logged in from keytab as kudu/127.10.255.66@KRBTEST.COM (short username kudu)
I20260806 09:14:37.159365 13956 webserver.cc:460] Webserver started at http://127.10.255.66:40691/ using document root <none> and password file <none>
I20260806 09:14:37.160310 13956 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:37.160470 13956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:37.160836 13956 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:37.164515 13956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "bbfd41968428456e8d7954413427bdaa"
format_stamp: "Formatted at 2026-08-06 09:14:37 on dist-test-slave-mvvj"
server_key: "4f3dbeec01ba7a686c652df853f89820"
server_key_iv: "fdee6d818858824db3a0b7a4aa64f747"
server_key_version: "encryptionkey@0"
I20260806 09:14:37.165508 13956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "bbfd41968428456e8d7954413427bdaa"
format_stamp: "Formatted at 2026-08-06 09:14:37 on dist-test-slave-mvvj"
server_key: "4f3dbeec01ba7a686c652df853f89820"
server_key_iv: "fdee6d818858824db3a0b7a4aa64f747"
server_key_version: "encryptionkey@0"
I20260806 09:14:37.171957 13956 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 09:14:37.176338 13971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:37.177955 13956 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 09:14:37.178167 13956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "bbfd41968428456e8d7954413427bdaa"
format_stamp: "Formatted at 2026-08-06 09:14:37 on dist-test-slave-mvvj"
server_key: "4f3dbeec01ba7a686c652df853f89820"
server_key_iv: "fdee6d818858824db3a0b7a4aa64f747"
server_key_version: "encryptionkey@0"
I20260806 09:14:37.178432 13956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:37.198585 13956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:37.203995 13956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:37.204391 13956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:37.205701 13956 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:14:37.207391 13956 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:37.207484 13956 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:37.207645 13956 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:37.207701 13956 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:37.246256 13956 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:37425
I20260806 09:14:37.246322 14084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:37425 every 8 connection(s)
I20260806 09:14:37.247764 13956 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:14:37.256147 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 13956
I20260806 09:14:37.256378 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:14:37.256865 11261 external_mini_cluster.cc:1428] Setting key 651794c62b905042464f07d279d2b20a
Aug 06 09:14:37 dist-test-slave-mvvj krb5kdc[13714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007677, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:37.273799 14087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:37.251009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:36987 (local address 127.10.255.126:38011)
0806 09:14:37.251666 (+ 657us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:37.251671 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:37.252731 (+ 1060us) server_negotiation.cc:407] Connection header received
0806 09:14:37.254834 (+ 2103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:37.254841 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:37.254951 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:37.255091 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:37.257115 (+ 2024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:37.258188 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:37.260507 (+ 2319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:37.261451 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:37.261645 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:37.265804 (+ 4159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:37.265814 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:37.265821 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:37.265880 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:37.269427 (+ 3547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:37.270716 (+ 1289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:37.270722 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:37.270724 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:37.270899 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:37.271579 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:37.271584 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:37.271586 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:37.272034 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:37.272176 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:37.273279 (+ 1103us) server_negotiation.cc:299] Negotiation successful
0806 09:14:37.273511 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":297,"threads_started":1}
I20260806 09:14:37.275825 14088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:37.251547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:38011 (local address 127.10.255.66:36987)
0806 09:14:37.252542 (+ 995us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:37.252589 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:37.254493 (+ 1904us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:37.255387 (+ 894us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:37.255396 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:37.256112 (+ 716us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:37.256866 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:37.256887 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:37.258386 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:37.258391 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:37.260321 (+ 1930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:37.260339 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:37.261760 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:37.261766 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:37.262019 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:37.262869 (+ 850us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:37.262903 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:37.265421 (+ 2518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:37.269678 (+ 4257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:37.269694 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:37.269719 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:37.270531 (+ 812us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:37.271045 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:37.271053 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:37.271059 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:37.271392 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:37.272187 (+ 795us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:37.272200 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:37.272806 (+ 606us) client_negotiation.cc:769] Sending connection context
0806 09:14:37.273166 (+ 360us) client_negotiation.cc:240] Negotiation successful
0806 09:14:37.273870 (+ 704us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":637,"thread_start_us":393,"threads_started":1}
I20260806 09:14:37.277966 14085 heartbeater.cc:347] Connected to a master server at 127.10.255.126:38011
I20260806 09:14:37.278402 14085 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.10.255.67@KRBTEST.COM; defaulting to no policy
I20260806 09:14:37.279551 14085 heartbeater.cc:511] Master 127.10.255.126:38011 requested a full tablet report, sending...
I20260806 09:14:37.281798 13759 ts_manager.cc:194] Registered new tserver with Master: bbfd41968428456e8d7954413427bdaa (127.10.255.66:37425)
I20260806 09:14:37.282938 13759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.66@KRBTEST.COM'} at 127.10.255.66:36987
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
I20260806 09:14:37.317106 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:38011
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:37843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:14:37.688779 13950 heartbeater.cc:503] Master 127.10.255.126:38011 was elected leader, sending a full tablet report...
W20260806 09:14:37.706135 14091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:37.706485 14091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:37.706586 14091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:37.714529 14091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:37.714882 14091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:37.715054 14091 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:14:37.730326 14091 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:37843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:38011
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:37.731746 14091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:37.733253 14091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:37.751405 14096 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:37.751456 14097 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:37.751420 14099 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:37.753171 14091 server_base.cc:1034] running on GCE node
I20260806 09:14:37.754031 14091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:37.755383 14091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:37.756664 14091 hybrid_clock.cc:648] HybridClock initialized: now 1786007677756558 us; error 95 us; skew 500 ppm
I20260806 09:14:37.757099 14091 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:37 dist-test-slave-mvvj krb5kdc[13714](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007677, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:37.761986 14091 init.cc:377] Logged in from keytab as kudu/127.10.255.67@KRBTEST.COM (short username kudu)
I20260806 09:14:37.764240 14091 webserver.cc:460] Webserver started at http://127.10.255.67:33095/ using document root <none> and password file <none>
I20260806 09:14:37.765147 14091 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:37.765308 14091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:37.765749 14091 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:37.769280 14091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "a7be0a6343824633b62366c956c55c20"
format_stamp: "Formatted at 2026-08-06 09:14:37 on dist-test-slave-mvvj"
server_key: "4cad6728b6dcc535fc6d63836e31a665"
server_key_iv: "735e9f393620ffd3feb89037a6e7b0d0"
server_key_version: "encryptionkey@0"
I20260806 09:14:37.770228 14091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "a7be0a6343824633b62366c956c55c20"
format_stamp: "Formatted at 2026-08-06 09:14:37 on dist-test-slave-mvvj"
server_key: "4cad6728b6dcc535fc6d63836e31a665"
server_key_iv: "735e9f393620ffd3feb89037a6e7b0d0"
server_key_version: "encryptionkey@0"
I20260806 09:14:37.776895 14091 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260806 09:14:37.781662 14106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:37.783571 14091 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 09:14:37.783828 14091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "a7be0a6343824633b62366c956c55c20"
format_stamp: "Formatted at 2026-08-06 09:14:37 on dist-test-slave-mvvj"
server_key: "4cad6728b6dcc535fc6d63836e31a665"
server_key_iv: "735e9f393620ffd3feb89037a6e7b0d0"
server_key_version: "encryptionkey@0"
I20260806 09:14:37.784322 14091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:37.815065 14091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:37.821796 14091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:37.822165 14091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:37.823339 14091 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:14:37.825074 14091 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:37.825193 14091 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:37.825384 14091 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:37.825469 14091 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:37.867573 14091 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:35121
I20260806 09:14:37.867610 14219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:35121 every 8 connection(s)
I20260806 09:14:37.869418 14091 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:14:37.873284 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 14091
I20260806 09:14:37.873591 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:14:37.874296 11261 external_mini_cluster.cc:1428] Setting key 66874d029cf6ef1fd64749a9441b8c4f
Aug 06 09:14:37 dist-test-slave-mvvj krb5kdc[13714](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007677, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:37.898871 14222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:37.874185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:53649 (local address 127.10.255.126:38011)
0806 09:14:37.874995 (+ 810us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:37.875002 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:37.876147 (+ 1145us) server_negotiation.cc:407] Connection header received
0806 09:14:37.879802 (+ 3655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:37.879808 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:37.879972 (+ 164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:37.880148 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:37.882229 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:37.883167 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:37.885268 (+ 2101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:37.885710 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:37.885864 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:37.890457 (+ 4593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:37.890467 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:37.890473 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:37.890550 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:37.894980 (+ 4430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:37.896052 (+ 1072us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:37.896057 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:37.896059 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:37.896210 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:37.896734 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:37.896739 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:37.896741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:37.897072 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:37.897256 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:37.898105 (+ 849us) server_negotiation.cc:299] Negotiation successful
0806 09:14:37.898402 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":433,"threads_started":1}
I20260806 09:14:37.900089 14223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:37.874693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:38011 (local address 127.10.255.67:53649)
0806 09:14:37.875960 (+ 1267us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:37.876022 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:37.878971 (+ 2949us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:37.880468 (+ 1497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:37.880480 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:37.881192 (+ 712us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:37.881958 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:37.881983 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:37.883405 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:37.883409 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:37.885056 (+ 1647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:37.885076 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:37.885991 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:37.886000 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:37.886258 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:37.887113 (+ 855us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:37.887139 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:37.890102 (+ 2963us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:37.895212 (+ 5110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:37.895224 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:37.895252 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:37.895814 (+ 562us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:37.896342 (+ 528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:37.896347 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:37.896351 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:37.896592 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:37.897217 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:37.897227 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:37.897669 (+ 442us) client_negotiation.cc:769] Sending connection context
0806 09:14:37.897977 (+ 308us) client_negotiation.cc:240] Negotiation successful
0806 09:14:37.898627 (+ 650us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":861,"thread_start_us":418,"threads_started":1}
I20260806 09:14:37.901937 14220 heartbeater.cc:347] Connected to a master server at 127.10.255.126:38011
I20260806 09:14:37.902310 14220 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:37.903254 14220 heartbeater.cc:511] Master 127.10.255.126:38011 requested a full tablet report, sending...
I20260806 09:14:37.905350 13759 ts_manager.cc:194] Registered new tserver with Master: a7be0a6343824633b62366c956c55c20 (127.10.255.67:35121)
I20260806 09:14:37.906617 13759 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.67@KRBTEST.COM'} at 127.10.255.67:53649
I20260806 09:14:37.907318 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 09:14:37.974392 14222 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:14:37.971152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44336 (local address 127.10.255.126:38011)
0806 09:14:37.971494 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:37.971506 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:37.972092 (+ 586us) server_negotiation.cc:407] Connection header received
0806 09:14:37.972320 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:37.972325 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:37.972442 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:37.972563 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:37.974047 (+ 1484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44336: BlockingRecv error: recv got EOF from 127.0.0.1:44336 (error 108)
Metrics: {"server-negotiator.queue_time_us":101}
I20260806 09:14:37.978026 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 13821
W20260806 09:14:37.982019 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 13821: Not authorized: Client connection negotiation failed: client connection to 127.10.255.65:34145: server requires authentication, but client does not have Kerberos credentials available
I20260806 09:14:37.982252 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 13821
I20260806 09:14:38.002349 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 13956
W20260806 09:14:38.006227 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 13956: Not authorized: Client connection negotiation failed: client connection to 127.10.255.66:37425: server requires authentication, but client does not have Kerberos credentials available
I20260806 09:14:38.006448 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 13956
W20260806 09:14:38.006546 14233 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:14:38.003634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33156 (local address 127.10.255.66:37425)
0806 09:14:38.004285 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:38.004293 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:38.004321 (+ 28us) server_negotiation.cc:407] Connection header received
0806 09:14:38.004397 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:38.004405 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:38.004640 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:38.004788 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:38.006034 (+ 1246us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33156: BlockingRecv error: recv got EOF from 127.0.0.1:33156 (error 108)
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":342,"threads_started":1}
I20260806 09:14:38.026836 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 14091
W20260806 09:14:38.031014 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 14091: Not authorized: Client connection negotiation failed: client connection to 127.10.255.67:35121: server requires authentication, but client does not have Kerberos credentials available
I20260806 09:14:38.031203 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 14091
I20260806 09:14:38.049556 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 13727
I20260806 09:14:38.051023 13790 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:38.170877 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 13727
2026-08-06T09:14:38Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (4183 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:14:38 dist-test-slave-mvvj krb5kdc[14238](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:14:38 dist-test-slave-mvvj krb5kdc[14238](info): set up 2 sockets
Aug 06 09:14:38 dist-test-slave-mvvj krb5kdc[14238](info): commencing operation
krb5kdc: starting...
W20260806 09:14:39.365262 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.145s user 0.004s sys 0.020s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:14:39 dist-test-slave-mvvj krb5kdc[14238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:14:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:14:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:14:39.626433 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:39647
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:45667
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:39647
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:40.027675 14251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:40.028456 14251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:40.028652 14251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:40.037503 14251 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:14:40.037737 14251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:40.037861 14251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:40.037985 14251 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:14:40.038079 14251 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:14:40.051256 14251 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:45667
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:39647
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:39647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:40.053155 14251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:40.054915 14251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:40.075700 14256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:40.075788 14259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:40.075861 14257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:40.076670 14251 server_base.cc:1034] running on GCE node
I20260806 09:14:40.077652 14251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:40.079730 14251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:40.081066 14251 hybrid_clock.cc:648] HybridClock initialized: now 1786007680080995 us; error 78 us; skew 500 ppm
I20260806 09:14:40.081820 14251 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:40 dist-test-slave-mvvj krb5kdc[14238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007680, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:40.087414 14251 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:14:40.090257 14251 webserver.cc:460] Webserver started at http://127.10.255.126:37303/ using document root <none> and password file <none>
I20260806 09:14:40.091531 14251 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:40.091722 14251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:40.092238 14251 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:40.095793 14251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "e44e187957f74e28ba54264077e51c6a"
format_stamp: "Formatted at 2026-08-06 09:14:40 on dist-test-slave-mvvj"
server_key: "b3846f8021c1c8d121ddd540a863c930"
server_key_iv: "a51929e1f71b093ce6aa56ec80a9a04e"
server_key_version: "encryptionkey@0"
I20260806 09:14:40.097240 14251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "e44e187957f74e28ba54264077e51c6a"
format_stamp: "Formatted at 2026-08-06 09:14:40 on dist-test-slave-mvvj"
server_key: "b3846f8021c1c8d121ddd540a863c930"
server_key_iv: "a51929e1f71b093ce6aa56ec80a9a04e"
server_key_version: "encryptionkey@0"
I20260806 09:14:40.105265 14251 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.002s sys 0.005s
I20260806 09:14:40.111040 14266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:40.113873 14251 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.001s
I20260806 09:14:40.114152 14251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "e44e187957f74e28ba54264077e51c6a"
format_stamp: "Formatted at 2026-08-06 09:14:40 on dist-test-slave-mvvj"
server_key: "b3846f8021c1c8d121ddd540a863c930"
server_key_iv: "a51929e1f71b093ce6aa56ec80a9a04e"
server_key_version: "encryptionkey@0"
I20260806 09:14:40.114418 14251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:40.146044 14251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:40.151290 14251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:40.151670 14251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:40.173969 14251 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:39647
I20260806 09:14:40.174021 14318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:39647 every 8 connection(s)
I20260806 09:14:40.175599 14251 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:14:40.179728 14319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:40.185554 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 14251
I20260806 09:14:40.185842 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:14:40.186586 11261 external_mini_cluster.cc:1428] Setting key 99ae45aa0bebe2fb0bf7ff6a8249e31a
I20260806 09:14:40.193248 14319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e44e187957f74e28ba54264077e51c6a: Bootstrap starting.
I20260806 09:14:40.197608 14319 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e44e187957f74e28ba54264077e51c6a: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:40.198861 14319 log.cc:824] T 00000000000000000000000000000000 P e44e187957f74e28ba54264077e51c6a: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:40.203125 14319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e44e187957f74e28ba54264077e51c6a: No bootstrap required, opened a new log
Aug 06 09:14:40 dist-test-slave-mvvj krb5kdc[14238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:40.213792 14319 raft_consensus.cc:348] T 00000000000000000000000000000000 P e44e187957f74e28ba54264077e51c6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e44e187957f74e28ba54264077e51c6a" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 39647 } }
I20260806 09:14:40.214208 14319 raft_consensus.cc:374] T 00000000000000000000000000000000 P e44e187957f74e28ba54264077e51c6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:40.214334 14319 raft_consensus.cc:729] T 00000000000000000000000000000000 P e44e187957f74e28ba54264077e51c6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e44e187957f74e28ba54264077e51c6a, State: Initialized, Role: FOLLOWER
I20260806 09:14:40.215044 14319 consensus_queue.cc:260] T 00000000000000000000000000000000 P e44e187957f74e28ba54264077e51c6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e44e187957f74e28ba54264077e51c6a" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 39647 } }
I20260806 09:14:40.215330 14319 raft_consensus.cc:388] T 00000000000000000000000000000000 P e44e187957f74e28ba54264077e51c6a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:14:40.215631 14319 raft_consensus.cc:482] T 00000000000000000000000000000000 P e44e187957f74e28ba54264077e51c6a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:14:40.216039 14319 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e44e187957f74e28ba54264077e51c6a [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:40.218852 14322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:40.188961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50790 (local address 127.10.255.126:39647)
0806 09:14:40.189985 (+ 1024us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:40.190016 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:40.190072 (+ 56us) server_negotiation.cc:407] Connection header received
0806 09:14:40.192618 (+ 2546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:40.192650 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:40.193275 (+ 625us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:40.193769 (+ 494us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:40.195448 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:40.197548 (+ 2100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:40.200149 (+ 2601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:40.201253 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:40.201641 (+ 388us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:40.208673 (+ 7032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:40.208688 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:40.208716 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:40.208789 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:40.213538 (+ 4749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:40.214602 (+ 1064us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:40.214610 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:40.214617 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:40.214830 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:40.215260 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:40.215264 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:40.215266 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:40.216147 (+ 881us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:40.216454 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:40.217078 (+ 624us) server_negotiation.cc:299] Negotiation successful
0806 09:14:40.217604 (+ 526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":732,"thread_start_us":495,"threads_started":1}
I20260806 09:14:40.219240 14319 raft_consensus.cc:504] T 00000000000000000000000000000000 P e44e187957f74e28ba54264077e51c6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e44e187957f74e28ba54264077e51c6a" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 39647 } }
I20260806 09:14:40.219964 14319 leader_election.cc:302] T 00000000000000000000000000000000 P e44e187957f74e28ba54264077e51c6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e44e187957f74e28ba54264077e51c6a; no voters:
I20260806 09:14:40.220688 14319 leader_election.cc:288] T 00000000000000000000000000000000 P e44e187957f74e28ba54264077e51c6a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:14:40.220829 14324 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e44e187957f74e28ba54264077e51c6a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:14:40.223662 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:14:40.223629 14319 sys_catalog.cc:564] T 00000000000000000000000000000000 P e44e187957f74e28ba54264077e51c6a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:14:40.228266 14324 raft_consensus.cc:686] T 00000000000000000000000000000000 P e44e187957f74e28ba54264077e51c6a [term 1 LEADER]: Becoming Leader. State: Replica: e44e187957f74e28ba54264077e51c6a, State: Running, Role: LEADER
I20260806 09:14:40.229290 14324 consensus_queue.cc:237] T 00000000000000000000000000000000 P e44e187957f74e28ba54264077e51c6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e44e187957f74e28ba54264077e51c6a" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 39647 } }
I20260806 09:14:40.233594 14326 sys_catalog.cc:455] T 00000000000000000000000000000000 P e44e187957f74e28ba54264077e51c6a [sys.catalog]: SysCatalogTable state changed. Reason: New leader e44e187957f74e28ba54264077e51c6a. Latest consensus state: current_term: 1 leader_uuid: "e44e187957f74e28ba54264077e51c6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e44e187957f74e28ba54264077e51c6a" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 39647 } } }
I20260806 09:14:40.234112 14326 sys_catalog.cc:458] T 00000000000000000000000000000000 P e44e187957f74e28ba54264077e51c6a [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:40.233554 14325 sys_catalog.cc:455] T 00000000000000000000000000000000 P e44e187957f74e28ba54264077e51c6a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e44e187957f74e28ba54264077e51c6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e44e187957f74e28ba54264077e51c6a" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 39647 } } }
I20260806 09:14:40.234292 14325 sys_catalog.cc:458] T 00000000000000000000000000000000 P e44e187957f74e28ba54264077e51c6a [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:40.236523 14334 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:14:40.243074 14334 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:14:40.270836 14334 catalog_manager.cc:1347] Generated new cluster ID: c0eda8232b2c4a2ba8d34b159e6c5376
I20260806 09:14:40.270998 14334 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:14:40.303194 14346 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 09:14:40.306773 14334 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:14:40.309034 14334 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:14:40.317667 14322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:40.306257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50796 (local address 127.10.255.126:39647)
0806 09:14:40.306471 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:40.306478 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:40.307569 (+ 1091us) server_negotiation.cc:407] Connection header received
0806 09:14:40.307803 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:40.307809 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:40.307955 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:40.308075 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:40.309371 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:40.310324 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:40.312804 (+ 2480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:40.313568 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:40.313706 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:40.315367 (+ 1661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:40.315373 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:40.315376 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:14:40.316369 (+ 993us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:40.316459 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:14:40.316691 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:40.316876 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:40.317058 (+ 182us) server_negotiation.cc:299] Negotiation successful
0806 09:14:40.317239 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 09:14:40.326321 14334 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e44e187957f74e28ba54264077e51c6a: Generated new TSK 0
I20260806 09:14:40.327430 14334 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:14:40.339884 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 14251
I20260806 09:14:40.341354 14313 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:40.440783 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 14251
2026-08-06T09:14:40Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2259 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:14:40 dist-test-slave-mvvj krb5kdc[14353](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:14:40 dist-test-slave-mvvj krb5kdc[14353](info): set up 2 sockets
Aug 06 09:14:40 dist-test-slave-mvvj krb5kdc[14353](info): commencing operation
krb5kdc: starting...
W20260806 09:14:41.607241 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.001s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:14:41 dist-test-slave-mvvj krb5kdc[14353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007681, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:14:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:14:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:14:41.845309 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:42939
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:42939
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:42.210340 14367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:42.210772 14367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:42.210872 14367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:42.218997 14367 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:14:42.219141 14367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:42.219192 14367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:42.219245 14367 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:14:42.219290 14367 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:14:42.230399 14367 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:42939
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:42939
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:42.231884 14367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:42.233232 14367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:42.246832 14375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:42.246917 14372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:42.246907 14373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:42.248796 14367 server_base.cc:1034] running on GCE node
I20260806 09:14:42.249828 14367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:42.251745 14367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:42.253098 14367 hybrid_clock.cc:648] HybridClock initialized: now 1786007682253038 us; error 60 us; skew 500 ppm
I20260806 09:14:42.253584 14367 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:42 dist-test-slave-mvvj krb5kdc[14353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007682, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:42.263243 14367 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:14:42.265383 14367 webserver.cc:460] Webserver started at http://127.10.255.126:46305/ using document root <none> and password file <none>
I20260806 09:14:42.266208 14367 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:42.266351 14367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:42.266685 14367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:42.270484 14367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "f9540448868f454aa1679310f74d2b68"
format_stamp: "Formatted at 2026-08-06 09:14:42 on dist-test-slave-mvvj"
server_key: "d9b4024b19ae2276f85dd91c38b2efdf"
server_key_iv: "19e39073879b14954f7a8e144f85f233"
server_key_version: "encryptionkey@0"
I20260806 09:14:42.271418 14367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "f9540448868f454aa1679310f74d2b68"
format_stamp: "Formatted at 2026-08-06 09:14:42 on dist-test-slave-mvvj"
server_key: "d9b4024b19ae2276f85dd91c38b2efdf"
server_key_iv: "19e39073879b14954f7a8e144f85f233"
server_key_version: "encryptionkey@0"
I20260806 09:14:42.278236 14367 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260806 09:14:42.282784 14382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:42.284713 14367 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260806 09:14:42.284938 14367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "f9540448868f454aa1679310f74d2b68"
format_stamp: "Formatted at 2026-08-06 09:14:42 on dist-test-slave-mvvj"
server_key: "d9b4024b19ae2276f85dd91c38b2efdf"
server_key_iv: "19e39073879b14954f7a8e144f85f233"
server_key_version: "encryptionkey@0"
I20260806 09:14:42.285158 14367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:42.315120 14367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:42.322063 14367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:42.322463 14367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:42.343899 14367 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:42939
I20260806 09:14:42.343947 14435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:42939 every 8 connection(s)
I20260806 09:14:42.345566 14367 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:14:42.349898 14436 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:42.350009 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 14367
I20260806 09:14:42.350227 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:14:42.351085 11261 external_mini_cluster.cc:1428] Setting key f39e28613384085cd277f3361298c5f5
I20260806 09:14:42.367050 14436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9540448868f454aa1679310f74d2b68: Bootstrap starting.
Aug 06 09:14:42 dist-test-slave-mvvj krb5kdc[14353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007681, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:42.371635 14436 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f9540448868f454aa1679310f74d2b68: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:42.373286 14436 log.cc:824] T 00000000000000000000000000000000 P f9540448868f454aa1679310f74d2b68: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:42.377329 14436 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9540448868f454aa1679310f74d2b68: No bootstrap required, opened a new log
I20260806 09:14:42.380832 14439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:42.353565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45442 (local address 127.10.255.126:42939)
0806 09:14:42.354529 (+ 964us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:42.354570 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:42.354640 (+ 70us) server_negotiation.cc:407] Connection header received
0806 09:14:42.357646 (+ 3006us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:42.357682 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:42.358281 (+ 599us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:42.358754 (+ 473us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:42.360801 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:42.362307 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:42.364490 (+ 2183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:42.365347 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:42.365584 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:42.370871 (+ 5287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:42.370882 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:42.370901 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:42.370962 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:42.375131 (+ 4169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:42.376257 (+ 1126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:42.376265 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:42.376273 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:42.376517 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:42.377114 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:42.377119 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:42.377122 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:42.377866 (+ 744us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:42.378329 (+ 463us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:42.378820 (+ 491us) server_negotiation.cc:299] Negotiation successful
0806 09:14:42.379369 (+ 549us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":700,"thread_start_us":469,"threads_started":1}
I20260806 09:14:42.387003 14436 raft_consensus.cc:348] T 00000000000000000000000000000000 P f9540448868f454aa1679310f74d2b68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9540448868f454aa1679310f74d2b68" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42939 } }
I20260806 09:14:42.387477 14436 raft_consensus.cc:374] T 00000000000000000000000000000000 P f9540448868f454aa1679310f74d2b68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:42.387589 14436 raft_consensus.cc:729] T 00000000000000000000000000000000 P f9540448868f454aa1679310f74d2b68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9540448868f454aa1679310f74d2b68, State: Initialized, Role: FOLLOWER
I20260806 09:14:42.388391 14436 consensus_queue.cc:260] T 00000000000000000000000000000000 P f9540448868f454aa1679310f74d2b68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9540448868f454aa1679310f74d2b68" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42939 } }
I20260806 09:14:42.388701 14436 raft_consensus.cc:388] T 00000000000000000000000000000000 P f9540448868f454aa1679310f74d2b68 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:14:42.388891 14436 raft_consensus.cc:482] T 00000000000000000000000000000000 P f9540448868f454aa1679310f74d2b68 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:14:42.389096 14436 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f9540448868f454aa1679310f74d2b68 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:42.392336 14436 raft_consensus.cc:504] T 00000000000000000000000000000000 P f9540448868f454aa1679310f74d2b68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9540448868f454aa1679310f74d2b68" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42939 } }
I20260806 09:14:42.393016 14436 leader_election.cc:302] T 00000000000000000000000000000000 P f9540448868f454aa1679310f74d2b68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f9540448868f454aa1679310f74d2b68; no voters:
I20260806 09:14:42.393767 14436 leader_election.cc:288] T 00000000000000000000000000000000 P f9540448868f454aa1679310f74d2b68 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:14:42.394029 14441 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f9540448868f454aa1679310f74d2b68 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:14:42.394879 14441 raft_consensus.cc:686] T 00000000000000000000000000000000 P f9540448868f454aa1679310f74d2b68 [term 1 LEADER]: Becoming Leader. State: Replica: f9540448868f454aa1679310f74d2b68, State: Running, Role: LEADER
I20260806 09:14:42.395587 14441 consensus_queue.cc:237] T 00000000000000000000000000000000 P f9540448868f454aa1679310f74d2b68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9540448868f454aa1679310f74d2b68" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42939 } }
I20260806 09:14:42.396690 14436 sys_catalog.cc:564] T 00000000000000000000000000000000 P f9540448868f454aa1679310f74d2b68 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:14:42.400166 14442 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9540448868f454aa1679310f74d2b68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f9540448868f454aa1679310f74d2b68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9540448868f454aa1679310f74d2b68" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42939 } } }
I20260806 09:14:42.400014 14443 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9540448868f454aa1679310f74d2b68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f9540448868f454aa1679310f74d2b68. Latest consensus state: current_term: 1 leader_uuid: "f9540448868f454aa1679310f74d2b68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f9540448868f454aa1679310f74d2b68" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42939 } } }
I20260806 09:14:42.400604 14443 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9540448868f454aa1679310f74d2b68 [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:42.403177 14442 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9540448868f454aa1679310f74d2b68 [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:42.408639 14449 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:14:42.414196 14449 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:14:42.424043 14449 catalog_manager.cc:1347] Generated new cluster ID: ce422940637f4fd0bd3bf579e9a700da
I20260806 09:14:42.424288 14449 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:14:42.440686 14449 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:14:42.442080 14449 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:14:42.448462 14449 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f9540448868f454aa1679310f74d2b68: Generated new TSK 0
I20260806 09:14:42.449415 14449 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.255.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
I20260806 09:14:42.508316 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42939
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:42.876716 14463 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:42.877059 14463 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:42.877221 14463 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:42.885865 14463 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:42.886023 14463 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:42.886202 14463 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:14:42.897372 14463 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42939
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:42.898916 14463 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:42.900419 14463 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:42.915449 14471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:42.915752 14469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:42.916200 14468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:42.921904 14463 server_base.cc:1034] running on GCE node
I20260806 09:14:42.922825 14463 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:42.924119 14463 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:42.925367 14463 hybrid_clock.cc:648] HybridClock initialized: now 1786007682925277 us; error 72 us; skew 500 ppm
I20260806 09:14:42.925814 14463 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:42 dist-test-slave-mvvj krb5kdc[14353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007682, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:42.929587 14463 init.cc:377] Logged in from keytab as kudu/127.10.255.65@KRBTEST.COM (short username kudu)
I20260806 09:14:42.931368 14463 webserver.cc:460] Webserver started at http://127.10.255.65:39085/ using document root <none> and password file <none>
I20260806 09:14:42.932337 14463 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:42.932495 14463 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:42.932894 14463 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:42.936304 14463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "b974d8b9330c4c9ab421fe0f94d58f22"
format_stamp: "Formatted at 2026-08-06 09:14:42 on dist-test-slave-mvvj"
server_key: "ba70e0daf39c2dc51cf57b3053136fe5"
server_key_iv: "fd9608e908cc921411344a889bc23e82"
server_key_version: "encryptionkey@0"
I20260806 09:14:42.937273 14463 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "b974d8b9330c4c9ab421fe0f94d58f22"
format_stamp: "Formatted at 2026-08-06 09:14:42 on dist-test-slave-mvvj"
server_key: "ba70e0daf39c2dc51cf57b3053136fe5"
server_key_iv: "fd9608e908cc921411344a889bc23e82"
server_key_version: "encryptionkey@0"
I20260806 09:14:42.943295 14463 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.002s
I20260806 09:14:42.947777 14478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:42.949566 14463 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:14:42.949803 14463 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "b974d8b9330c4c9ab421fe0f94d58f22"
format_stamp: "Formatted at 2026-08-06 09:14:42 on dist-test-slave-mvvj"
server_key: "ba70e0daf39c2dc51cf57b3053136fe5"
server_key_iv: "fd9608e908cc921411344a889bc23e82"
server_key_version: "encryptionkey@0"
I20260806 09:14:42.950040 14463 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:42.965699 14463 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:42.970474 14463 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:42.970806 14463 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:42.971967 14463 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:14:42.973500 14463 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:42.973577 14463 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:42.973727 14463 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:42.973805 14463 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:43.011708 14463 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:39061
I20260806 09:14:43.011761 14592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:39061 every 8 connection(s)
I20260806 09:14:43.013180 14463 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:14:43.021858 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 14463
I20260806 09:14:43.022094 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:14:43.022830 11261 external_mini_cluster.cc:1428] Setting key 905acaf0d9b607ef36df511a793945cf
Aug 06 09:14:43 dist-test-slave-mvvj krb5kdc[14353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007682, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:43.038568 14595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:43.016265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:33369 (local address 127.10.255.126:42939)
0806 09:14:43.016759 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:43.016763 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:43.017810 (+ 1047us) server_negotiation.cc:407] Connection header received
0806 09:14:43.019917 (+ 2107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:43.019925 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:43.020028 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:43.020158 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:43.022536 (+ 2378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:43.023380 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:43.025619 (+ 2239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:43.026079 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:43.026229 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:43.030840 (+ 4611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:43.030846 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:43.030849 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:43.030892 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:43.034495 (+ 3603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:43.035482 (+ 987us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:43.035494 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:43.035497 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:43.035666 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:43.036260 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:43.036271 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:43.036274 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:43.036586 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:43.036768 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:43.037797 (+ 1029us) server_negotiation.cc:299] Negotiation successful
0806 09:14:43.038158 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":389,"thread_start_us":274,"threads_started":1}
I20260806 09:14:43.039999 14596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:43.016789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42939 (local address 127.10.255.65:33369)
0806 09:14:43.017624 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:43.017671 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:43.019523 (+ 1852us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:43.020440 (+ 917us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:43.020450 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:43.021276 (+ 826us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:43.022289 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:43.022316 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:43.023595 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:43.023600 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:43.025428 (+ 1828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:43.025448 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:43.026358 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:43.026367 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:43.026648 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:43.027538 (+ 890us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:43.027566 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:43.030510 (+ 2944us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:43.034740 (+ 4230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:43.034752 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:43.034778 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:43.035319 (+ 541us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:43.035806 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:43.035812 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:43.035816 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:43.036120 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:43.036738 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:43.036760 (+ 22us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:43.037200 (+ 440us) client_negotiation.cc:769] Sending connection context
0806 09:14:43.037655 (+ 455us) client_negotiation.cc:240] Negotiation successful
0806 09:14:43.038335 (+ 680us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":317,"threads_started":1}
I20260806 09:14:43.042292 14593 heartbeater.cc:347] Connected to a master server at 127.10.255.126:42939
I20260806 09:14:43.042691 14593 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:43.043586 14593 heartbeater.cc:511] Master 127.10.255.126:42939 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.255.66@KRBTEST.COM; defaulting to no policy
I20260806 09:14:43.046272 14400 ts_manager.cc:194] Registered new tserver with Master: b974d8b9330c4c9ab421fe0f94d58f22 (127.10.255.65:39061)
I20260806 09:14:43.047912 14400 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.65@KRBTEST.COM'} at 127.10.255.65:33369
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
I20260806 09:14:43.076102 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42939
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:43.471241 14600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:43.471621 14600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:43.471803 14600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:43.479959 14600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:43.480129 14600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:43.480324 14600 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:14:43.491272 14600 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42939
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:43.492794 14600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:43.494233 14600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:43.510269 14606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:43.510309 14608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:43.510607 14605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:43.510972 14600 server_base.cc:1034] running on GCE node
I20260806 09:14:43.511763 14600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:43.513033 14600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:43.514326 14600 hybrid_clock.cc:648] HybridClock initialized: now 1786007683514249 us; error 79 us; skew 500 ppm
I20260806 09:14:43.514734 14600 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:43 dist-test-slave-mvvj krb5kdc[14353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007683, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:43.519076 14600 init.cc:377] Logged in from keytab as kudu/127.10.255.66@KRBTEST.COM (short username kudu)
I20260806 09:14:43.521137 14600 webserver.cc:460] Webserver started at http://127.10.255.66:37729/ using document root <none> and password file <none>
I20260806 09:14:43.521997 14600 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:43.522173 14600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:43.522548 14600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:43.525964 14600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "d2c0af686a9a42e29e5ccc4d4639c392"
format_stamp: "Formatted at 2026-08-06 09:14:43 on dist-test-slave-mvvj"
server_key: "2aba0824e166d43098bc63e9684c7f9a"
server_key_iv: "f61bea858d7aa12b75becf7245957a13"
server_key_version: "encryptionkey@0"
I20260806 09:14:43.526913 14600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "d2c0af686a9a42e29e5ccc4d4639c392"
format_stamp: "Formatted at 2026-08-06 09:14:43 on dist-test-slave-mvvj"
server_key: "2aba0824e166d43098bc63e9684c7f9a"
server_key_iv: "f61bea858d7aa12b75becf7245957a13"
server_key_version: "encryptionkey@0"
I20260806 09:14:43.533149 14600 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260806 09:14:43.537467 14615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:43.539561 14600 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260806 09:14:43.539960 14600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "d2c0af686a9a42e29e5ccc4d4639c392"
format_stamp: "Formatted at 2026-08-06 09:14:43 on dist-test-slave-mvvj"
server_key: "2aba0824e166d43098bc63e9684c7f9a"
server_key_iv: "f61bea858d7aa12b75becf7245957a13"
server_key_version: "encryptionkey@0"
I20260806 09:14:43.540205 14600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:43.560045 14600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:43.565414 14600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:43.565768 14600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:43.567026 14600 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:14:43.568743 14600 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:43.568861 14600 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:43.569017 14600 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:43.569089 14600 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:43.607156 14600 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:43997
I20260806 09:14:43.607179 14730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:43997 every 8 connection(s)
I20260806 09:14:43.609011 14600 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:14:43.612345 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 14600
I20260806 09:14:43.612646 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:14:43.613262 11261 external_mini_cluster.cc:1428] Setting key 0090220ecb4cfe1ab29649c3426655b0
Aug 06 09:14:43 dist-test-slave-mvvj krb5kdc[14353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007683, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.255.67@KRBTEST.COM; defaulting to no policy
I20260806 09:14:43.639227 14733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:43.612827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:34281 (local address 127.10.255.126:42939)
0806 09:14:43.613379 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:43.613385 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:43.615175 (+ 1790us) server_negotiation.cc:407] Connection header received
0806 09:14:43.617980 (+ 2805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:43.617987 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:43.618089 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:43.618211 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:43.620120 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:43.620868 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:43.623229 (+ 2361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:43.624326 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:43.624585 (+ 259us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:43.629559 (+ 4974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:43.629579 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:43.629588 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:43.629646 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:43.634126 (+ 4480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:43.635729 (+ 1603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:43.635740 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:43.635746 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:43.636016 (+ 270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:43.636836 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:43.636844 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:43.636848 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:43.637307 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:43.637449 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:43.638648 (+ 1199us) server_negotiation.cc:299] Negotiation successful
0806 09:14:43.638883 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":311,"threads_started":1}
I20260806 09:14:43.640594 14734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:43.613415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42939 (local address 127.10.255.66:34281)
0806 09:14:43.614572 (+ 1157us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:43.614989 (+ 417us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:43.617610 (+ 2621us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:43.618525 (+ 915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:43.618535 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:43.619144 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:43.619822 (+ 678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:43.619919 (+ 97us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:43.621096 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:43.621102 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:43.622929 (+ 1827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:43.622959 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:43.624747 (+ 1788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:43.624754 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:43.625017 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:43.625889 (+ 872us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:43.625922 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:43.629178 (+ 3256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:43.634537 (+ 5359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:43.634552 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:43.634577 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:43.635475 (+ 898us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:43.636352 (+ 877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:43.636357 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:43.636359 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:43.636651 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:43.637510 (+ 859us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:43.637518 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:43.638006 (+ 488us) client_negotiation.cc:769] Sending connection context
0806 09:14:43.638521 (+ 515us) client_negotiation.cc:240] Negotiation successful
0806 09:14:43.639046 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":747,"thread_start_us":473,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.67@KRBTEST.COM" created.
I20260806 09:14:43.642865 14731 heartbeater.cc:347] Connected to a master server at 127.10.255.126:42939
I20260806 09:14:43.643245 14731 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:43.644330 14731 heartbeater.cc:511] Master 127.10.255.126:42939 requested a full tablet report, sending...
I20260806 09:14:43.646420 14400 ts_manager.cc:194] Registered new tserver with Master: d2c0af686a9a42e29e5ccc4d4639c392 (127.10.255.66:43997)
I20260806 09:14:43.648007 14400 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.66@KRBTEST.COM'} at 127.10.255.66:34281
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
I20260806 09:14:43.677412 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42939
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:14:44.051676 14593 heartbeater.cc:503] Master 127.10.255.126:42939 was elected leader, sending a full tablet report...
W20260806 09:14:44.069437 14737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:44.069833 14737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:44.070015 14737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:44.078048 14737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:44.078254 14737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:44.078488 14737 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:14:44.090095 14737 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42939
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:44.091756 14737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:44.093302 14737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:44.109118 14745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:44.109165 14743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:44.109062 14742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:44.114989 14737 server_base.cc:1034] running on GCE node
I20260806 09:14:44.116142 14737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:44.117731 14737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:44.119072 14737 hybrid_clock.cc:648] HybridClock initialized: now 1786007684119014 us; error 55 us; skew 500 ppm
I20260806 09:14:44.119621 14737 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:44 dist-test-slave-mvvj krb5kdc[14353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007684, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:44.123956 14737 init.cc:377] Logged in from keytab as kudu/127.10.255.67@KRBTEST.COM (short username kudu)
I20260806 09:14:44.126096 14737 webserver.cc:460] Webserver started at http://127.10.255.67:33103/ using document root <none> and password file <none>
I20260806 09:14:44.127035 14737 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:44.127208 14737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:44.127568 14737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:44.131346 14737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "7a667f1ff0b440e7a24f31ac28060e67"
format_stamp: "Formatted at 2026-08-06 09:14:44 on dist-test-slave-mvvj"
server_key: "bc5b83b3281d3d5e13512e6956aef539"
server_key_iv: "184e8a3a43307dfd067517408d0bc9a9"
server_key_version: "encryptionkey@0"
I20260806 09:14:44.132434 14737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "7a667f1ff0b440e7a24f31ac28060e67"
format_stamp: "Formatted at 2026-08-06 09:14:44 on dist-test-slave-mvvj"
server_key: "bc5b83b3281d3d5e13512e6956aef539"
server_key_iv: "184e8a3a43307dfd067517408d0bc9a9"
server_key_version: "encryptionkey@0"
I20260806 09:14:44.139225 14737 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260806 09:14:44.143968 14752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:44.145874 14737 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:14:44.146126 14737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "7a667f1ff0b440e7a24f31ac28060e67"
format_stamp: "Formatted at 2026-08-06 09:14:44 on dist-test-slave-mvvj"
server_key: "bc5b83b3281d3d5e13512e6956aef539"
server_key_iv: "184e8a3a43307dfd067517408d0bc9a9"
server_key_version: "encryptionkey@0"
I20260806 09:14:44.146409 14737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:44.174139 14737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:44.179417 14737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:44.179788 14737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:44.181046 14737 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:14:44.182713 14737 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:44.182829 14737 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:44.182999 14737 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:44.183073 14737 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:44.224157 14737 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:40733
I20260806 09:14:44.224191 14868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:40733 every 8 connection(s)
I20260806 09:14:44.225668 14737 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:14:44.233680 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 14737
I20260806 09:14:44.233898 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:14:44.234393 11261 external_mini_cluster.cc:1428] Setting key 9671a99902371774397b04437c84df13
Aug 06 09:14:44 dist-test-slave-mvvj krb5kdc[14353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007684, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:44.253317 14871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:44.228594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:34451 (local address 127.10.255.126:42939)
0806 09:14:44.229111 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:44.229116 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:44.230131 (+ 1015us) server_negotiation.cc:407] Connection header received
0806 09:14:44.232177 (+ 2046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:44.232186 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:44.232319 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:44.232448 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:44.234163 (+ 1715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:44.235150 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:44.238036 (+ 2886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:44.238767 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:44.238914 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:44.244870 (+ 5956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:44.244877 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:44.244881 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:44.244925 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:44.248847 (+ 3922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:44.250144 (+ 1297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:44.250149 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:44.250151 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:44.250403 (+ 252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:44.250982 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:44.250990 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:44.250998 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:44.251443 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:44.251634 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:44.252656 (+ 1022us) server_negotiation.cc:299] Negotiation successful
0806 09:14:44.252924 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":251,"threads_started":1}
I20260806 09:14:44.254462 14872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:44.229130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42939 (local address 127.10.255.67:34451)
0806 09:14:44.229903 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:44.229948 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:44.231799 (+ 1851us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:44.232718 (+ 919us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:44.232727 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:44.233289 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:44.233934 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:44.233966 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:44.235400 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:44.235406 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:44.237817 (+ 2411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:44.237843 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:44.239245 (+ 1402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:44.239258 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:44.239520 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:44.240802 (+ 1282us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:44.240884 (+ 82us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:44.244526 (+ 3642us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:44.249093 (+ 4567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:44.249112 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:44.249136 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:44.249926 (+ 790us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:44.250549 (+ 623us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:44.250555 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:44.250559 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:44.250854 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:44.251622 (+ 768us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:44.251632 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:44.252152 (+ 520us) client_negotiation.cc:769] Sending connection context
0806 09:14:44.252465 (+ 313us) client_negotiation.cc:240] Negotiation successful
0806 09:14:44.253109 (+ 644us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":306,"threads_started":1}
I20260806 09:14:44.256771 14869 heartbeater.cc:347] Connected to a master server at 127.10.255.126:42939
I20260806 09:14:44.257174 14869 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:44.258091 14869 heartbeater.cc:511] Master 127.10.255.126:42939 requested a full tablet report, sending...
I20260806 09:14:44.260566 14400 ts_manager.cc:194] Registered new tserver with Master: 7a667f1ff0b440e7a24f31ac28060e67 (127.10.255.67:40733)
I20260806 09:14:44.261485 14400 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.67@KRBTEST.COM'} at 127.10.255.67:34451
I20260806 09:14:44.266175 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 09:14:44 dist-test-slave-mvvj krb5kdc[14353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007684, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 06 09:14:44 dist-test-slave-mvvj krb5kdc[14353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007684, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:44.324339 14871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:44.306925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45448 (local address 127.10.255.126:42939)
0806 09:14:44.307145 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:44.307150 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:44.307934 (+ 784us) server_negotiation.cc:407] Connection header received
0806 09:14:44.308091 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:44.308096 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:44.308195 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:44.308329 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:44.309914 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:44.310741 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:44.312374 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:44.312828 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:44.312999 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:44.318220 (+ 5221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:44.318227 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:44.318231 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:44.318277 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:44.321248 (+ 2971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:44.322101 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:44.322106 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:44.322109 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:44.322246 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:44.322712 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:44.322716 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:44.322718 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:44.323086 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:44.323353 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:44.323706 (+ 353us) server_negotiation.cc:299] Negotiation successful
0806 09:14:44.323990 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
W20260806 09:14:44.324977 14400 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:45448
I20260806 09:14:44.327117 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 14463
Aug 06 09:14:44 dist-test-slave-mvvj krb5kdc[14353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007684, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.10.255.65@KRBTEST.COM
I20260806 09:14:44.349519 14881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:44.328576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42276 (local address 127.10.255.65:39061)
0806 09:14:44.330119 (+ 1543us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:44.330129 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:44.330167 (+ 38us) server_negotiation.cc:407] Connection header received
0806 09:14:44.330287 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:44.330295 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:44.330532 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:44.330744 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:44.332576 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:44.333936 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:44.335602 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:44.336515 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:44.336665 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:44.342431 (+ 5766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:44.342461 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:44.342479 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:44.342539 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:44.346012 (+ 3473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:44.347148 (+ 1136us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:44.347157 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:44.347159 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:44.347329 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:44.347769 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:44.347773 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:44.347776 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:44.348271 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:44.348544 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:44.348948 (+ 404us) server_negotiation.cc:299] Negotiation successful
0806 09:14:44.349207 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1325,"thread_start_us":1164,"threads_started":1}
W20260806 09:14:44.351145 14588 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:42276
W20260806 09:14:44.352674 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 14463: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 09:14:44.352941 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 14463
I20260806 09:14:44.372567 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 14600
Aug 06 09:14:44 dist-test-slave-mvvj krb5kdc[14353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007684, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.10.255.66@KRBTEST.COM
I20260806 09:14:44.391515 14882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:44.373599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57334 (local address 127.10.255.66:43997)
0806 09:14:44.374177 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:44.374185 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:44.374211 (+ 26us) server_negotiation.cc:407] Connection header received
0806 09:14:44.374279 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:44.374286 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:44.374526 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:44.374717 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:44.376507 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:44.377566 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:44.378984 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:44.379577 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:44.379783 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:44.384377 (+ 4594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:44.384395 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:44.384412 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:44.384463 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:44.387974 (+ 3511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:44.388914 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:44.388931 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:44.388933 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:44.389114 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:44.389603 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:44.389608 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:44.389614 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:44.390085 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:44.390478 (+ 393us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:44.390887 (+ 409us) server_negotiation.cc:299] Negotiation successful
0806 09:14:44.391179 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":266,"threads_started":1}
W20260806 09:14:44.393286 14726 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:57334
W20260806 09:14:44.394685 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 14600: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 09:14:44.394910 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 14600
I20260806 09:14:44.413426 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 14737
Aug 06 09:14:44 dist-test-slave-mvvj krb5kdc[14353](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007684, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.10.255.67@KRBTEST.COM
I20260806 09:14:44.433377 14883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:44.414682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37036 (local address 127.10.255.67:40733)
0806 09:14:44.415446 (+ 764us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:44.415454 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:44.415486 (+ 32us) server_negotiation.cc:407] Connection header received
0806 09:14:44.415601 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:44.415609 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:44.416121 (+ 512us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:44.416334 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:44.417835 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:44.418976 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:44.420393 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:44.421064 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:44.421227 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:44.426282 (+ 5055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:44.426300 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:44.426318 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:44.426370 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:44.429916 (+ 3546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:44.430807 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:44.430816 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:44.430818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:44.430985 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:44.431404 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:44.431420 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:44.431423 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:44.431823 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:44.432231 (+ 408us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:44.432628 (+ 397us) server_negotiation.cc:299] Negotiation successful
0806 09:14:44.432949 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":430,"threads_started":1}
W20260806 09:14:44.435353 14864 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:37036
W20260806 09:14:44.437024 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 14737: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 09:14:44.437240 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 14737
I20260806 09:14:44.455893 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 14367
I20260806 09:14:44.457263 14431 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:44.572700 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 14367
2026-08-06T09:14:44Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (4138 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:14:44 dist-test-slave-mvvj krb5kdc[14887](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:14:44 dist-test-slave-mvvj krb5kdc[14887](info): set up 2 sockets
Aug 06 09:14:44 dist-test-slave-mvvj krb5kdc[14887](info): commencing operation
krb5kdc: starting...
W20260806 09:14:45.715739 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.097s user 0.000s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:14:45 dist-test-slave-mvvj krb5kdc[14887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:14:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:14:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:14:45.951954 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:43073
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:37321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:43073
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:46.303812 14900 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:46.304222 14900 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:46.304317 14900 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:46.312114 14900 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:14:46.312258 14900 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:46.312309 14900 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:46.312361 14900 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:14:46.312441 14900 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:14:46.323594 14900 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:37321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:43073
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:43073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:46.325081 14900 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:46.326500 14900 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:46.340250 14905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:46.340266 14906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:46.340462 14908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:46.342387 14900 server_base.cc:1034] running on GCE node
I20260806 09:14:46.344106 14900 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:46.346625 14900 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:46.347947 14900 hybrid_clock.cc:648] HybridClock initialized: now 1786007686347883 us; error 54 us; skew 500 ppm
I20260806 09:14:46.348414 14900 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:46 dist-test-slave-mvvj krb5kdc[14887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007686, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:46.352039 14900 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:14:46.353801 14900 webserver.cc:460] Webserver started at http://127.10.255.126:43019/ using document root <none> and password file <none>
I20260806 09:14:46.354548 14900 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:46.354684 14900 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:46.355033 14900 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:46.358284 14900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "f0eadca48aa84c3b9d343bd40d513b5a"
format_stamp: "Formatted at 2026-08-06 09:14:46 on dist-test-slave-mvvj"
server_key: "bf9e5dbbec98e532b4cc5b72c91f449c"
server_key_iv: "26e7ceffa84a86ef5cfdd10ebd956ae0"
server_key_version: "encryptionkey@0"
I20260806 09:14:46.359211 14900 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "f0eadca48aa84c3b9d343bd40d513b5a"
format_stamp: "Formatted at 2026-08-06 09:14:46 on dist-test-slave-mvvj"
server_key: "bf9e5dbbec98e532b4cc5b72c91f449c"
server_key_iv: "26e7ceffa84a86ef5cfdd10ebd956ae0"
server_key_version: "encryptionkey@0"
I20260806 09:14:46.365056 14900 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260806 09:14:46.369815 14915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:46.371615 14900 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 09:14:46.371937 14900 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "f0eadca48aa84c3b9d343bd40d513b5a"
format_stamp: "Formatted at 2026-08-06 09:14:46 on dist-test-slave-mvvj"
server_key: "bf9e5dbbec98e532b4cc5b72c91f449c"
server_key_iv: "26e7ceffa84a86ef5cfdd10ebd956ae0"
server_key_version: "encryptionkey@0"
I20260806 09:14:46.372210 14900 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:46.395895 14900 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:46.400990 14900 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:46.401322 14900 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:46.423039 14900 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:43073
I20260806 09:14:46.423105 14968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:43073 every 8 connection(s)
I20260806 09:14:46.424757 14900 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:14:46.429315 14969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:46.430650 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 14900
I20260806 09:14:46.430939 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:14:46.431607 11261 external_mini_cluster.cc:1428] Setting key 95b47791c6b2cf189ee67158e3356eb6
I20260806 09:14:46.445776 14969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0eadca48aa84c3b9d343bd40d513b5a: Bootstrap starting.
Aug 06 09:14:46 dist-test-slave-mvvj krb5kdc[14887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:46.450073 14969 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0eadca48aa84c3b9d343bd40d513b5a: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:46.451603 14969 log.cc:824] T 00000000000000000000000000000000 P f0eadca48aa84c3b9d343bd40d513b5a: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:46.455736 14969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0eadca48aa84c3b9d343bd40d513b5a: No bootstrap required, opened a new log
I20260806 09:14:46.460384 14972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:46.434187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54000 (local address 127.10.255.126:43073)
0806 09:14:46.435296 (+ 1109us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:46.435309 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:46.435366 (+ 57us) server_negotiation.cc:407] Connection header received
0806 09:14:46.437376 (+ 2010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:46.437413 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:46.437941 (+ 528us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:46.438397 (+ 456us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:46.440625 (+ 2228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:46.442138 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:46.444085 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:46.444894 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:46.445063 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:46.450256 (+ 5193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:46.450271 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:46.450296 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:46.450356 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:46.454636 (+ 4280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:46.455640 (+ 1004us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:46.455652 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:46.455661 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:46.455992 (+ 331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:46.456510 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:46.456515 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:46.456518 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:46.457342 (+ 824us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:46.457666 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:46.458186 (+ 520us) server_negotiation.cc:299] Negotiation successful
0806 09:14:46.458749 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":835,"thread_start_us":571,"threads_started":1}
I20260806 09:14:46.466259 14969 raft_consensus.cc:348] T 00000000000000000000000000000000 P f0eadca48aa84c3b9d343bd40d513b5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0eadca48aa84c3b9d343bd40d513b5a" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 43073 } }
I20260806 09:14:46.466657 14969 raft_consensus.cc:374] T 00000000000000000000000000000000 P f0eadca48aa84c3b9d343bd40d513b5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:46.466810 14969 raft_consensus.cc:729] T 00000000000000000000000000000000 P f0eadca48aa84c3b9d343bd40d513b5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0eadca48aa84c3b9d343bd40d513b5a, State: Initialized, Role: FOLLOWER
I20260806 09:14:46.467466 14969 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0eadca48aa84c3b9d343bd40d513b5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0eadca48aa84c3b9d343bd40d513b5a" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 43073 } }
I20260806 09:14:46.467743 14969 raft_consensus.cc:388] T 00000000000000000000000000000000 P f0eadca48aa84c3b9d343bd40d513b5a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:14:46.467954 14969 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0eadca48aa84c3b9d343bd40d513b5a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:14:46.468155 14969 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f0eadca48aa84c3b9d343bd40d513b5a [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:46.470539 14969 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0eadca48aa84c3b9d343bd40d513b5a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0eadca48aa84c3b9d343bd40d513b5a" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 43073 } }
I20260806 09:14:46.471115 14969 leader_election.cc:302] T 00000000000000000000000000000000 P f0eadca48aa84c3b9d343bd40d513b5a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f0eadca48aa84c3b9d343bd40d513b5a; no voters:
I20260806 09:14:46.471740 14969 leader_election.cc:288] T 00000000000000000000000000000000 P f0eadca48aa84c3b9d343bd40d513b5a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:14:46.472040 14974 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0eadca48aa84c3b9d343bd40d513b5a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:14:46.472746 14974 raft_consensus.cc:686] T 00000000000000000000000000000000 P f0eadca48aa84c3b9d343bd40d513b5a [term 1 LEADER]: Becoming Leader. State: Replica: f0eadca48aa84c3b9d343bd40d513b5a, State: Running, Role: LEADER
I20260806 09:14:46.473307 14974 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0eadca48aa84c3b9d343bd40d513b5a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0eadca48aa84c3b9d343bd40d513b5a" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 43073 } }
I20260806 09:14:46.474251 14969 sys_catalog.cc:564] T 00000000000000000000000000000000 P f0eadca48aa84c3b9d343bd40d513b5a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:14:46.476197 14975 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0eadca48aa84c3b9d343bd40d513b5a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f0eadca48aa84c3b9d343bd40d513b5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0eadca48aa84c3b9d343bd40d513b5a" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 43073 } } }
I20260806 09:14:46.477070 14975 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0eadca48aa84c3b9d343bd40d513b5a [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:46.477010 14976 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0eadca48aa84c3b9d343bd40d513b5a [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0eadca48aa84c3b9d343bd40d513b5a. Latest consensus state: current_term: 1 leader_uuid: "f0eadca48aa84c3b9d343bd40d513b5a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f0eadca48aa84c3b9d343bd40d513b5a" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 43073 } } }
I20260806 09:14:46.477488 14976 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0eadca48aa84c3b9d343bd40d513b5a [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:46.479256 14980 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:14:46.484932 14980 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:14:46.497017 14980 catalog_manager.cc:1347] Generated new cluster ID: 52489ab302e3411fb8ae316948735c09
I20260806 09:14:46.497169 14980 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:14:46.522729 14980 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:14:46.524871 14980 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:14:46.532683 14980 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f0eadca48aa84c3b9d343bd40d513b5a: Generated new TSK 0
I20260806 09:14:46.533938 14980 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.255.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
I20260806 09:14:46.596473 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:43073
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:37321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:46.980324 14996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:46.980779 14996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:46.980978 14996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:46.988983 14996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:46.989171 14996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:46.989363 14996 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:14:47.000630 14996 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:37321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:43073
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:47.002105 14996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:47.003502 14996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:47.019677 15001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:47.019634 15002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:47.019603 15004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:47.021113 14996 server_base.cc:1034] running on GCE node
I20260806 09:14:47.021984 14996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:47.023216 14996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:47.024454 14996 hybrid_clock.cc:648] HybridClock initialized: now 1786007687024392 us; error 37 us; skew 500 ppm
I20260806 09:14:47.024842 14996 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:47 dist-test-slave-mvvj krb5kdc[14887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007687, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:47.028518 14996 init.cc:377] Logged in from keytab as kudu/127.10.255.65@KRBTEST.COM (short username kudu)
I20260806 09:14:47.030370 14996 webserver.cc:460] Webserver started at http://127.10.255.65:46473/ using document root <none> and password file <none>
I20260806 09:14:47.031253 14996 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:47.031435 14996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:47.031867 14996 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:47.035593 14996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "caa63860ef2d4f2bbd1a7f1147c44bcc"
format_stamp: "Formatted at 2026-08-06 09:14:47 on dist-test-slave-mvvj"
server_key: "93365c4152ed70753dec8c3b4e572e33"
server_key_iv: "4550c8063a9f31d4eb4e72b64ea716a9"
server_key_version: "encryptionkey@0"
I20260806 09:14:47.036702 14996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "caa63860ef2d4f2bbd1a7f1147c44bcc"
format_stamp: "Formatted at 2026-08-06 09:14:47 on dist-test-slave-mvvj"
server_key: "93365c4152ed70753dec8c3b4e572e33"
server_key_iv: "4550c8063a9f31d4eb4e72b64ea716a9"
server_key_version: "encryptionkey@0"
I20260806 09:14:47.043110 14996 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260806 09:14:47.047115 15011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:47.048918 14996 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 09:14:47.049151 14996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "caa63860ef2d4f2bbd1a7f1147c44bcc"
format_stamp: "Formatted at 2026-08-06 09:14:47 on dist-test-slave-mvvj"
server_key: "93365c4152ed70753dec8c3b4e572e33"
server_key_iv: "4550c8063a9f31d4eb4e72b64ea716a9"
server_key_version: "encryptionkey@0"
I20260806 09:14:47.049415 14996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:47.090186 14996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:47.095291 14996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:47.095659 14996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:47.096822 14996 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:14:47.098382 14996 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:47.098500 14996 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:47.098680 14996 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:47.098750 14996 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:47.137535 14996 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:37597
I20260806 09:14:47.137645 15124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:37597 every 8 connection(s)
I20260806 09:14:47.138989 14996 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:14:47.144563 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 14996
I20260806 09:14:47.144827 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:14:47.145501 11261 external_mini_cluster.cc:1428] Setting key b91c766b78c75a5f17c6a611647d0419
Aug 06 09:14:47 dist-test-slave-mvvj krb5kdc[14887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007687, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:47.163555 15127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:47.142030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:59259 (local address 127.10.255.126:43073)
0806 09:14:47.142559 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:47.142564 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:47.143499 (+ 935us) server_negotiation.cc:407] Connection header received
0806 09:14:47.145864 (+ 2365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:47.145872 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:47.145983 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:47.146119 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:47.147859 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:47.148786 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:47.150571 (+ 1785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:47.151026 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:47.151182 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:47.156535 (+ 5353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:47.156542 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:47.156545 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:47.156588 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:47.159764 (+ 3176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:47.160849 (+ 1085us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:47.160861 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:47.160863 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:47.161015 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:47.161545 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:47.161551 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:47.161554 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:47.161857 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:47.162038 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:47.162900 (+ 862us) server_negotiation.cc:299] Negotiation successful
0806 09:14:47.163166 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":293,"threads_started":1}
I20260806 09:14:47.164685 15128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:47.142469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:43073 (local address 127.10.255.65:59259)
0806 09:14:47.143291 (+ 822us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:47.143335 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:47.145471 (+ 2136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:47.146411 (+ 940us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:47.146421 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:47.147010 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:47.147642 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:47.147663 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:47.149007 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:47.149012 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:47.150390 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:47.150406 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:47.151293 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:47.151302 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:47.151583 (+ 281us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:47.152720 (+ 1137us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:47.152750 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:47.156201 (+ 3451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:47.160048 (+ 3847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:47.160060 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:47.160087 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:47.160673 (+ 586us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:47.161154 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:47.161160 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:47.161163 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:47.161406 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:47.162023 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:47.162032 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:47.162448 (+ 416us) client_negotiation.cc:769] Sending connection context
0806 09:14:47.162768 (+ 320us) client_negotiation.cc:240] Negotiation successful
0806 09:14:47.163407 (+ 639us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":346,"threads_started":1}
WARNING: no policy specified for kudu/127.10.255.66@KRBTEST.COM; defaulting to no policy
I20260806 09:14:47.166687 15125 heartbeater.cc:347] Connected to a master server at 127.10.255.126:43073
I20260806 09:14:47.167028 15125 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:47.167879 15125 heartbeater.cc:511] Master 127.10.255.126:43073 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.66@KRBTEST.COM" created.
I20260806 09:14:47.170354 14932 ts_manager.cc:194] Registered new tserver with Master: caa63860ef2d4f2bbd1a7f1147c44bcc (127.10.255.65:37597)
I20260806 09:14:47.171916 14932 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.65@KRBTEST.COM'} at 127.10.255.65:59259
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
I20260806 09:14:47.197019 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:43073
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:37321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:47.577869 15132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:47.578259 15132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:47.578450 15132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:47.586400 15132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:47.586563 15132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:47.586686 15132 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:14:47.597867 15132 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:37321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:43073
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:47.599401 15132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:47.600992 15132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:47.616808 15137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:47.616739 15141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:47.616770 15138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:47.617693 15132 server_base.cc:1034] running on GCE node
I20260806 09:14:47.618475 15132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:47.619642 15132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:47.620899 15132 hybrid_clock.cc:648] HybridClock initialized: now 1786007687620882 us; error 105 us; skew 500 ppm
I20260806 09:14:47.621250 15132 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:47 dist-test-slave-mvvj krb5kdc[14887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007687, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:47.631332 15132 init.cc:377] Logged in from keytab as kudu/127.10.255.66@KRBTEST.COM (short username kudu)
I20260806 09:14:47.633227 15132 webserver.cc:460] Webserver started at http://127.10.255.66:38021/ using document root <none> and password file <none>
I20260806 09:14:47.634032 15132 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:47.634153 15132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:47.634490 15132 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:47.637880 15132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "6dccace04a924f88b2eea231893c90d6"
format_stamp: "Formatted at 2026-08-06 09:14:47 on dist-test-slave-mvvj"
server_key: "7bc0dfc72c6deadf6f4077e9d83949cb"
server_key_iv: "114ddac940e8a610f9e76d19d110c606"
server_key_version: "encryptionkey@0"
I20260806 09:14:47.638808 15132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "6dccace04a924f88b2eea231893c90d6"
format_stamp: "Formatted at 2026-08-06 09:14:47 on dist-test-slave-mvvj"
server_key: "7bc0dfc72c6deadf6f4077e9d83949cb"
server_key_iv: "114ddac940e8a610f9e76d19d110c606"
server_key_version: "encryptionkey@0"
I20260806 09:14:47.644984 15132 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260806 09:14:47.649179 15149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:47.650888 15132 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 09:14:47.651127 15132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "6dccace04a924f88b2eea231893c90d6"
format_stamp: "Formatted at 2026-08-06 09:14:47 on dist-test-slave-mvvj"
server_key: "7bc0dfc72c6deadf6f4077e9d83949cb"
server_key_iv: "114ddac940e8a610f9e76d19d110c606"
server_key_version: "encryptionkey@0"
I20260806 09:14:47.651384 15132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:47.678273 15132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:47.683507 15132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:47.683876 15132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:47.684988 15132 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:14:47.686547 15132 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:47.686657 15132 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:47.686822 15132 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:47.686901 15132 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:47.727229 15132 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:42709
I20260806 09:14:47.727511 15264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:42709 every 8 connection(s)
I20260806 09:14:47.728735 15132 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:14:47.732455 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 15132
I20260806 09:14:47.732694 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:14:47.733328 11261 external_mini_cluster.cc:1428] Setting key 51eaf5ed0647c0f5456a5dc3f21363e1
Aug 06 09:14:47 dist-test-slave-mvvj krb5kdc[14887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007687, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:47.755437 15267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:47.731645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:56375 (local address 127.10.255.126:43073)
0806 09:14:47.732243 (+ 598us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:47.732248 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:47.733611 (+ 1363us) server_negotiation.cc:407] Connection header received
0806 09:14:47.736401 (+ 2790us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:47.736408 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:47.736508 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:47.736645 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:47.738742 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:47.739499 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:47.741354 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:47.741806 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:47.741960 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:47.746849 (+ 4889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:47.746856 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:47.746860 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:47.746907 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:47.750189 (+ 3282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:47.751663 (+ 1474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:47.751669 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:47.751671 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:47.751919 (+ 248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:47.752674 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:47.752679 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:47.752681 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:47.753187 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:47.753334 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:47.754602 (+ 1268us) server_negotiation.cc:299] Negotiation successful
0806 09:14:47.755016 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":323,"threads_started":1}
WARNING: no policy specified for kudu/127.10.255.67@KRBTEST.COM; defaulting to no policy
I20260806 09:14:47.756709 15268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:47.732272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:43073 (local address 127.10.255.66:56375)
0806 09:14:47.733346 (+ 1074us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:47.733427 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:47.736048 (+ 2621us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:47.736969 (+ 921us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:47.736982 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:47.737630 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:47.738438 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:47.738490 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:47.739731 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:47.739736 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:47.741154 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:47.741170 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:47.742087 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:47.742095 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:47.742366 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:47.743250 (+ 884us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:47.743278 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:47.746442 (+ 3164us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:47.750463 (+ 4021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:47.750480 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:47.750506 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:47.751420 (+ 914us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:47.752081 (+ 661us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:47.752088 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:47.752095 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:47.752438 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:47.753374 (+ 936us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:47.753385 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:47.753947 (+ 562us) client_negotiation.cc:769] Sending connection context
0806 09:14:47.754384 (+ 437us) client_negotiation.cc:240] Negotiation successful
0806 09:14:47.755082 (+ 698us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":794,"thread_start_us":528,"threads_started":1}
I20260806 09:14:47.758836 15265 heartbeater.cc:347] Connected to a master server at 127.10.255.126:43073
I20260806 09:14:47.759254 15265 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.67@KRBTEST.COM" created.
I20260806 09:14:47.760514 15265 heartbeater.cc:511] Master 127.10.255.126:43073 requested a full tablet report, sending...
I20260806 09:14:47.762601 14932 ts_manager.cc:194] Registered new tserver with Master: 6dccace04a924f88b2eea231893c90d6 (127.10.255.66:42709)
I20260806 09:14:47.763984 14932 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.66@KRBTEST.COM'} at 127.10.255.66:56375
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
I20260806 09:14:47.792614 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:43073
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:37321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:48.164683 15271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:48.165000 15271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:48.165165 15271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:48.172921 15271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:48.173056 15271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:48.173246 15271 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:14:48.175997 15125 heartbeater.cc:503] Master 127.10.255.126:43073 was elected leader, sending a full tablet report...
I20260806 09:14:48.184542 15271 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:37321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:43073
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:48.186012 15271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:48.187495 15271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:48.202268 15276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:48.202293 15277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:48.202225 15280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:48.204164 15271 server_base.cc:1034] running on GCE node
I20260806 09:14:48.204922 15271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:48.206001 15271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:48.207312 15271 hybrid_clock.cc:648] HybridClock initialized: now 1786007688207237 us; error 69 us; skew 500 ppm
I20260806 09:14:48.207712 15271 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:48 dist-test-slave-mvvj krb5kdc[14887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007688, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:48.211373 15271 init.cc:377] Logged in from keytab as kudu/127.10.255.67@KRBTEST.COM (short username kudu)
I20260806 09:14:48.213177 15271 webserver.cc:460] Webserver started at http://127.10.255.67:37733/ using document root <none> and password file <none>
I20260806 09:14:48.213917 15271 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:48.214033 15271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:48.214354 15271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:48.217826 15271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "f3785cc19dec49b6a8f7c626e673f13b"
format_stamp: "Formatted at 2026-08-06 09:14:48 on dist-test-slave-mvvj"
server_key: "e096b42c12061d92d75550e35cbce975"
server_key_iv: "b62c968e3b5fa3ba988e209c8144b7aa"
server_key_version: "encryptionkey@0"
I20260806 09:14:48.218772 15271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "f3785cc19dec49b6a8f7c626e673f13b"
format_stamp: "Formatted at 2026-08-06 09:14:48 on dist-test-slave-mvvj"
server_key: "e096b42c12061d92d75550e35cbce975"
server_key_iv: "b62c968e3b5fa3ba988e209c8144b7aa"
server_key_version: "encryptionkey@0"
I20260806 09:14:48.224906 15271 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260806 09:14:48.229290 15287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:48.230983 15271 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.001s
I20260806 09:14:48.231246 15271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "f3785cc19dec49b6a8f7c626e673f13b"
format_stamp: "Formatted at 2026-08-06 09:14:48 on dist-test-slave-mvvj"
server_key: "e096b42c12061d92d75550e35cbce975"
server_key_iv: "b62c968e3b5fa3ba988e209c8144b7aa"
server_key_version: "encryptionkey@0"
I20260806 09:14:48.231498 15271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:48.247769 15271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:48.253134 15271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:48.253516 15271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:48.254776 15271 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:14:48.256680 15271 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:48.256763 15271 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:48.256862 15271 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:48.256914 15271 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:48.294422 15271 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:44709
I20260806 09:14:48.294545 15401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:44709 every 8 connection(s)
I20260806 09:14:48.296370 15271 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:14:48.298825 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 15271
I20260806 09:14:48.299058 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:14:48.299562 11261 external_mini_cluster.cc:1428] Setting key cabc9e06382c37b8fd7f7ac97696c35f
Aug 06 09:14:48 dist-test-slave-mvvj krb5kdc[14887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007688, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:48.322183 15404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:48.299749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:52419 (local address 127.10.255.126:43073)
0806 09:14:48.300316 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:48.300323 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:48.301775 (+ 1452us) server_negotiation.cc:407] Connection header received
0806 09:14:48.304261 (+ 2486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:48.304265 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:48.304351 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:48.304523 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:48.306507 (+ 1984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:48.307390 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:48.309468 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:48.309894 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:48.310011 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:48.314554 (+ 4543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:48.314561 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:48.314564 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:48.314606 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:48.318425 (+ 3819us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:48.319421 (+ 996us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:48.319427 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:48.319430 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:48.319582 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:48.320203 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:48.320215 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:48.320218 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:48.320525 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:48.320705 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:48.321526 (+ 821us) server_negotiation.cc:299] Negotiation successful
0806 09:14:48.321787 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":284,"threads_started":1}
I20260806 09:14:48.323266 15405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:48.300550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:43073 (local address 127.10.255.67:52419)
0806 09:14:48.301581 (+ 1031us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:48.301639 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:48.303984 (+ 2345us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:48.304879 (+ 895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:48.304889 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:48.305573 (+ 684us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:48.306256 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:48.306279 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:48.307578 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:48.307583 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:48.309235 (+ 1652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:48.309251 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:48.310177 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:48.310183 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:48.310416 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:48.311405 (+ 989us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:48.311433 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:48.314128 (+ 2695us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:48.318698 (+ 4570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:48.318708 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:48.318726 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:48.319265 (+ 539us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:48.319711 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:48.319716 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:48.319720 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:48.320072 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:48.320669 (+ 597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:48.320679 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:48.321097 (+ 418us) client_negotiation.cc:769] Sending connection context
0806 09:14:48.321387 (+ 290us) client_negotiation.cc:240] Negotiation successful
0806 09:14:48.322001 (+ 614us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":659,"thread_start_us":406,"threads_started":1}
I20260806 09:14:48.324906 15402 heartbeater.cc:347] Connected to a master server at 127.10.255.126:43073
I20260806 09:14:48.325286 15402 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:48.326150 15402 heartbeater.cc:511] Master 127.10.255.126:43073 requested a full tablet report, sending...
I20260806 09:14:48.328197 14932 ts_manager.cc:194] Registered new tserver with Master: f3785cc19dec49b6a8f7c626e673f13b (127.10.255.67:44709)
I20260806 09:14:48.329514 14932 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.67@KRBTEST.COM'} at 127.10.255.67:52419
I20260806 09:14:48.330344 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 09:14:48 dist-test-slave-mvvj krb5kdc[14887](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007688, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 09:14:48 dist-test-slave-mvvj krb5kdc[14887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007688, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.65@KRBTEST.COM
I20260806 09:14:48.391547 15410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:48.370960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49726 (local address 127.10.255.65:37597)
0806 09:14:48.371811 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:48.371821 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:48.371888 (+ 67us) server_negotiation.cc:407] Connection header received
0806 09:14:48.371969 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:48.371976 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:48.372236 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:48.372440 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:48.374156 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:48.375330 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:48.377776 (+ 2446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:48.378628 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:48.378804 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:48.383458 (+ 4654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:48.383478 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:48.383503 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:48.383557 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:48.387079 (+ 3522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:48.388566 (+ 1487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:48.388578 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:48.388582 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:48.388805 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:48.389494 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:48.389499 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:48.389501 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:48.389988 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:48.390414 (+ 426us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:48.390770 (+ 356us) server_negotiation.cc:299] Negotiation successful
0806 09:14:48.391135 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":657,"thread_start_us":324,"threads_started":1}
Aug 06 09:14:48 dist-test-slave-mvvj krb5kdc[14887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007688, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:48.414266 15404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:48.397520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54008 (local address 127.10.255.126:43073)
0806 09:14:48.397803 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:48.397809 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:48.397979 (+ 170us) server_negotiation.cc:407] Connection header received
0806 09:14:48.398076 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:48.398081 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:48.398155 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:48.398237 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:48.399717 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:48.400625 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:48.402200 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:48.402736 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:48.402853 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:48.407599 (+ 4746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:48.407605 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:48.407609 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:48.407655 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:48.410882 (+ 3227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:48.411689 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:48.411695 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:48.411698 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:48.411973 (+ 275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:48.412530 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:48.412535 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:48.412537 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:48.412953 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:48.413156 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:48.413672 (+ 516us) server_negotiation.cc:299] Negotiation successful
0806 09:14:48.413918 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
W20260806 09:14:48.415035 14932 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54008
I20260806 09:14:48.416419 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 14996
I20260806 09:14:48.432801 15410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:48.417562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49740 (local address 127.10.255.65:37597)
0806 09:14:48.417805 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:48.417810 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:48.417904 (+ 94us) server_negotiation.cc:407] Connection header received
0806 09:14:48.418052 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:48.418055 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:48.418138 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:48.418251 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:48.419687 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:48.420496 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:48.421846 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:48.422401 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:48.422550 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:48.425535 (+ 2985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:48.425543 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:48.425549 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:48.425604 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:48.429446 (+ 3842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:48.430405 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:48.430412 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:48.430416 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:48.430598 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:48.431069 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:48.431075 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:48.431078 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:48.431446 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:48.431700 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:48.432162 (+ 462us) server_negotiation.cc:299] Negotiation successful
0806 09:14:48.432431 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260806 09:14:48.433513 15120 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:48.524497 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 14996
I20260806 09:14:48.543252 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 15132
Aug 06 09:14:48 dist-test-slave-mvvj krb5kdc[14887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007688, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.66@KRBTEST.COM
I20260806 09:14:48.562459 15415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:48.544357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43580 (local address 127.10.255.66:42709)
0806 09:14:48.545090 (+ 733us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:48.545098 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:48.545125 (+ 27us) server_negotiation.cc:407] Connection header received
0806 09:14:48.545189 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:48.545195 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:48.545413 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:48.545550 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:48.547040 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:48.548203 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:48.549705 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:48.550366 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:48.550487 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:48.555376 (+ 4889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:48.555395 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:48.555413 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:48.555457 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:48.558911 (+ 3454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:48.559741 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:48.559750 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:48.559752 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:48.560263 (+ 511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:48.560747 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:48.560752 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:48.560754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:48.561161 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:48.561501 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:48.561830 (+ 329us) server_negotiation.cc:299] Negotiation successful
0806 09:14:48.562081 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":581,"thread_start_us":334,"threads_started":1}
I20260806 09:14:48.563818 15260 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:48.652002 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 15132
I20260806 09:14:48.672001 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 15271
Aug 06 09:14:48 dist-test-slave-mvvj krb5kdc[14887](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007688, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.67@KRBTEST.COM
I20260806 09:14:48.693145 15417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:48.673237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37758 (local address 127.10.255.67:44709)
0806 09:14:48.673998 (+ 761us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:48.674006 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:48.674041 (+ 35us) server_negotiation.cc:407] Connection header received
0806 09:14:48.674111 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:48.674119 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:48.674360 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:48.674597 (+ 237us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:48.676231 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:48.677465 (+ 1234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:48.678929 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:48.679562 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:48.679730 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:48.685542 (+ 5812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:48.685562 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:48.685581 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:48.685629 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:48.688825 (+ 3196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:48.689834 (+ 1009us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:48.689845 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:48.689847 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:48.690017 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:48.690624 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:48.690630 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:48.690635 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:48.691338 (+ 703us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:48.691708 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:48.692515 (+ 807us) server_negotiation.cc:299] Negotiation successful
0806 09:14:48.692807 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":381,"threads_started":1}
I20260806 09:14:48.694718 15397 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:48.784415 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 15271
I20260806 09:14:48.804332 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 14900
I20260806 09:14:48.805801 14964 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:48.919106 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 14900
2026-08-06T09:14:48Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (4346 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:14:49 dist-test-slave-mvvj krb5kdc[15422](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:14:49 dist-test-slave-mvvj krb5kdc[15422](info): set up 2 sockets
Aug 06 09:14:49 dist-test-slave-mvvj krb5kdc[15422](info): commencing operation
krb5kdc: starting...
W20260806 09:14:50.091053 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.000s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:14:50 dist-test-slave-mvvj krb5kdc[15422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:14:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:14:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:14:50.333659 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:45217
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:34247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:45217
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:50.701130 15435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:50.701507 15435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:50.701611 15435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:50.711052 15435 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:14:50.711228 15435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:50.711283 15435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:50.711341 15435 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:14:50.711403 15435 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:14:50.723008 15435 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:34247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:45217
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:45217
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:50.724820 15435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:50.726270 15435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:50.741753 15440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:50.741920 15441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:50.741918 15443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:50.743481 15435 server_base.cc:1034] running on GCE node
I20260806 09:14:50.744575 15435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:50.746435 15435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:50.747761 15435 hybrid_clock.cc:648] HybridClock initialized: now 1786007690747713 us; error 52 us; skew 500 ppm
I20260806 09:14:50.748410 15435 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:50 dist-test-slave-mvvj krb5kdc[15422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007690, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:50.752205 15435 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:14:50.753677 15435 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:50.753813 15435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:50.754289 15435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:50.757897 15435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "8b211b4642a84ef2834d924ccd022aa9"
format_stamp: "Formatted at 2026-08-06 09:14:50 on dist-test-slave-mvvj"
server_key: "6b3f46158d3bbb12a4e0090cf0b4f821"
server_key_iv: "badd334453cea5920ed8761e99dffe20"
server_key_version: "encryptionkey@0"
I20260806 09:14:50.758886 15435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "8b211b4642a84ef2834d924ccd022aa9"
format_stamp: "Formatted at 2026-08-06 09:14:50 on dist-test-slave-mvvj"
server_key: "6b3f46158d3bbb12a4e0090cf0b4f821"
server_key_iv: "badd334453cea5920ed8761e99dffe20"
server_key_version: "encryptionkey@0"
I20260806 09:14:50.765389 15435 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260806 09:14:50.770165 15449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:50.771970 15435 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:14:50.772228 15435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "8b211b4642a84ef2834d924ccd022aa9"
format_stamp: "Formatted at 2026-08-06 09:14:50 on dist-test-slave-mvvj"
server_key: "6b3f46158d3bbb12a4e0090cf0b4f821"
server_key_iv: "badd334453cea5920ed8761e99dffe20"
server_key_version: "encryptionkey@0"
I20260806 09:14:50.772526 15435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:50.794955 15435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:50.800705 15435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:50.801075 15435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:50.824021 15435 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:45217
I20260806 09:14:50.824009 15502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:45217 every 8 connection(s)
I20260806 09:14:50.825135 15435 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:14:50.829478 15503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:50.830221 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 15435
I20260806 09:14:50.830487 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:14:50.831384 11261 external_mini_cluster.cc:1428] Setting key 41156c3fa71191388eca2326da9ed20b
I20260806 09:14:50.844728 15503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b211b4642a84ef2834d924ccd022aa9: Bootstrap starting.
Aug 06 09:14:50 dist-test-slave-mvvj krb5kdc[15422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:50.848757 15503 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b211b4642a84ef2834d924ccd022aa9: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:50.849985 15503 log.cc:824] T 00000000000000000000000000000000 P 8b211b4642a84ef2834d924ccd022aa9: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:50.854089 15503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b211b4642a84ef2834d924ccd022aa9: No bootstrap required, opened a new log
I20260806 09:14:50.859031 15506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:50.833979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41296 (local address 127.10.255.126:45217)
0806 09:14:50.834933 (+ 954us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:50.834950 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:50.835000 (+ 50us) server_negotiation.cc:407] Connection header received
0806 09:14:50.837254 (+ 2254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:50.837286 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:50.837910 (+ 624us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:50.838422 (+ 512us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:50.840415 (+ 1993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:50.841986 (+ 1571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:50.843524 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:50.844445 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:50.844685 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:50.849625 (+ 4940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:50.849636 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:50.849654 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:50.849715 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:50.853926 (+ 4211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:50.854905 (+ 979us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:50.854915 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:50.854923 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:50.855134 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:50.855592 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:50.855597 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:50.855606 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:50.856339 (+ 733us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:50.856735 (+ 396us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:50.857263 (+ 528us) server_negotiation.cc:299] Negotiation successful
0806 09:14:50.857802 (+ 539us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":648,"thread_start_us":404,"threads_started":1}
I20260806 09:14:50.863621 15503 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b211b4642a84ef2834d924ccd022aa9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b211b4642a84ef2834d924ccd022aa9" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 45217 } }
I20260806 09:14:50.864202 15503 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b211b4642a84ef2834d924ccd022aa9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:50.864324 15503 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b211b4642a84ef2834d924ccd022aa9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b211b4642a84ef2834d924ccd022aa9, State: Initialized, Role: FOLLOWER
I20260806 09:14:50.865118 15503 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b211b4642a84ef2834d924ccd022aa9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b211b4642a84ef2834d924ccd022aa9" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 45217 } }
I20260806 09:14:50.865463 15503 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b211b4642a84ef2834d924ccd022aa9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:14:50.865624 15503 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b211b4642a84ef2834d924ccd022aa9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:14:50.865856 15503 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b211b4642a84ef2834d924ccd022aa9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:50.868533 15503 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b211b4642a84ef2834d924ccd022aa9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b211b4642a84ef2834d924ccd022aa9" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 45217 } }
I20260806 09:14:50.869098 15503 leader_election.cc:302] T 00000000000000000000000000000000 P 8b211b4642a84ef2834d924ccd022aa9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b211b4642a84ef2834d924ccd022aa9; no voters:
I20260806 09:14:50.869735 15503 leader_election.cc:288] T 00000000000000000000000000000000 P 8b211b4642a84ef2834d924ccd022aa9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:14:50.869940 15508 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b211b4642a84ef2834d924ccd022aa9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:14:50.870709 15508 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b211b4642a84ef2834d924ccd022aa9 [term 1 LEADER]: Becoming Leader. State: Replica: 8b211b4642a84ef2834d924ccd022aa9, State: Running, Role: LEADER
I20260806 09:14:50.871320 15508 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b211b4642a84ef2834d924ccd022aa9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b211b4642a84ef2834d924ccd022aa9" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 45217 } }
I20260806 09:14:50.872242 15503 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b211b4642a84ef2834d924ccd022aa9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:14:50.874734 15509 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b211b4642a84ef2834d924ccd022aa9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b211b4642a84ef2834d924ccd022aa9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b211b4642a84ef2834d924ccd022aa9" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 45217 } } }
I20260806 09:14:50.875263 15509 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b211b4642a84ef2834d924ccd022aa9 [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:50.876282 15516 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:14:50.876132 15510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b211b4642a84ef2834d924ccd022aa9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b211b4642a84ef2834d924ccd022aa9. Latest consensus state: current_term: 1 leader_uuid: "8b211b4642a84ef2834d924ccd022aa9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b211b4642a84ef2834d924ccd022aa9" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 45217 } } }
I20260806 09:14:50.877892 15510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b211b4642a84ef2834d924ccd022aa9 [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:50.882514 15516 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:14:50.887194 15525 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 09:14:50.896293 15516 catalog_manager.cc:1347] Generated new cluster ID: ba9c24221aec4666a30da62d3ad8096a
I20260806 09:14:50.896459 15516 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:14:50.919237 15516 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:14:50.921700 15516 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:14:50.930370 15516 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b211b4642a84ef2834d924ccd022aa9: Generated new TSK 0
I20260806 09:14:50.931560 15516 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.255.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
I20260806 09:14:51.005347 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:45217
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:34247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:51.385387 15529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:51.385740 15529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:51.385847 15529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:51.395562 15529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:51.395732 15529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:51.395944 15529 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:14:51.407030 15529 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:34247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:45217
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:51.408699 15529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:51.410174 15529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:51.426684 15537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:51.426726 15534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:51.426873 15535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:51.427552 15529 server_base.cc:1034] running on GCE node
I20260806 09:14:51.428567 15529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:51.429870 15529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:51.431207 15529 hybrid_clock.cc:648] HybridClock initialized: now 1786007691431111 us; error 52 us; skew 500 ppm
I20260806 09:14:51.431680 15529 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:51 dist-test-slave-mvvj krb5kdc[15422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007691, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:51.436013 15529 init.cc:377] Logged in from keytab as kudu/127.10.255.65@KRBTEST.COM (short username kudu)
I20260806 09:14:51.437753 15529 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:51.437947 15529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:51.438395 15529 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:51.442137 15529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "a6a90b175e7843a68e4507ec061350d7"
format_stamp: "Formatted at 2026-08-06 09:14:51 on dist-test-slave-mvvj"
server_key: "a0cc786599333eddc7a4492c2caff268"
server_key_iv: "5076274b2b4adcc4c896ebb9933cb7d5"
server_key_version: "encryptionkey@0"
I20260806 09:14:51.443096 15529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "a6a90b175e7843a68e4507ec061350d7"
format_stamp: "Formatted at 2026-08-06 09:14:51 on dist-test-slave-mvvj"
server_key: "a0cc786599333eddc7a4492c2caff268"
server_key_iv: "5076274b2b4adcc4c896ebb9933cb7d5"
server_key_version: "encryptionkey@0"
I20260806 09:14:51.449354 15529 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260806 09:14:51.453822 15543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:51.455765 15529 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260806 09:14:51.456252 15529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "a6a90b175e7843a68e4507ec061350d7"
format_stamp: "Formatted at 2026-08-06 09:14:51 on dist-test-slave-mvvj"
server_key: "a0cc786599333eddc7a4492c2caff268"
server_key_iv: "5076274b2b4adcc4c896ebb9933cb7d5"
server_key_version: "encryptionkey@0"
I20260806 09:14:51.456712 15529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:51.486240 15529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:51.491601 15529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:51.492013 15529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:51.493177 15529 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:14:51.494843 15529 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:51.494980 15529 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:51.495131 15529 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:51.495226 15529 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:51.534598 15529 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:41967
I20260806 09:14:51.534756 15656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:41967 every 8 connection(s)
I20260806 09:14:51.535660 15529 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:14:51.541956 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 15529
I20260806 09:14:51.542236 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:14:51.542984 11261 external_mini_cluster.cc:1428] Setting key 8ae6524fb31914f7ed8e63060685d842
Aug 06 09:14:51 dist-test-slave-mvvj krb5kdc[15422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007691, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:51.564957 15659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:51.538711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:60535 (local address 127.10.255.126:45217)
0806 09:14:51.539285 (+ 574us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:51.539290 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:51.540680 (+ 1390us) server_negotiation.cc:407] Connection header received
0806 09:14:51.542925 (+ 2245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:51.542931 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:51.543056 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:51.543197 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:51.545763 (+ 2566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:51.546636 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:51.549768 (+ 3132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:51.550291 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:51.550443 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:51.556784 (+ 6341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:51.556790 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:51.556794 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:51.556850 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:51.560168 (+ 3318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:51.561745 (+ 1577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:51.561755 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:51.561761 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:51.562001 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:51.562702 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:51.562706 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:51.562709 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:51.563040 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:51.563174 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:51.564387 (+ 1213us) server_negotiation.cc:299] Negotiation successful
0806 09:14:51.564644 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":312,"threads_started":1}
I20260806 09:14:51.566666 15660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:51.539157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:45217 (local address 127.10.255.65:60535)
0806 09:14:51.540396 (+ 1239us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:51.540452 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:51.542558 (+ 2106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:51.543595 (+ 1037us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:51.543611 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:51.544635 (+ 1024us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:51.545500 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:51.545547 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:51.546882 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:51.546891 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:51.549469 (+ 2578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:51.549500 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:51.550651 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:51.550662 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:51.551047 (+ 385us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:51.552070 (+ 1023us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:51.552111 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:51.556326 (+ 4215us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:51.560433 (+ 4107us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:51.560448 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:51.560477 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:51.561425 (+ 948us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:51.562177 (+ 752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:51.562186 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:51.562193 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:51.562501 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:51.563204 (+ 703us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:51.563215 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:51.563792 (+ 577us) client_negotiation.cc:769] Sending connection context
0806 09:14:51.564198 (+ 406us) client_negotiation.cc:240] Negotiation successful
0806 09:14:51.564911 (+ 713us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":341,"threads_started":1}
WARNING: no policy specified for kudu/127.10.255.66@KRBTEST.COM; defaulting to no policy
I20260806 09:14:51.568825 15657 heartbeater.cc:347] Connected to a master server at 127.10.255.126:45217
I20260806 09:14:51.569224 15657 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:51.570149 15657 heartbeater.cc:511] Master 127.10.255.126:45217 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.66@KRBTEST.COM" created.
I20260806 09:14:51.573035 15467 ts_manager.cc:194] Registered new tserver with Master: a6a90b175e7843a68e4507ec061350d7 (127.10.255.65:41967)
I20260806 09:14:51.574827 15467 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.65@KRBTEST.COM'} at 127.10.255.65:60535
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
I20260806 09:14:51.604638 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:45217
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:34247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:51.985530 15663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:51.985867 15663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:51.986042 15663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:51.994396 15663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:51.994556 15663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:51.994755 15663 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:14:52.005810 15663 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:34247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:45217
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:52.007397 15663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:52.009116 15663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:52.028338 15669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:52.028364 15671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:52.029016 15668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:52.029448 15663 server_base.cc:1034] running on GCE node
I20260806 09:14:52.030179 15663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:52.031301 15663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:52.032575 15663 hybrid_clock.cc:648] HybridClock initialized: now 1786007692032520 us; error 45 us; skew 500 ppm
I20260806 09:14:52.032989 15663 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:52 dist-test-slave-mvvj krb5kdc[15422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007692, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:52.037398 15663 init.cc:377] Logged in from keytab as kudu/127.10.255.66@KRBTEST.COM (short username kudu)
I20260806 09:14:52.039119 15663 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:52.039300 15663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:52.039739 15663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:52.044041 15663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "a6394b29ac554b6983ec7f9b762f9d2f"
format_stamp: "Formatted at 2026-08-06 09:14:52 on dist-test-slave-mvvj"
server_key: "58a29c71e9f4592f607794222b725019"
server_key_iv: "e050f39ef25bd9f243949a5f77b678e2"
server_key_version: "encryptionkey@0"
I20260806 09:14:52.045138 15663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "a6394b29ac554b6983ec7f9b762f9d2f"
format_stamp: "Formatted at 2026-08-06 09:14:52 on dist-test-slave-mvvj"
server_key: "58a29c71e9f4592f607794222b725019"
server_key_iv: "e050f39ef25bd9f243949a5f77b678e2"
server_key_version: "encryptionkey@0"
I20260806 09:14:52.051802 15663 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260806 09:14:52.056052 15677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:52.057991 15663 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260806 09:14:52.058266 15663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "a6394b29ac554b6983ec7f9b762f9d2f"
format_stamp: "Formatted at 2026-08-06 09:14:52 on dist-test-slave-mvvj"
server_key: "58a29c71e9f4592f607794222b725019"
server_key_iv: "e050f39ef25bd9f243949a5f77b678e2"
server_key_version: "encryptionkey@0"
I20260806 09:14:52.058568 15663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:52.079387 15663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:52.084872 15663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:52.085222 15663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:52.086369 15663 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:14:52.088423 15663 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:52.088567 15663 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:52.088726 15663 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:52.088826 15663 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:52.128376 15663 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:42655
I20260806 09:14:52.128443 15791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:42655 every 8 connection(s)
I20260806 09:14:52.129398 15663 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:14:52.131255 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 15663
I20260806 09:14:52.131493 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:14:52.132160 11261 external_mini_cluster.cc:1428] Setting key 7288b65bc3de73054a5dbe0801587a33
Aug 06 09:14:52 dist-test-slave-mvvj krb5kdc[15422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007692, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:52.155642 15795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:52.132921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:42467 (local address 127.10.255.126:45217)
0806 09:14:52.133833 (+ 912us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:52.133839 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:52.134859 (+ 1020us) server_negotiation.cc:407] Connection header received
0806 09:14:52.136999 (+ 2140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:52.137005 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:52.137111 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:52.137243 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:52.139095 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:52.139910 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:52.141600 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:52.142065 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:52.142216 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:52.147068 (+ 4852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:52.147078 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:52.147086 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:52.147141 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:52.151390 (+ 4249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:52.152636 (+ 1246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:52.152645 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:52.152651 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:52.152845 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:52.153394 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:52.153402 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:52.153408 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:52.153895 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:52.154090 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:52.154902 (+ 812us) server_negotiation.cc:299] Negotiation successful
0806 09:14:52.155201 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":793,"thread_start_us":672,"threads_started":1}
WARNING: no policy specified for kudu/127.10.255.67@KRBTEST.COM; defaulting to no policy
I20260806 09:14:52.156514 15796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:52.133588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:45217 (local address 127.10.255.66:42467)
0806 09:14:52.134667 (+ 1079us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:52.134725 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:52.136669 (+ 1944us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:52.137514 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:52.137524 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:52.138165 (+ 641us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:52.138862 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:52.138882 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:52.140094 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:52.140098 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:52.141419 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:52.141436 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:52.142326 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:52.142333 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:52.142695 (+ 362us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:52.143548 (+ 853us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:52.143587 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:52.146725 (+ 3138us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:52.151663 (+ 4938us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:52.151677 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:52.151696 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:52.152460 (+ 764us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:52.152993 (+ 533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:52.152997 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:52.152999 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:52.153244 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:52.154081 (+ 837us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:52.154089 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:52.154458 (+ 369us) client_negotiation.cc:769] Sending connection context
0806 09:14:52.154709 (+ 251us) client_negotiation.cc:240] Negotiation successful
0806 09:14:52.155175 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":665,"thread_start_us":442,"threads_started":1}
I20260806 09:14:52.158265 15792 heartbeater.cc:347] Connected to a master server at 127.10.255.126:45217
I20260806 09:14:52.158763 15792 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:52.159618 15792 heartbeater.cc:511] Master 127.10.255.126:45217 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.67@KRBTEST.COM" created.
I20260806 09:14:52.162011 15467 ts_manager.cc:194] Registered new tserver with Master: a6394b29ac554b6983ec7f9b762f9d2f (127.10.255.66:42655)
I20260806 09:14:52.163074 15467 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.66@KRBTEST.COM'} at 127.10.255.66:42467
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
I20260806 09:14:52.191365 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:45217
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:34247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:14:52.565831 15799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:52.566154 15799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:52.566259 15799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:52.574154 15799 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:52.574288 15799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:52.574416 15799 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:14:52.579798 15657 heartbeater.cc:503] Master 127.10.255.126:45217 was elected leader, sending a full tablet report...
I20260806 09:14:52.586194 15799 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:34247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:45217
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:52.587749 15799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:52.589257 15799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:52.605161 15805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:52.605113 15807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:52.605887 15804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:52.606191 15799 server_base.cc:1034] running on GCE node
I20260806 09:14:52.607686 15799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:52.609525 15799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:52.610927 15799 hybrid_clock.cc:648] HybridClock initialized: now 1786007692610828 us; error 104 us; skew 500 ppm
I20260806 09:14:52.611367 15799 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:14:52 dist-test-slave-mvvj krb5kdc[15422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007692, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:14:52.615715 15799 init.cc:377] Logged in from keytab as kudu/127.10.255.67@KRBTEST.COM (short username kudu)
I20260806 09:14:52.617174 15799 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:52.617282 15799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:52.617604 15799 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:52.621601 15799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "00b4b6cd770945eab363bd824c5ef004"
format_stamp: "Formatted at 2026-08-06 09:14:52 on dist-test-slave-mvvj"
server_key: "6fe5aa5b5b816b0f291523c680c559f6"
server_key_iv: "fcfc3f46df3ba7815ce498e46c21a2b5"
server_key_version: "encryptionkey@0"
I20260806 09:14:52.622548 15799 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "00b4b6cd770945eab363bd824c5ef004"
format_stamp: "Formatted at 2026-08-06 09:14:52 on dist-test-slave-mvvj"
server_key: "6fe5aa5b5b816b0f291523c680c559f6"
server_key_iv: "fcfc3f46df3ba7815ce498e46c21a2b5"
server_key_version: "encryptionkey@0"
I20260806 09:14:52.628541 15799 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260806 09:14:52.632776 15813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:52.634609 15799 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260806 09:14:52.634774 15799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "00b4b6cd770945eab363bd824c5ef004"
format_stamp: "Formatted at 2026-08-06 09:14:52 on dist-test-slave-mvvj"
server_key: "6fe5aa5b5b816b0f291523c680c559f6"
server_key_iv: "fcfc3f46df3ba7815ce498e46c21a2b5"
server_key_version: "encryptionkey@0"
I20260806 09:14:52.634987 15799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:52.666234 15799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:52.672379 15799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:52.672755 15799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:52.674180 15799 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:14:52.675762 15799 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:52.675930 15799 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260806 09:14:52.676043 15799 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:52.676095 15799 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:52.725028 15799 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:38153
I20260806 09:14:52.725145 15930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:38153 every 8 connection(s)
I20260806 09:14:52.726100 15799 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:14:52.727188 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 15799
I20260806 09:14:52.727500 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:14:52.728188 11261 external_mini_cluster.cc:1428] Setting key 45cf807171ab4125033f09ecaaef73dc
Aug 06 09:14:52 dist-test-slave-mvvj krb5kdc[15422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007692, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:14:52.754808 15933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:52.730144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:60713 (local address 127.10.255.126:45217)
0806 09:14:52.730675 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:52.730682 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:52.732117 (+ 1435us) server_negotiation.cc:407] Connection header received
0806 09:14:52.734545 (+ 2428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:52.734550 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:52.734822 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:52.735350 (+ 528us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:52.738464 (+ 3114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:52.739410 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:52.741611 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:52.742089 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:52.742258 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:52.747367 (+ 5109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:52.747373 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:52.747376 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:52.747427 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:52.750816 (+ 3389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:52.752029 (+ 1213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:52.752034 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:52.752037 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:52.752205 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:52.752861 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:52.752865 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:52.752867 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:52.753216 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:52.753378 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:52.754271 (+ 893us) server_negotiation.cc:299] Negotiation successful
0806 09:14:52.754497 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":328,"threads_started":1}
I20260806 09:14:52.755954 15934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:52.730878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:45217 (local address 127.10.255.67:60713)
0806 09:14:52.731943 (+ 1065us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:52.732001 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:52.734204 (+ 2203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:52.736294 (+ 2090us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:52.736309 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:52.737399 (+ 1090us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:52.738135 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:52.738160 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:52.739815 (+ 1655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:52.739821 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:52.741379 (+ 1558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:52.741400 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:52.742379 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:52.742388 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:52.742666 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:52.743544 (+ 878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:14:52.743584 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:52.747086 (+ 3502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:52.751099 (+ 4013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:52.751110 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:52.751129 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:52.751756 (+ 627us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:52.752367 (+ 611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:14:52.752371 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:14:52.752386 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:14:52.752697 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:14:52.753418 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:52.753426 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:52.753844 (+ 418us) client_negotiation.cc:769] Sending connection context
0806 09:14:52.754116 (+ 272us) client_negotiation.cc:240] Negotiation successful
0806 09:14:52.754584 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":730,"thread_start_us":456,"threads_started":1}
I20260806 09:14:52.757939 15931 heartbeater.cc:347] Connected to a master server at 127.10.255.126:45217
I20260806 09:14:52.758361 15931 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:52.759327 15931 heartbeater.cc:511] Master 127.10.255.126:45217 requested a full tablet report, sending...
I20260806 09:14:52.761459 15467 ts_manager.cc:194] Registered new tserver with Master: 00b4b6cd770945eab363bd824c5ef004 (127.10.255.67:38153)
I20260806 09:14:52.762527 15467 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.67@KRBTEST.COM'} at 127.10.255.67:60713
I20260806 09:14:52.772826 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 09:14:52.793385 15933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:52.777950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41300 (local address 127.10.255.126:45217)
0806 09:14:52.778180 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:52.778185 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:52.778853 (+ 668us) server_negotiation.cc:407] Connection header received
0806 09:14:52.779066 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:52.779070 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:52.779190 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:52.779288 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:52.781273 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:52.782026 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:52.783544 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:52.784369 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:52.784494 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:52.787160 (+ 2666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:52.787167 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:52.787171 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:52.787216 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:52.790239 (+ 3023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:52.791087 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:52.791096 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:52.791102 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:52.791318 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:52.791799 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:52.791803 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:52.791806 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:52.792305 (+ 499us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:52.792529 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:52.792938 (+ 409us) server_negotiation.cc:299] Negotiation successful
0806 09:14:52.793152 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 09:14:52.798296 15467 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41300:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:14:52.806480 15467 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:14:52.861817 15946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:52.824910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45718 (local address 127.10.255.66:42655)
0806 09:14:52.840704 (+ 15794us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:52.840720 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:52.850108 (+ 9388us) server_negotiation.cc:407] Connection header received
0806 09:14:52.850240 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:52.850249 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:52.850625 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:52.850849 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:52.852160 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:52.853706 (+ 1546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:52.856940 (+ 3234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:52.858554 (+ 1614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:52.858694 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:52.858906 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:52.861139 (+ 2233us) server_negotiation.cc:299] Negotiation successful
0806 09:14:52.861352 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15481,"thread_start_us":15836,"threads_started":1}
I20260806 09:14:52.863200 15944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:52.827263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:41967 (local address 127.0.0.1:57736)
0806 09:14:52.853287 (+ 26024us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:52.853305 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:52.853421 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:52.854320 (+ 899us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:52.854325 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:52.854355 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:52.855003 (+ 648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:52.855017 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:52.857149 (+ 2132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:52.857154 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:52.859561 (+ 2407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:52.859577 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:52.861972 (+ 2395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:52.861979 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:52.862173 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:52.862207 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 09:14:52.862302 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 09:14:52.862434 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25895,"mutex_wait_us":62,"thread_start_us":21831,"threads_started":1}
I20260806 09:14:52.863303 15948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:52.827921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57736 (local address 127.10.255.65:41967)
0806 09:14:52.848830 (+ 20909us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:52.848844 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:52.853553 (+ 4709us) server_negotiation.cc:407] Connection header received
0806 09:14:52.853669 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:52.853677 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:52.853875 (+ 198us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:52.854062 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:52.855245 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:52.856914 (+ 1669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:52.859800 (+ 2886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:52.861395 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:52.861558 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:52.861808 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:52.862631 (+ 823us) server_negotiation.cc:299] Negotiation successful
0806 09:14:52.862826 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20701,"thread_start_us":20491,"threads_started":1}
I20260806 09:14:52.864071 15947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:52.824155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:42655 (local address 127.0.0.1:45718)
0806 09:14:52.849537 (+ 25382us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:52.849605 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:52.849853 (+ 248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:52.851214 (+ 1361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:52.851226 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:52.851273 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:52.851894 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:52.851914 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:52.853879 (+ 1965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:52.853885 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:52.856714 (+ 2829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:52.856737 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:52.859066 (+ 2329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:52.859073 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:52.860577 (+ 1504us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:52.860665 (+ 88us) client_negotiation.cc:769] Sending connection context
0806 09:14:52.860804 (+ 139us) client_negotiation.cc:240] Negotiation successful
0806 09:14:52.862326 (+ 1522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25102,"mutex_wait_us":72,"thread_start_us":28849,"threads_started":1}
I20260806 09:14:52.865223 15945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:52.824315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:38153 (local address 127.0.0.1:58972)
0806 09:14:52.852480 (+ 28165us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:52.852510 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:52.852708 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:52.853875 (+ 1167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:52.853880 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:52.853908 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:52.854480 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:52.854500 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:52.857941 (+ 3441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:52.857950 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:52.861060 (+ 3110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:52.861076 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:52.863823 (+ 2747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:52.863863 (+ 40us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:52.864079 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:52.864122 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 09:14:52.864690 (+ 568us) client_negotiation.cc:240] Negotiation successful
0806 09:14:52.864895 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27952,"thread_start_us":27703,"threads_started":1}
I20260806 09:14:52.865311 15949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:52.828397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58972 (local address 127.10.255.67:38153)
0806 09:14:52.844727 (+ 16330us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:52.844741 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:52.852695 (+ 7954us) server_negotiation.cc:407] Connection header received
0806 09:14:52.852894 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:52.852902 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:52.853195 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:52.855776 (+ 2581us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:52.856163 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:52.857757 (+ 1594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:52.861286 (+ 3529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:52.863018 (+ 1732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:52.863148 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:52.863400 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:52.864716 (+ 1316us) server_negotiation.cc:299] Negotiation successful
0806 09:14:52.864928 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16051,"thread_start_us":15795,"threads_started":1}
I20260806 09:14:52.867820 15726 tablet_service.cc:1467] Processing CreateTablet for tablet ba1ced6c0c0b49988a3c205f9c975c58 (DEFAULT_TABLE table=test-table [id=f7d26158995a4443b70a9301ffd01394]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:52.867924 15591 tablet_service.cc:1467] Processing CreateTablet for tablet ba1ced6c0c0b49988a3c205f9c975c58 (DEFAULT_TABLE table=test-table [id=f7d26158995a4443b70a9301ffd01394]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:52.869304 15726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba1ced6c0c0b49988a3c205f9c975c58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:52.869489 15591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba1ced6c0c0b49988a3c205f9c975c58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:52.869637 15862 tablet_service.cc:1467] Processing CreateTablet for tablet ba1ced6c0c0b49988a3c205f9c975c58 (DEFAULT_TABLE table=test-table [id=f7d26158995a4443b70a9301ffd01394]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:52.871155 15862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba1ced6c0c0b49988a3c205f9c975c58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:52.883891 15950 tablet_bootstrap.cc:492] T ba1ced6c0c0b49988a3c205f9c975c58 P a6394b29ac554b6983ec7f9b762f9d2f: Bootstrap starting.
I20260806 09:14:52.886543 15951 tablet_bootstrap.cc:492] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7: Bootstrap starting.
I20260806 09:14:52.888732 15952 tablet_bootstrap.cc:492] T ba1ced6c0c0b49988a3c205f9c975c58 P 00b4b6cd770945eab363bd824c5ef004: Bootstrap starting.
I20260806 09:14:52.889063 15950 tablet_bootstrap.cc:654] T ba1ced6c0c0b49988a3c205f9c975c58 P a6394b29ac554b6983ec7f9b762f9d2f: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:52.890585 15950 log.cc:824] T ba1ced6c0c0b49988a3c205f9c975c58 P a6394b29ac554b6983ec7f9b762f9d2f: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:52.890667 15951 tablet_bootstrap.cc:654] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:52.892061 15951 log.cc:824] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:52.894001 15952 tablet_bootstrap.cc:654] T ba1ced6c0c0b49988a3c205f9c975c58 P 00b4b6cd770945eab363bd824c5ef004: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:52.894428 15950 tablet_bootstrap.cc:492] T ba1ced6c0c0b49988a3c205f9c975c58 P a6394b29ac554b6983ec7f9b762f9d2f: No bootstrap required, opened a new log
I20260806 09:14:52.894760 15950 ts_tablet_manager.cc:1397] T ba1ced6c0c0b49988a3c205f9c975c58 P a6394b29ac554b6983ec7f9b762f9d2f: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260806 09:14:52.895262 15952 log.cc:824] T ba1ced6c0c0b49988a3c205f9c975c58 P 00b4b6cd770945eab363bd824c5ef004: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:52.895659 15951 tablet_bootstrap.cc:492] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7: No bootstrap required, opened a new log
I20260806 09:14:52.896006 15951 ts_tablet_manager.cc:1397] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260806 09:14:52.898371 15952 tablet_bootstrap.cc:492] T ba1ced6c0c0b49988a3c205f9c975c58 P 00b4b6cd770945eab363bd824c5ef004: No bootstrap required, opened a new log
I20260806 09:14:52.898702 15952 ts_tablet_manager.cc:1397] T ba1ced6c0c0b49988a3c205f9c975c58 P 00b4b6cd770945eab363bd824c5ef004: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.004s
I20260806 09:14:52.906596 15950 raft_consensus.cc:348] T ba1ced6c0c0b49988a3c205f9c975c58 P a6394b29ac554b6983ec7f9b762f9d2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6394b29ac554b6983ec7f9b762f9d2f" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 42655 } } peers { permanent_uuid: "00b4b6cd770945eab363bd824c5ef004" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38153 } } peers { permanent_uuid: "a6a90b175e7843a68e4507ec061350d7" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41967 } }
I20260806 09:14:52.906944 15952 raft_consensus.cc:348] T ba1ced6c0c0b49988a3c205f9c975c58 P 00b4b6cd770945eab363bd824c5ef004 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6394b29ac554b6983ec7f9b762f9d2f" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 42655 } } peers { permanent_uuid: "00b4b6cd770945eab363bd824c5ef004" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38153 } } peers { permanent_uuid: "a6a90b175e7843a68e4507ec061350d7" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41967 } }
I20260806 09:14:52.907219 15950 raft_consensus.cc:374] T ba1ced6c0c0b49988a3c205f9c975c58 P a6394b29ac554b6983ec7f9b762f9d2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:52.907346 15950 raft_consensus.cc:729] T ba1ced6c0c0b49988a3c205f9c975c58 P a6394b29ac554b6983ec7f9b762f9d2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6394b29ac554b6983ec7f9b762f9d2f, State: Initialized, Role: FOLLOWER
I20260806 09:14:52.907406 15952 raft_consensus.cc:374] T ba1ced6c0c0b49988a3c205f9c975c58 P 00b4b6cd770945eab363bd824c5ef004 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:52.907585 15952 raft_consensus.cc:729] T ba1ced6c0c0b49988a3c205f9c975c58 P 00b4b6cd770945eab363bd824c5ef004 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00b4b6cd770945eab363bd824c5ef004, State: Initialized, Role: FOLLOWER
I20260806 09:14:52.907368 15951 raft_consensus.cc:348] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6394b29ac554b6983ec7f9b762f9d2f" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 42655 } } peers { permanent_uuid: "00b4b6cd770945eab363bd824c5ef004" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38153 } } peers { permanent_uuid: "a6a90b175e7843a68e4507ec061350d7" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41967 } }
I20260806 09:14:52.907899 15951 raft_consensus.cc:374] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:52.908020 15951 raft_consensus.cc:729] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a90b175e7843a68e4507ec061350d7, State: Initialized, Role: FOLLOWER
I20260806 09:14:52.908267 15950 consensus_queue.cc:260] T ba1ced6c0c0b49988a3c205f9c975c58 P a6394b29ac554b6983ec7f9b762f9d2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6394b29ac554b6983ec7f9b762f9d2f" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 42655 } } peers { permanent_uuid: "00b4b6cd770945eab363bd824c5ef004" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38153 } } peers { permanent_uuid: "a6a90b175e7843a68e4507ec061350d7" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41967 } }
I20260806 09:14:52.908403 15952 consensus_queue.cc:260] T ba1ced6c0c0b49988a3c205f9c975c58 P 00b4b6cd770945eab363bd824c5ef004 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6394b29ac554b6983ec7f9b762f9d2f" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 42655 } } peers { permanent_uuid: "00b4b6cd770945eab363bd824c5ef004" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38153 } } peers { permanent_uuid: "a6a90b175e7843a68e4507ec061350d7" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41967 } }
I20260806 09:14:52.908787 15951 consensus_queue.cc:260] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6394b29ac554b6983ec7f9b762f9d2f" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 42655 } } peers { permanent_uuid: "00b4b6cd770945eab363bd824c5ef004" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38153 } } peers { permanent_uuid: "a6a90b175e7843a68e4507ec061350d7" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41967 } }
I20260806 09:14:52.909835 15792 heartbeater.cc:503] Master 127.10.255.126:45217 was elected leader, sending a full tablet report...
I20260806 09:14:52.910703 15950 ts_tablet_manager.cc:1428] T ba1ced6c0c0b49988a3c205f9c975c58 P a6394b29ac554b6983ec7f9b762f9d2f: Time spent starting tablet: real 0.016s user 0.017s sys 0.000s
I20260806 09:14:52.912549 15951 ts_tablet_manager.cc:1428] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7: Time spent starting tablet: real 0.016s user 0.011s sys 0.005s
I20260806 09:14:52.913826 15931 heartbeater.cc:503] Master 127.10.255.126:45217 was elected leader, sending a full tablet report...
I20260806 09:14:52.915791 15952 ts_tablet_manager.cc:1428] T ba1ced6c0c0b49988a3c205f9c975c58 P 00b4b6cd770945eab363bd824c5ef004: Time spent starting tablet: real 0.017s user 0.008s sys 0.009s
W20260806 09:14:52.978026 15932 tablet.cc:2369] T ba1ced6c0c0b49988a3c205f9c975c58 P 00b4b6cd770945eab363bd824c5ef004: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 09:14:53.038901 15658 tablet.cc:2369] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:14:53.131016 15958 raft_consensus.cc:482] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:14:53.131421 15958 raft_consensus.cc:504] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6394b29ac554b6983ec7f9b762f9d2f" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 42655 } } peers { permanent_uuid: "00b4b6cd770945eab363bd824c5ef004" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38153 } } peers { permanent_uuid: "a6a90b175e7843a68e4507ec061350d7" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41967 } }
W20260806 09:14:53.131870 15794 tablet.cc:2369] T ba1ced6c0c0b49988a3c205f9c975c58 P a6394b29ac554b6983ec7f9b762f9d2f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:14:53.133828 15958 leader_election.cc:288] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6394b29ac554b6983ec7f9b762f9d2f (127.10.255.66:42655), 00b4b6cd770945eab363bd824c5ef004 (127.10.255.67:38153)
I20260806 09:14:53.142984 15946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:53.134429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:53339 (local address 127.10.255.66:42655)
0806 09:14:53.134740 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:53.134749 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:53.135776 (+ 1027us) server_negotiation.cc:407] Connection header received
0806 09:14:53.136070 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:53.136076 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:53.136158 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:53.136262 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:53.137032 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:53.138138 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:53.140534 (+ 2396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:53.141869 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:53.142069 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:53.142152 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:53.142544 (+ 392us) server_negotiation.cc:299] Negotiation successful
0806 09:14:53.142707 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260806 09:14:53.143095 15949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:53.134735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:41599 (local address 127.10.255.67:38153)
0806 09:14:53.135001 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:53.135010 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:53.135482 (+ 472us) server_negotiation.cc:407] Connection header received
0806 09:14:53.135819 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:53.135825 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:53.135931 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:53.136066 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:14:53.136752 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:53.137898 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:53.140709 (+ 2811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:53.141951 (+ 1242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:53.142096 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:53.142162 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:53.142693 (+ 531us) server_negotiation.cc:299] Negotiation successful
0806 09:14:53.142842 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260806 09:14:53.143087 15959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:53.134250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:42655 (local address 127.10.255.65:53339)
0806 09:14:53.135685 (+ 1435us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:53.135703 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:53.135928 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:53.136284 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:53.136289 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:53.136320 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:53.136821 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:53.136834 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:53.138280 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:53.138334 (+ 54us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:53.140348 (+ 2014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:53.140365 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:53.142132 (+ 1767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:53.142139 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:53.142334 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:53.142378 (+ 44us) client_negotiation.cc:769] Sending connection context
0806 09:14:53.142492 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 09:14:53.142641 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1320,"mutex_wait_us":25,"thread_start_us":707,"threads_started":1}
I20260806 09:14:53.143791 15960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:53.134165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:38153 (local address 127.10.255.65:41599)
0806 09:14:53.135334 (+ 1169us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:53.135357 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:53.135635 (+ 278us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:53.136093 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:53.136098 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:53.136119 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:14:53.136592 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:53.136604 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:53.138046 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:53.138052 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:53.140473 (+ 2421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:53.140489 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:53.142315 (+ 1826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:53.142320 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:53.142492 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:53.142534 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 09:14:53.143301 (+ 767us) client_negotiation.cc:240] Negotiation successful
0806 09:14:53.143465 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1001,"mutex_wait_us":34,"thread_start_us":1211,"threads_started":1}
I20260806 09:14:53.144717 15747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba1ced6c0c0b49988a3c205f9c975c58" candidate_uuid: "a6a90b175e7843a68e4507ec061350d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6394b29ac554b6983ec7f9b762f9d2f" is_pre_election: true
I20260806 09:14:53.144891 15883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba1ced6c0c0b49988a3c205f9c975c58" candidate_uuid: "a6a90b175e7843a68e4507ec061350d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00b4b6cd770945eab363bd824c5ef004" is_pre_election: true
I20260806 09:14:53.145288 15747 raft_consensus.cc:2454] T ba1ced6c0c0b49988a3c205f9c975c58 P a6394b29ac554b6983ec7f9b762f9d2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a90b175e7843a68e4507ec061350d7 in term 0.
I20260806 09:14:53.145424 15883 raft_consensus.cc:2454] T ba1ced6c0c0b49988a3c205f9c975c58 P 00b4b6cd770945eab363bd824c5ef004 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a90b175e7843a68e4507ec061350d7 in term 0.
I20260806 09:14:53.146101 15546 leader_election.cc:302] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00b4b6cd770945eab363bd824c5ef004, a6a90b175e7843a68e4507ec061350d7; no voters:
I20260806 09:14:53.146620 15958 raft_consensus.cc:2781] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:14:53.146785 15958 raft_consensus.cc:482] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:14:53.146898 15958 raft_consensus.cc:3037] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:53.149379 15958 raft_consensus.cc:504] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6394b29ac554b6983ec7f9b762f9d2f" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 42655 } } peers { permanent_uuid: "00b4b6cd770945eab363bd824c5ef004" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38153 } } peers { permanent_uuid: "a6a90b175e7843a68e4507ec061350d7" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41967 } }
I20260806 09:14:53.150290 15958 leader_election.cc:288] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7 [CANDIDATE]: Term 1 election: Requested vote from peers a6394b29ac554b6983ec7f9b762f9d2f (127.10.255.66:42655), 00b4b6cd770945eab363bd824c5ef004 (127.10.255.67:38153)
I20260806 09:14:53.150822 15747 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba1ced6c0c0b49988a3c205f9c975c58" candidate_uuid: "a6a90b175e7843a68e4507ec061350d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6394b29ac554b6983ec7f9b762f9d2f"
I20260806 09:14:53.151115 15747 raft_consensus.cc:3037] T ba1ced6c0c0b49988a3c205f9c975c58 P a6394b29ac554b6983ec7f9b762f9d2f [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:53.151203 15883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba1ced6c0c0b49988a3c205f9c975c58" candidate_uuid: "a6a90b175e7843a68e4507ec061350d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00b4b6cd770945eab363bd824c5ef004"
I20260806 09:14:53.151510 15883 raft_consensus.cc:3037] T ba1ced6c0c0b49988a3c205f9c975c58 P 00b4b6cd770945eab363bd824c5ef004 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:53.153740 15747 raft_consensus.cc:2454] T ba1ced6c0c0b49988a3c205f9c975c58 P a6394b29ac554b6983ec7f9b762f9d2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a90b175e7843a68e4507ec061350d7 in term 1.
I20260806 09:14:53.154016 15883 raft_consensus.cc:2454] T ba1ced6c0c0b49988a3c205f9c975c58 P 00b4b6cd770945eab363bd824c5ef004 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a90b175e7843a68e4507ec061350d7 in term 1.
I20260806 09:14:53.154373 15547 leader_election.cc:302] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6394b29ac554b6983ec7f9b762f9d2f, a6a90b175e7843a68e4507ec061350d7; no voters:
I20260806 09:14:53.154734 15958 raft_consensus.cc:2781] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:14:53.155246 15958 raft_consensus.cc:686] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7 [term 1 LEADER]: Becoming Leader. State: Replica: a6a90b175e7843a68e4507ec061350d7, State: Running, Role: LEADER
I20260806 09:14:53.155799 15958 consensus_queue.cc:237] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6394b29ac554b6983ec7f9b762f9d2f" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 42655 } } peers { permanent_uuid: "00b4b6cd770945eab363bd824c5ef004" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38153 } } peers { permanent_uuid: "a6a90b175e7843a68e4507ec061350d7" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41967 } }
I20260806 09:14:53.161437 15467 catalog_manager.cc:5495] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a90b175e7843a68e4507ec061350d7 (127.10.255.65). New cstate: current_term: 1 leader_uuid: "a6a90b175e7843a68e4507ec061350d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a6394b29ac554b6983ec7f9b762f9d2f" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 42655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00b4b6cd770945eab363bd824c5ef004" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a90b175e7843a68e4507ec061350d7" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41967 } health_report { overall_health: HEALTHY } } }
I20260806 09:14:53.238868 15948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:53.231448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57752 (local address 127.10.255.65:41967)
0806 09:14:53.231716 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:53.231721 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:53.231765 (+ 44us) server_negotiation.cc:407] Connection header received
0806 09:14:53.231901 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:53.231905 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:53.231999 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:53.232157 (+ 158us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:14:53.232676 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:53.233533 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:53.235107 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:53.235584 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:53.235709 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:53.237110 (+ 1401us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:14:53.237780 (+ 670us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:14:53.237955 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:53.238294 (+ 339us) server_negotiation.cc:299] Negotiation successful
0806 09:14:53.238423 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260806 09:14:53.249034 15747 raft_consensus.cc:1261] T ba1ced6c0c0b49988a3c205f9c975c58 P a6394b29ac554b6983ec7f9b762f9d2f [term 1 FOLLOWER]: Refusing update from remote peer a6a90b175e7843a68e4507ec061350d7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:14:53.249033 15883 raft_consensus.cc:1261] T ba1ced6c0c0b49988a3c205f9c975c58 P 00b4b6cd770945eab363bd824c5ef004 [term 1 FOLLOWER]: Refusing update from remote peer a6a90b175e7843a68e4507ec061350d7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:14:53.250262 15958 consensus_queue.cc:1035] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6394b29ac554b6983ec7f9b762f9d2f" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 42655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:14:53.250653 15961 consensus_queue.cc:1035] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00b4b6cd770945eab363bd824c5ef004" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:14:53.287078 15466 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41300:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:14:53.287537 15466 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41300:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:14:53.292315 15466 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8b211b4642a84ef2834d924ccd022aa9: Sending DeleteTablet for 3 replicas of tablet ba1ced6c0c0b49988a3c205f9c975c58
I20260806 09:14:53.293952 15862 tablet_service.cc:1514] Processing DeleteTablet for tablet ba1ced6c0c0b49988a3c205f9c975c58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:14:53 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:58972
I20260806 09:14:53.293964 15591 tablet_service.cc:1514] Processing DeleteTablet for tablet ba1ced6c0c0b49988a3c205f9c975c58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:14:53 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:57736
I20260806 09:14:53.293942 15726 tablet_service.cc:1514] Processing DeleteTablet for tablet ba1ced6c0c0b49988a3c205f9c975c58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:14:53 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:45718
I20260806 09:14:53.296725 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 15529
I20260806 09:14:53.314204 15977 tablet_replica.cc:330] T ba1ced6c0c0b49988a3c205f9c975c58 P a6394b29ac554b6983ec7f9b762f9d2f: stopping tablet replica
I20260806 09:14:53.314862 15977 raft_consensus.cc:2229] T ba1ced6c0c0b49988a3c205f9c975c58 P a6394b29ac554b6983ec7f9b762f9d2f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:14:53.315480 15977 raft_consensus.cc:2258] T ba1ced6c0c0b49988a3c205f9c975c58 P a6394b29ac554b6983ec7f9b762f9d2f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:14:53.320122 15975 tablet_replica.cc:330] T ba1ced6c0c0b49988a3c205f9c975c58 P 00b4b6cd770945eab363bd824c5ef004: stopping tablet replica
I20260806 09:14:53.321141 15975 raft_consensus.cc:2229] T ba1ced6c0c0b49988a3c205f9c975c58 P 00b4b6cd770945eab363bd824c5ef004 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:14:53.321811 15975 raft_consensus.cc:2258] T ba1ced6c0c0b49988a3c205f9c975c58 P 00b4b6cd770945eab363bd824c5ef004 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:14:53.323127 15977 ts_tablet_manager.cc:1905] T ba1ced6c0c0b49988a3c205f9c975c58 P a6394b29ac554b6983ec7f9b762f9d2f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:14:53.327276 15976 tablet_replica.cc:330] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7: stopping tablet replica
I20260806 09:14:53.327939 15976 raft_consensus.cc:2229] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7 [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:14:53.328755 15976 raft_consensus.cc:2258] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7 [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 06 09:14:53 dist-test-slave-mvvj krb5kdc[15422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.65@KRBTEST.COM
I20260806 09:14:53.331670 15975 ts_tablet_manager.cc:1905] T ba1ced6c0c0b49988a3c205f9c975c58 P 00b4b6cd770945eab363bd824c5ef004: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:14:53.332168 15976 ts_tablet_manager.cc:1905] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:14:53.334218 15977 ts_tablet_manager.cc:1918] T ba1ced6c0c0b49988a3c205f9c975c58 P a6394b29ac554b6983ec7f9b762f9d2f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:14:53.334523 15977 log.cc:1196] T ba1ced6c0c0b49988a3c205f9c975c58 P a6394b29ac554b6983ec7f9b762f9d2f: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/ba1ced6c0c0b49988a3c205f9c975c58
I20260806 09:14:53.335212 15977 ts_tablet_manager.cc:1939] T ba1ced6c0c0b49988a3c205f9c975c58 P a6394b29ac554b6983ec7f9b762f9d2f: Deleting consensus metadata
I20260806 09:14:53.337724 15454 catalog_manager.cc:4841] TS a6394b29ac554b6983ec7f9b762f9d2f (127.10.255.66:42655): tablet ba1ced6c0c0b49988a3c205f9c975c58 (table test-table [id=f7d26158995a4443b70a9301ffd01394]) successfully deleted
I20260806 09:14:53.340142 15975 ts_tablet_manager.cc:1918] T ba1ced6c0c0b49988a3c205f9c975c58 P 00b4b6cd770945eab363bd824c5ef004: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:14:53.340433 15975 log.cc:1196] T ba1ced6c0c0b49988a3c205f9c975c58 P 00b4b6cd770945eab363bd824c5ef004: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/ba1ced6c0c0b49988a3c205f9c975c58
I20260806 09:14:53.341105 15975 ts_tablet_manager.cc:1939] T ba1ced6c0c0b49988a3c205f9c975c58 P 00b4b6cd770945eab363bd824c5ef004: Deleting consensus metadata
I20260806 09:14:53.343477 15976 ts_tablet_manager.cc:1918] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:14:53.343494 15452 catalog_manager.cc:4841] TS 00b4b6cd770945eab363bd824c5ef004 (127.10.255.67:38153): tablet ba1ced6c0c0b49988a3c205f9c975c58 (table test-table [id=f7d26158995a4443b70a9301ffd01394]) successfully deleted
I20260806 09:14:53.343703 15976 log.cc:1196] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786007647474472-11261-0/minicluster-data/ts-0/wal/wals/ba1ced6c0c0b49988a3c205f9c975c58
I20260806 09:14:53.344451 15976 ts_tablet_manager.cc:1939] T ba1ced6c0c0b49988a3c205f9c975c58 P a6a90b175e7843a68e4507ec061350d7: Deleting consensus metadata
I20260806 09:14:53.346613 15451 catalog_manager.cc:4841] TS a6a90b175e7843a68e4507ec061350d7 (127.10.255.65:41967): tablet ba1ced6c0c0b49988a3c205f9c975c58 (table test-table [id=f7d26158995a4443b70a9301ffd01394]) successfully deleted
I20260806 09:14:53.348878 15948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:53.299803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57756 (local address 127.10.255.65:41967)
0806 09:14:53.300051 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:53.300058 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:53.310522 (+ 10464us) server_negotiation.cc:407] Connection header received
0806 09:14:53.311156 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:53.311164 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:53.311279 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:53.311361 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:53.314038 (+ 2677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:53.315713 (+ 1675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:53.322977 (+ 7264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:53.324596 (+ 1619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:53.324796 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:53.340079 (+ 15283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:53.340118 (+ 39us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:53.340146 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:53.340216 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:53.345119 (+ 4903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:53.346059 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:53.346068 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:53.346071 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:53.346252 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:53.346846 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:53.346854 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:53.346857 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:53.347311 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:53.347665 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:53.348157 (+ 492us) server_negotiation.cc:299] Negotiation successful
0806 09:14:53.348463 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260806 09:14:53.349918 15652 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:53.488251 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 15529
I20260806 09:14:53.508891 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 15663
Aug 06 09:14:53 dist-test-slave-mvvj krb5kdc[15422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.66@KRBTEST.COM
I20260806 09:14:53.534155 15946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:53.510016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45724 (local address 127.10.255.66:42655)
0806 09:14:53.510241 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:53.510246 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:53.510269 (+ 23us) server_negotiation.cc:407] Connection header received
0806 09:14:53.510359 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:53.510364 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:53.510437 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:53.510622 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:53.512981 (+ 2359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:53.513812 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:53.516464 (+ 2652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:53.517333 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:53.517551 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:53.524840 (+ 7289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:53.524872 (+ 32us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:53.524889 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:53.524941 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:53.529661 (+ 4720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:53.530741 (+ 1080us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:53.530751 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:53.530754 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:53.530934 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:53.531477 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:53.531483 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:53.531485 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:53.532236 (+ 751us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:53.532633 (+ 397us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:53.533344 (+ 711us) server_negotiation.cc:299] Negotiation successful
0806 09:14:53.533751 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260806 09:14:53.535054 15787 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:53.636314 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 15663
I20260806 09:14:53.657137 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 15799
Aug 06 09:14:53 dist-test-slave-mvvj krb5kdc[15422](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.67@KRBTEST.COM
I20260806 09:14:53.676638 15981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:53.658154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58980 (local address 127.10.255.67:38153)
0806 09:14:53.658723 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:53.658729 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:53.658749 (+ 20us) server_negotiation.cc:407] Connection header received
0806 09:14:53.658810 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:53.658814 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:53.658875 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:53.658989 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:53.660593 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:53.661344 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:53.662906 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:53.663372 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:53.663534 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:53.669136 (+ 5602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:53.669159 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:53.669177 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:14:53.669227 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:53.672585 (+ 3358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:53.673791 (+ 1206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:53.673801 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:53.673804 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:53.674005 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:14:53.674550 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:14:53.674555 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:14:53.674557 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:14:53.675020 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:53.675500 (+ 480us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:53.675641 (+ 141us) server_negotiation.cc:299] Negotiation successful
0806 09:14:53.675987 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":281,"threads_started":1}
I20260806 09:14:53.677983 15925 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:53.778508 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 15799
I20260806 09:14:53.797164 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 15435
I20260806 09:14:53.798415 15498 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:53.914166 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 15435
2026-08-06T09:14:53Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4994 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-06T09:14:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:14:53Z Disabled control of system clock
I20260806 09:14:53.991750 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:41799
--webserver_interface=127.10.255.126
--webserver_port=0
--builtin_ntp_servers=127.10.255.84:43747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:41799
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 09:14:54.374635 15987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:54.374980 15987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:54.375126 15987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:54.384498 15987 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:14:54.384636 15987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:54.384676 15987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:54.384784 15987 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:14:54.384868 15987 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:14:54.395323 15987 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:41799
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:41799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:54.396879 15987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:54.398926 15987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:54.412358 15995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:54.412490 15992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:54.412479 15993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:54.413352 15987 server_base.cc:1034] running on GCE node
I20260806 09:14:54.414322 15987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:54.416200 15987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:54.417555 15987 hybrid_clock.cc:648] HybridClock initialized: now 1786007694417495 us; error 70 us; skew 500 ppm
I20260806 09:14:54.418074 15987 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:14:54.421314 15987 webserver.cc:460] Webserver started at http://127.10.255.126:42651/ using document root <none> and password file <none>
I20260806 09:14:54.422156 15987 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:54.422303 15987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:54.422691 15987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:54.425994 15987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "79fdf54b60904c81809cd0761ea1baf7"
format_stamp: "Formatted at 2026-08-06 09:14:54 on dist-test-slave-mvvj"
server_key: "65c0357ad3753d76fbd575b2e623aea5"
server_key_iv: "ea37d658ac0c46b03f965737914edc51"
server_key_version: "encryptionkey@0"
I20260806 09:14:54.426926 15987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "79fdf54b60904c81809cd0761ea1baf7"
format_stamp: "Formatted at 2026-08-06 09:14:54 on dist-test-slave-mvvj"
server_key: "65c0357ad3753d76fbd575b2e623aea5"
server_key_iv: "ea37d658ac0c46b03f965737914edc51"
server_key_version: "encryptionkey@0"
I20260806 09:14:54.432833 15987 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 09:14:54.436981 16001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:54.438869 15987 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 09:14:54.439128 15987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "79fdf54b60904c81809cd0761ea1baf7"
format_stamp: "Formatted at 2026-08-06 09:14:54 on dist-test-slave-mvvj"
server_key: "65c0357ad3753d76fbd575b2e623aea5"
server_key_iv: "ea37d658ac0c46b03f965737914edc51"
server_key_version: "encryptionkey@0"
I20260806 09:14:54.439426 15987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:54.446461 15987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:54.447481 15987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:54.447980 15987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:54.469575 15987 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:41799
I20260806 09:14:54.469691 16053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:41799 every 8 connection(s)
I20260806 09:14:54.471185 15987 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:14:54.475476 16054 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:54.479444 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 15987
I20260806 09:14:54.479717 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:14:54.480553 11261 external_mini_cluster.cc:1428] Setting key 4fea1f50f95f175cd1ff5f98cc09848f
I20260806 09:14:54.490253 16054 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79fdf54b60904c81809cd0761ea1baf7: Bootstrap starting.
I20260806 09:14:54.492695 16057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:54.483437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46956 (local address 127.10.255.126:41799)
0806 09:14:54.484842 (+ 1405us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:54.484860 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:54.484921 (+ 61us) server_negotiation.cc:407] Connection header received
0806 09:14:54.488020 (+ 3099us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:54.488061 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:54.488747 (+ 686us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:54.489278 (+ 531us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:54.490658 (+ 1380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:54.490666 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:54.490682 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:14:54.490701 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:54.490778 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:14:54.490803 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:54.491098 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:54.491268 (+ 170us) server_negotiation.cc:299] Negotiation successful
0806 09:14:54.491562 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":706,"thread_start_us":450,"threads_started":1}
I20260806 09:14:54.493973 16054 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79fdf54b60904c81809cd0761ea1baf7: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:54.495281 16054 log.cc:824] T 00000000000000000000000000000000 P 79fdf54b60904c81809cd0761ea1baf7: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:54.498689 16054 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79fdf54b60904c81809cd0761ea1baf7: No bootstrap required, opened a new log
I20260806 09:14:54.506896 16054 raft_consensus.cc:348] T 00000000000000000000000000000000 P 79fdf54b60904c81809cd0761ea1baf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79fdf54b60904c81809cd0761ea1baf7" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 41799 } }
I20260806 09:14:54.507370 16054 raft_consensus.cc:374] T 00000000000000000000000000000000 P 79fdf54b60904c81809cd0761ea1baf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:54.507488 16054 raft_consensus.cc:729] T 00000000000000000000000000000000 P 79fdf54b60904c81809cd0761ea1baf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79fdf54b60904c81809cd0761ea1baf7, State: Initialized, Role: FOLLOWER
I20260806 09:14:54.508136 16054 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79fdf54b60904c81809cd0761ea1baf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79fdf54b60904c81809cd0761ea1baf7" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 41799 } }
I20260806 09:14:54.508354 16054 raft_consensus.cc:388] T 00000000000000000000000000000000 P 79fdf54b60904c81809cd0761ea1baf7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:14:54.508458 16054 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79fdf54b60904c81809cd0761ea1baf7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:14:54.508601 16054 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79fdf54b60904c81809cd0761ea1baf7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:54.510878 16054 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79fdf54b60904c81809cd0761ea1baf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79fdf54b60904c81809cd0761ea1baf7" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 41799 } }
I20260806 09:14:54.511420 16054 leader_election.cc:302] T 00000000000000000000000000000000 P 79fdf54b60904c81809cd0761ea1baf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 79fdf54b60904c81809cd0761ea1baf7; no voters:
I20260806 09:14:54.512133 16054 leader_election.cc:288] T 00000000000000000000000000000000 P 79fdf54b60904c81809cd0761ea1baf7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:14:54.512310 16061 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79fdf54b60904c81809cd0761ea1baf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:14:54.513564 16061 raft_consensus.cc:686] T 00000000000000000000000000000000 P 79fdf54b60904c81809cd0761ea1baf7 [term 1 LEADER]: Becoming Leader. State: Replica: 79fdf54b60904c81809cd0761ea1baf7, State: Running, Role: LEADER
I20260806 09:14:54.514300 16061 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79fdf54b60904c81809cd0761ea1baf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79fdf54b60904c81809cd0761ea1baf7" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 41799 } }
I20260806 09:14:54.514715 16054 sys_catalog.cc:564] T 00000000000000000000000000000000 P 79fdf54b60904c81809cd0761ea1baf7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:14:54.518173 16062 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79fdf54b60904c81809cd0761ea1baf7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "79fdf54b60904c81809cd0761ea1baf7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79fdf54b60904c81809cd0761ea1baf7" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 41799 } } }
I20260806 09:14:54.518708 16062 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79fdf54b60904c81809cd0761ea1baf7 [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:54.518172 16063 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79fdf54b60904c81809cd0761ea1baf7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79fdf54b60904c81809cd0761ea1baf7. Latest consensus state: current_term: 1 leader_uuid: "79fdf54b60904c81809cd0761ea1baf7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79fdf54b60904c81809cd0761ea1baf7" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 41799 } } }
I20260806 09:14:54.518926 16063 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79fdf54b60904c81809cd0761ea1baf7 [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:54.521574 16067 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:14:54.535790 16067 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:14:54.545892 16067 catalog_manager.cc:1347] Generated new cluster ID: 8423e838829945a8b4daedb964f7f64e
I20260806 09:14:54.546042 16067 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:14:54.559145 16067 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:14:54.559763 16067 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:14:54.569422 16067 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 79fdf54b60904c81809cd0761ea1baf7: Generated new TSK 0
I20260806 09:14:54.570935 16067 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:14:54.588362 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:41799
--builtin_ntp_servers=127.10.255.84:43747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 09:14:54.960732 16080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:54.961103 16080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:54.961275 16080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:54.969111 16080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:54.969290 16080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:54.969487 16080 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:14:54.979357 16080 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:41799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:54.980921 16080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:54.982838 16080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:54.997627 16088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:54.997785 16085 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:54.997627 16086 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:54.998790 16080 server_base.cc:1034] running on GCE node
I20260806 09:14:54.999432 16080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:55.000690 16080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:55.001902 16080 hybrid_clock.cc:648] HybridClock initialized: now 1786007695001855 us; error 40 us; skew 500 ppm
I20260806 09:14:55.002280 16080 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:14:55.005117 16080 webserver.cc:460] Webserver started at http://127.10.255.65:44699/ using document root <none> and password file <none>
I20260806 09:14:55.005996 16080 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:55.006104 16080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:55.006403 16080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:55.009855 16080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "9f0a2ff4046847e7b407f432b021d971"
format_stamp: "Formatted at 2026-08-06 09:14:55 on dist-test-slave-mvvj"
server_key: "55a0b30ef26e52db02c34f1ffa5fd22d"
server_key_iv: "182796b7157a6e1fd748ceb905bef023"
server_key_version: "encryptionkey@0"
I20260806 09:14:55.010699 16080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "9f0a2ff4046847e7b407f432b021d971"
format_stamp: "Formatted at 2026-08-06 09:14:55 on dist-test-slave-mvvj"
server_key: "55a0b30ef26e52db02c34f1ffa5fd22d"
server_key_iv: "182796b7157a6e1fd748ceb905bef023"
server_key_version: "encryptionkey@0"
I20260806 09:14:55.017242 16080 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260806 09:14:55.021935 16094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:55.023919 16080 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260806 09:14:55.024155 16080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "9f0a2ff4046847e7b407f432b021d971"
format_stamp: "Formatted at 2026-08-06 09:14:55 on dist-test-slave-mvvj"
server_key: "55a0b30ef26e52db02c34f1ffa5fd22d"
server_key_iv: "182796b7157a6e1fd748ceb905bef023"
server_key_version: "encryptionkey@0"
I20260806 09:14:55.024451 16080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:55.031278 16080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:55.032339 16080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:55.032644 16080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:55.033696 16080 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:14:55.035269 16080 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:55.035400 16080 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:55.035533 16080 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:55.035650 16080 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:55.073643 16080 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:38635
I20260806 09:14:55.073745 16208 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:38635 every 8 connection(s)
I20260806 09:14:55.075033 16080 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:14:55.082690 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 16080
I20260806 09:14:55.082926 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:14:55.083797 11261 external_mini_cluster.cc:1428] Setting key 7f8a9924d84478f128e96535d075f807
I20260806 09:14:55.084554 16211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:55.077899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:38465 (local address 127.10.255.126:41799)
0806 09:14:55.078403 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:55.078410 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:55.079695 (+ 1285us) server_negotiation.cc:407] Connection header received
0806 09:14:55.081474 (+ 1779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:55.081479 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:55.081550 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:55.081661 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:55.083382 (+ 1721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:55.083389 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:55.083395 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:14:55.083418 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:55.083481 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:14:55.083502 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:55.083668 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:55.084020 (+ 352us) server_negotiation.cc:299] Negotiation successful
0806 09:14:55.084106 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359,"thread_start_us":225,"threads_started":1}
I20260806 09:14:55.085695 16212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:55.078584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41799 (local address 127.10.255.65:38465)
0806 09:14:55.079539 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:55.079574 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:55.081185 (+ 1611us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:55.081973 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:55.081983 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:55.082092 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:55.083008 (+ 916us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 09:14:55.083013 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:55.083074 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 09:14:55.083181 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:55.083653 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:55.083663 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:55.083671 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 09:14:55.084095 (+ 424us) client_negotiation.cc:240] Negotiation successful
0806 09:14:55.084341 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"thread_start_us":317,"threads_started":1}
I20260806 09:14:55.087488 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:41799
--builtin_ntp_servers=127.10.255.84:43747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260806 09:14:55.087510 16209 heartbeater.cc:347] Connected to a master server at 127.10.255.126:41799
I20260806 09:14:55.087908 16209 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:55.088641 16209 heartbeater.cc:511] Master 127.10.255.126:41799 requested a full tablet report, sending...
I20260806 09:14:55.091104 16018 ts_manager.cc:194] Registered new tserver with Master: 9f0a2ff4046847e7b407f432b021d971 (127.10.255.65:38635)
W20260806 09:14:55.444977 16213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:55.445298 16213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:55.445390 16213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:55.453259 16213 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:55.453377 16213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:55.453491 16213 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:14:55.465961 16213 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:41799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:55.467590 16213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:55.469599 16213 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:55.486887 16219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:55.486887 16218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:55.487121 16221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:55.487989 16213 server_base.cc:1034] running on GCE node
I20260806 09:14:55.488689 16213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:55.489744 16213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:55.490974 16213 hybrid_clock.cc:648] HybridClock initialized: now 1786007695490924 us; error 29 us; skew 500 ppm
I20260806 09:14:55.491324 16213 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:14:55.493870 16213 webserver.cc:460] Webserver started at http://127.10.255.66:43157/ using document root <none> and password file <none>
I20260806 09:14:55.494715 16213 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:55.494845 16213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:55.495229 16213 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:55.498526 16213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "1f4f9a298c1b4a628e364b5d24072350"
format_stamp: "Formatted at 2026-08-06 09:14:55 on dist-test-slave-mvvj"
server_key: "a4f5c49ff45b414b7968f91551320720"
server_key_iv: "84c11476d875fa497332e70e524fa366"
server_key_version: "encryptionkey@0"
I20260806 09:14:55.499512 16213 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "1f4f9a298c1b4a628e364b5d24072350"
format_stamp: "Formatted at 2026-08-06 09:14:55 on dist-test-slave-mvvj"
server_key: "a4f5c49ff45b414b7968f91551320720"
server_key_iv: "84c11476d875fa497332e70e524fa366"
server_key_version: "encryptionkey@0"
I20260806 09:14:55.505968 16213 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.001s
I20260806 09:14:55.510370 16227 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:55.512164 16213 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:14:55.512378 16213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "1f4f9a298c1b4a628e364b5d24072350"
format_stamp: "Formatted at 2026-08-06 09:14:55 on dist-test-slave-mvvj"
server_key: "a4f5c49ff45b414b7968f91551320720"
server_key_iv: "84c11476d875fa497332e70e524fa366"
server_key_version: "encryptionkey@0"
I20260806 09:14:55.512676 16213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:55.519120 16213 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:55.520324 16213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:55.520653 16213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:55.521886 16213 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:14:55.523789 16213 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:55.523953 16213 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260806 09:14:55.524088 16213 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:55.524189 16213 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:55.561089 16213 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:33871
I20260806 09:14:55.561154 16340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:33871 every 8 connection(s)
I20260806 09:14:55.562687 16213 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:14:55.571458 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 16213
I20260806 09:14:55.571638 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:14:55.572283 11261 external_mini_cluster.cc:1428] Setting key 8edfeeb5de716b615342d33f7b182d0a
I20260806 09:14:55.573194 16211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:55.565613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:54099 (local address 127.10.255.126:41799)
0806 09:14:55.565863 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:55.565878 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:55.567603 (+ 1725us) server_negotiation.cc:407] Connection header received
0806 09:14:55.569974 (+ 2371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:55.569980 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:55.570124 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:55.570264 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:55.572302 (+ 2038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:55.572312 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:55.572316 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:14:55.572345 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:55.572394 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:14:55.572414 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:55.572587 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:55.572859 (+ 272us) server_negotiation.cc:299] Negotiation successful
0806 09:14:55.572936 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 09:14:55.574797 16343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:55.566338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41799 (local address 127.10.255.66:54099)
0806 09:14:55.567365 (+ 1027us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:55.567411 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:55.569487 (+ 2076us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:55.570602 (+ 1115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:55.570613 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:55.570732 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:55.571720 (+ 988us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 09:14:55.571725 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:55.571795 (+ 70us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 09:14:55.572020 (+ 225us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:55.572546 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:55.572557 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:55.572564 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 09:14:55.572910 (+ 346us) client_negotiation.cc:240] Negotiation successful
0806 09:14:55.573287 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":310,"threads_started":1}
I20260806 09:14:55.576346 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:41799
--builtin_ntp_servers=127.10.255.84:43747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260806 09:14:55.576654 16341 heartbeater.cc:347] Connected to a master server at 127.10.255.126:41799
I20260806 09:14:55.577054 16341 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:55.577745 16341 heartbeater.cc:511] Master 127.10.255.126:41799 requested a full tablet report, sending...
I20260806 09:14:55.579514 16018 ts_manager.cc:194] Registered new tserver with Master: 1f4f9a298c1b4a628e364b5d24072350 (127.10.255.66:33871)
W20260806 09:14:55.936002 16345 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:55.936343 16345 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:55.936440 16345 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:55.944463 16345 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:55.944597 16345 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:55.944795 16345 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:14:55.955108 16345 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:41799
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:55.956527 16345 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:55.958421 16345 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:55.973845 16350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:55.973819 16351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:55.973941 16353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:55.977766 16345 server_base.cc:1034] running on GCE node
I20260806 09:14:55.978497 16345 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:55.979686 16345 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:55.980960 16345 hybrid_clock.cc:648] HybridClock initialized: now 1786007695980871 us; error 75 us; skew 500 ppm
I20260806 09:14:55.981365 16345 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:14:55.984126 16345 webserver.cc:460] Webserver started at http://127.10.255.67:45465/ using document root <none> and password file <none>
I20260806 09:14:55.984923 16345 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:55.985029 16345 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:55.985323 16345 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:55.988727 16345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "450745faba8b4e7dab18354005f0d65a"
format_stamp: "Formatted at 2026-08-06 09:14:55 on dist-test-slave-mvvj"
server_key: "2573cb764bb9612643eb9b9afc0b02c9"
server_key_iv: "4bf45ed8cd9215e948612200108dc8c4"
server_key_version: "encryptionkey@0"
I20260806 09:14:55.989677 16345 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "450745faba8b4e7dab18354005f0d65a"
format_stamp: "Formatted at 2026-08-06 09:14:55 on dist-test-slave-mvvj"
server_key: "2573cb764bb9612643eb9b9afc0b02c9"
server_key_iv: "4bf45ed8cd9215e948612200108dc8c4"
server_key_version: "encryptionkey@0"
I20260806 09:14:55.996058 16345 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 09:14:56.000682 16359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:56.002570 16345 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:14:56.002803 16345 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "450745faba8b4e7dab18354005f0d65a"
format_stamp: "Formatted at 2026-08-06 09:14:55 on dist-test-slave-mvvj"
server_key: "2573cb764bb9612643eb9b9afc0b02c9"
server_key_iv: "4bf45ed8cd9215e948612200108dc8c4"
server_key_version: "encryptionkey@0"
I20260806 09:14:56.003177 16345 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:56.010208 16345 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:56.011126 16345 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:56.011400 16345 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:56.012534 16345 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:14:56.014242 16345 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:14:56.014346 16345 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:56.014447 16345 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:14:56.014510 16345 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:56.054945 16345 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:34269
I20260806 09:14:56.055054 16472 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:34269 every 8 connection(s)
I20260806 09:14:56.056396 16345 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:14:56.061597 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 16345
I20260806 09:14:56.061803 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:14:56.062414 11261 external_mini_cluster.cc:1428] Setting key 0f59e15c61934b0c69c1b1b0d62128e3
I20260806 09:14:56.066551 16211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:56.059154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:56443 (local address 127.10.255.126:41799)
0806 09:14:56.059356 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:56.059360 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:56.061048 (+ 1688us) server_negotiation.cc:407] Connection header received
0806 09:14:56.063737 (+ 2689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:56.063742 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:56.063817 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:56.064002 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:56.065644 (+ 1642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:56.065666 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:56.065671 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:14:56.065699 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:56.065738 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:14:56.065751 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:56.065889 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:56.066136 (+ 247us) server_negotiation.cc:299] Negotiation successful
0806 09:14:56.066219 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 09:14:56.067538 16475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:56.059655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41799 (local address 127.10.255.67:56443)
0806 09:14:56.060763 (+ 1108us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:56.060806 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:56.063372 (+ 2566us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:56.064259 (+ 887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:56.064268 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:56.064375 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:56.065258 (+ 883us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 09:14:56.065261 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:56.065302 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 09:14:56.065400 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:56.065874 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:56.065886 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:56.065895 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 09:14:56.066221 (+ 326us) client_negotiation.cc:240] Negotiation successful
0806 09:14:56.066464 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"thread_start_us":426,"threads_started":1}
I20260806 09:14:56.069226 16473 heartbeater.cc:347] Connected to a master server at 127.10.255.126:41799
I20260806 09:14:56.069612 16473 heartbeater.cc:464] Registering TS with master...
I20260806 09:14:56.070271 16473 heartbeater.cc:511] Master 127.10.255.126:41799 requested a full tablet report, sending...
I20260806 09:14:56.071987 16018 ts_manager.cc:194] Registered new tserver with Master: 450745faba8b4e7dab18354005f0d65a (127.10.255.67:34269)
I20260806 09:14:56.079540 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 09:14:56.087538 16211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:56.084523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46970 (local address 127.10.255.126:41799)
0806 09:14:56.084721 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:56.084725 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:56.085295 (+ 570us) server_negotiation.cc:407] Connection header received
0806 09:14:56.085443 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:56.085447 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:56.085548 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:56.085645 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:56.086828 (+ 1183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:56.086833 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:56.086836 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:14:56.086852 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:56.086886 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:14:56.086899 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:56.087017 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:56.087215 (+ 198us) server_negotiation.cc:299] Negotiation successful
0806 09:14:56.087281 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 09:14:56.094738 16209 heartbeater.cc:503] Master 127.10.255.126:41799 was elected leader, sending a full tablet report...
I20260806 09:14:56.092556 16018 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46970:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:14:56.100454 16018 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:14:56.140930 16488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:56.115129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51898 (local address 127.10.255.67:34269)
0806 09:14:56.133008 (+ 17879us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:56.133024 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:56.137695 (+ 4671us) server_negotiation.cc:407] Connection header received
0806 09:14:56.137941 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:56.137953 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:56.138206 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:56.138427 (+ 221us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:56.139798 (+ 1371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:56.139810 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:56.139825 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:14:56.139880 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:56.139941 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:14:56.139965 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:56.140169 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:56.140339 (+ 170us) server_negotiation.cc:299] Negotiation successful
0806 09:14:56.140457 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17547,"thread_start_us":17889,"threads_started":1}
I20260806 09:14:56.140965 16491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:56.114837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:34269 (local address 127.0.0.1:51898)
0806 09:14:56.137266 (+ 22429us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:56.137315 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:56.137753 (+ 438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:56.138440 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:56.138449 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:56.138571 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:56.139467 (+ 896us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 09:14:56.139472 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:56.139509 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 09:14:56.139603 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:56.140104 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:56.140124 (+ 20us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:56.140135 (+ 11us) client_negotiation.cc:769] Sending connection context
0806 09:14:56.140388 (+ 253us) client_negotiation.cc:240] Negotiation successful
0806 09:14:56.140488 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22093,"thread_start_us":23177,"threads_started":1}
I20260806 09:14:56.142227 16486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:56.118439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:33871 (local address 127.0.0.1:33050)
0806 09:14:56.138274 (+ 19835us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:56.138295 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:56.138411 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:56.139906 (+ 1495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:56.139911 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:56.139983 (+ 72us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:56.140958 (+ 975us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 09:14:56.140964 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:56.140981 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 09:14:56.141021 (+ 40us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:56.141549 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:56.141555 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:56.141560 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 09:14:56.141704 (+ 144us) client_negotiation.cc:240] Negotiation successful
0806 09:14:56.141779 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19711,"thread_start_us":18253,"threads_started":1}
I20260806 09:14:56.142848 16489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:56.115412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45324 (local address 127.10.255.65:38635)
0806 09:14:56.136636 (+ 21224us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:56.136651 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:56.137777 (+ 1126us) server_negotiation.cc:407] Connection header received
0806 09:14:56.137901 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:56.137915 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:56.138202 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:56.138435 (+ 233us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:56.141511 (+ 3076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:56.141520 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:56.141534 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:14:56.141556 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:56.141617 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:14:56.141639 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:56.141829 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:56.142332 (+ 503us) server_negotiation.cc:299] Negotiation successful
0806 09:14:56.142444 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20946,"thread_start_us":20749,"threads_started":1}
I20260806 09:14:56.142939 16490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:56.118538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33050 (local address 127.10.255.66:33871)
0806 09:14:56.136783 (+ 18245us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:56.136793 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:56.138548 (+ 1755us) server_negotiation.cc:407] Connection header received
0806 09:14:56.138633 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:56.138641 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:56.138853 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:56.139026 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:56.141217 (+ 2191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:56.141226 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:56.141240 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:14:56.141259 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:56.141322 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:14:56.141345 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:56.141481 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:56.142559 (+ 1078us) server_negotiation.cc:299] Negotiation successful
0806 09:14:56.142670 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15182,"thread_start_us":15033,"threads_started":1}
I20260806 09:14:56.143491 16487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:56.114970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:38635 (local address 127.0.0.1:45324)
0806 09:14:56.137374 (+ 22404us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:56.137405 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:56.137567 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:56.139117 (+ 1550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:56.139124 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:56.139149 (+ 25us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:56.140654 (+ 1505us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 09:14:56.140658 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:56.140677 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 09:14:56.140730 (+ 53us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:56.141893 (+ 1163us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:56.141908 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:56.141913 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 09:14:56.142084 (+ 171us) client_negotiation.cc:240] Negotiation successful
0806 09:14:56.142145 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22206,"thread_start_us":22518,"threads_started":1}
I20260806 09:14:56.146163 16408 tablet_service.cc:1467] Processing CreateTablet for tablet 554a32238571462a90a2854e2e7df666 (DEFAULT_TABLE table=test-table [id=71f5e161234f4b1ba86403918e6e9bdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:56.147122 16276 tablet_service.cc:1467] Processing CreateTablet for tablet 554a32238571462a90a2854e2e7df666 (DEFAULT_TABLE table=test-table [id=71f5e161234f4b1ba86403918e6e9bdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:56.147450 16142 tablet_service.cc:1467] Processing CreateTablet for tablet 554a32238571462a90a2854e2e7df666 (DEFAULT_TABLE table=test-table [id=71f5e161234f4b1ba86403918e6e9bdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:14:56.148072 16408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 554a32238571462a90a2854e2e7df666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:56.148510 16276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 554a32238571462a90a2854e2e7df666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:56.148905 16142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 554a32238571462a90a2854e2e7df666. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:56.161860 16492 tablet_bootstrap.cc:492] T 554a32238571462a90a2854e2e7df666 P 1f4f9a298c1b4a628e364b5d24072350: Bootstrap starting.
I20260806 09:14:56.165133 16493 tablet_bootstrap.cc:492] T 554a32238571462a90a2854e2e7df666 P 9f0a2ff4046847e7b407f432b021d971: Bootstrap starting.
I20260806 09:14:56.165912 16492 tablet_bootstrap.cc:654] T 554a32238571462a90a2854e2e7df666 P 1f4f9a298c1b4a628e364b5d24072350: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:56.167477 16492 log.cc:824] T 554a32238571462a90a2854e2e7df666 P 1f4f9a298c1b4a628e364b5d24072350: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:56.169492 16493 tablet_bootstrap.cc:654] T 554a32238571462a90a2854e2e7df666 P 9f0a2ff4046847e7b407f432b021d971: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:56.170650 16494 tablet_bootstrap.cc:492] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a: Bootstrap starting.
I20260806 09:14:56.171037 16493 log.cc:824] T 554a32238571462a90a2854e2e7df666 P 9f0a2ff4046847e7b407f432b021d971: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:56.171175 16492 tablet_bootstrap.cc:492] T 554a32238571462a90a2854e2e7df666 P 1f4f9a298c1b4a628e364b5d24072350: No bootstrap required, opened a new log
I20260806 09:14:56.171458 16492 ts_tablet_manager.cc:1397] T 554a32238571462a90a2854e2e7df666 P 1f4f9a298c1b4a628e364b5d24072350: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.004s
I20260806 09:14:56.174588 16494 tablet_bootstrap.cc:654] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:56.174695 16493 tablet_bootstrap.cc:492] T 554a32238571462a90a2854e2e7df666 P 9f0a2ff4046847e7b407f432b021d971: No bootstrap required, opened a new log
I20260806 09:14:56.175021 16493 ts_tablet_manager.cc:1397] T 554a32238571462a90a2854e2e7df666 P 9f0a2ff4046847e7b407f432b021d971: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.002s
I20260806 09:14:56.175930 16494 log.cc:824] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:56.179437 16494 tablet_bootstrap.cc:492] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a: No bootstrap required, opened a new log
I20260806 09:14:56.179725 16494 ts_tablet_manager.cc:1397] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.003s
I20260806 09:14:56.179877 16492 raft_consensus.cc:348] T 554a32238571462a90a2854e2e7df666 P 1f4f9a298c1b4a628e364b5d24072350 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "450745faba8b4e7dab18354005f0d65a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34269 } } peers { permanent_uuid: "9f0a2ff4046847e7b407f432b021d971" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 38635 } } peers { permanent_uuid: "1f4f9a298c1b4a628e364b5d24072350" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 33871 } }
I20260806 09:14:56.180315 16492 raft_consensus.cc:374] T 554a32238571462a90a2854e2e7df666 P 1f4f9a298c1b4a628e364b5d24072350 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:56.180424 16492 raft_consensus.cc:729] T 554a32238571462a90a2854e2e7df666 P 1f4f9a298c1b4a628e364b5d24072350 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f4f9a298c1b4a628e364b5d24072350, State: Initialized, Role: FOLLOWER
I20260806 09:14:56.181138 16492 consensus_queue.cc:260] T 554a32238571462a90a2854e2e7df666 P 1f4f9a298c1b4a628e364b5d24072350 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "450745faba8b4e7dab18354005f0d65a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34269 } } peers { permanent_uuid: "9f0a2ff4046847e7b407f432b021d971" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 38635 } } peers { permanent_uuid: "1f4f9a298c1b4a628e364b5d24072350" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 33871 } }
I20260806 09:14:56.182312 16341 heartbeater.cc:503] Master 127.10.255.126:41799 was elected leader, sending a full tablet report...
I20260806 09:14:56.182960 16492 ts_tablet_manager.cc:1428] T 554a32238571462a90a2854e2e7df666 P 1f4f9a298c1b4a628e364b5d24072350: Time spent starting tablet: real 0.011s user 0.004s sys 0.008s
I20260806 09:14:56.185489 16493 raft_consensus.cc:348] T 554a32238571462a90a2854e2e7df666 P 9f0a2ff4046847e7b407f432b021d971 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "450745faba8b4e7dab18354005f0d65a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34269 } } peers { permanent_uuid: "9f0a2ff4046847e7b407f432b021d971" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 38635 } } peers { permanent_uuid: "1f4f9a298c1b4a628e364b5d24072350" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 33871 } }
I20260806 09:14:56.186007 16493 raft_consensus.cc:374] T 554a32238571462a90a2854e2e7df666 P 9f0a2ff4046847e7b407f432b021d971 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:56.186124 16493 raft_consensus.cc:729] T 554a32238571462a90a2854e2e7df666 P 9f0a2ff4046847e7b407f432b021d971 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0a2ff4046847e7b407f432b021d971, State: Initialized, Role: FOLLOWER
I20260806 09:14:56.186919 16493 consensus_queue.cc:260] T 554a32238571462a90a2854e2e7df666 P 9f0a2ff4046847e7b407f432b021d971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "450745faba8b4e7dab18354005f0d65a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34269 } } peers { permanent_uuid: "9f0a2ff4046847e7b407f432b021d971" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 38635 } } peers { permanent_uuid: "1f4f9a298c1b4a628e364b5d24072350" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 33871 } }
I20260806 09:14:56.188951 16493 ts_tablet_manager.cc:1428] T 554a32238571462a90a2854e2e7df666 P 9f0a2ff4046847e7b407f432b021d971: Time spent starting tablet: real 0.014s user 0.010s sys 0.002s
I20260806 09:14:56.190711 16494 raft_consensus.cc:348] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "450745faba8b4e7dab18354005f0d65a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34269 } } peers { permanent_uuid: "9f0a2ff4046847e7b407f432b021d971" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 38635 } } peers { permanent_uuid: "1f4f9a298c1b4a628e364b5d24072350" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 33871 } }
I20260806 09:14:56.191174 16494 raft_consensus.cc:374] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:56.191296 16494 raft_consensus.cc:729] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 450745faba8b4e7dab18354005f0d65a, State: Initialized, Role: FOLLOWER
I20260806 09:14:56.192003 16494 consensus_queue.cc:260] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "450745faba8b4e7dab18354005f0d65a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34269 } } peers { permanent_uuid: "9f0a2ff4046847e7b407f432b021d971" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 38635 } } peers { permanent_uuid: "1f4f9a298c1b4a628e364b5d24072350" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 33871 } }
I20260806 09:14:56.193187 16473 heartbeater.cc:503] Master 127.10.255.126:41799 was elected leader, sending a full tablet report...
I20260806 09:14:56.193900 16494 ts_tablet_manager.cc:1428] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a: Time spent starting tablet: real 0.014s user 0.014s sys 0.000s
I20260806 09:14:56.246773 16500 raft_consensus.cc:482] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:14:56.247164 16500 raft_consensus.cc:504] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "450745faba8b4e7dab18354005f0d65a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34269 } } peers { permanent_uuid: "9f0a2ff4046847e7b407f432b021d971" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 38635 } } peers { permanent_uuid: "1f4f9a298c1b4a628e364b5d24072350" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 33871 } }
I20260806 09:14:56.249130 16500 leader_election.cc:288] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f0a2ff4046847e7b407f432b021d971 (127.10.255.65:38635), 1f4f9a298c1b4a628e364b5d24072350 (127.10.255.66:33871)
I20260806 09:14:56.251957 16489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:56.249624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:59977 (local address 127.10.255.65:38635)
0806 09:14:56.249848 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:56.249855 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:56.249880 (+ 25us) server_negotiation.cc:407] Connection header received
0806 09:14:56.250078 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:56.250084 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:56.250153 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:56.250288 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:56.251289 (+ 1001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:56.251302 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:56.251306 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:14:56.251321 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:56.251356 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:14:56.251368 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:56.251503 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:56.251586 (+ 83us) server_negotiation.cc:299] Negotiation successful
0806 09:14:56.251650 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260806 09:14:56.251958 16475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:56.249378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:38635 (local address 127.10.255.67:59977)
0806 09:14:56.249733 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:56.249761 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:56.249880 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:56.250331 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:56.250335 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:56.250362 (+ 27us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:56.251076 (+ 714us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 09:14:56.251078 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:56.251097 (+ 19us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 09:14:56.251138 (+ 41us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:56.251469 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:56.251474 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:56.251480 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 09:14:56.251588 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 09:14:56.251649 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209}
I20260806 09:14:56.252715 16490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:56.249933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:56889 (local address 127.10.255.66:33871)
0806 09:14:56.250128 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:56.250133 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:56.250515 (+ 382us) server_negotiation.cc:407] Connection header received
0806 09:14:56.250702 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:56.250706 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:56.250757 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:56.250889 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:56.251893 (+ 1004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:56.251900 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:56.251904 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:14:56.251923 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:56.251963 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:14:56.251975 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:56.252137 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:56.252381 (+ 244us) server_negotiation.cc:299] Negotiation successful
0806 09:14:56.252455 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 09:14:56.252815 16501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:56.249656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:33871 (local address 127.10.255.67:56889)
0806 09:14:56.250388 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:56.250408 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:56.250557 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:56.250906 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:56.250913 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:56.250942 (+ 29us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:14:56.251656 (+ 714us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 09:14:56.251658 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:14:56.251671 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 09:14:56.251708 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:14:56.252194 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:14:56.252198 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:14:56.252202 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 09:14:56.252336 (+ 134us) client_negotiation.cc:240] Negotiation successful
0806 09:14:56.252385 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":418,"threads_started":1}
I20260806 09:14:56.253193 16162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "554a32238571462a90a2854e2e7df666" candidate_uuid: "450745faba8b4e7dab18354005f0d65a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0a2ff4046847e7b407f432b021d971" is_pre_election: true
I20260806 09:14:56.253880 16162 raft_consensus.cc:2454] T 554a32238571462a90a2854e2e7df666 P 9f0a2ff4046847e7b407f432b021d971 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 450745faba8b4e7dab18354005f0d65a in term 0.
I20260806 09:14:56.253816 16296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "554a32238571462a90a2854e2e7df666" candidate_uuid: "450745faba8b4e7dab18354005f0d65a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f4f9a298c1b4a628e364b5d24072350" is_pre_election: true
I20260806 09:14:56.254377 16296 raft_consensus.cc:2454] T 554a32238571462a90a2854e2e7df666 P 1f4f9a298c1b4a628e364b5d24072350 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 450745faba8b4e7dab18354005f0d65a in term 0.
I20260806 09:14:56.254694 16361 leader_election.cc:302] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 450745faba8b4e7dab18354005f0d65a, 9f0a2ff4046847e7b407f432b021d971; no voters:
I20260806 09:14:56.255165 16500 raft_consensus.cc:2781] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:14:56.255303 16500 raft_consensus.cc:482] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:14:56.255429 16500 raft_consensus.cc:3037] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:56.257799 16500 raft_consensus.cc:504] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "450745faba8b4e7dab18354005f0d65a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34269 } } peers { permanent_uuid: "9f0a2ff4046847e7b407f432b021d971" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 38635 } } peers { permanent_uuid: "1f4f9a298c1b4a628e364b5d24072350" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 33871 } }
I20260806 09:14:56.258469 16500 leader_election.cc:288] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a [CANDIDATE]: Term 1 election: Requested vote from peers 9f0a2ff4046847e7b407f432b021d971 (127.10.255.65:38635), 1f4f9a298c1b4a628e364b5d24072350 (127.10.255.66:33871)
I20260806 09:14:56.258970 16162 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "554a32238571462a90a2854e2e7df666" candidate_uuid: "450745faba8b4e7dab18354005f0d65a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0a2ff4046847e7b407f432b021d971"
I20260806 09:14:56.259045 16296 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "554a32238571462a90a2854e2e7df666" candidate_uuid: "450745faba8b4e7dab18354005f0d65a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f4f9a298c1b4a628e364b5d24072350"
I20260806 09:14:56.259178 16162 raft_consensus.cc:3037] T 554a32238571462a90a2854e2e7df666 P 9f0a2ff4046847e7b407f432b021d971 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:56.259321 16296 raft_consensus.cc:3037] T 554a32238571462a90a2854e2e7df666 P 1f4f9a298c1b4a628e364b5d24072350 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:56.261737 16162 raft_consensus.cc:2454] T 554a32238571462a90a2854e2e7df666 P 9f0a2ff4046847e7b407f432b021d971 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 450745faba8b4e7dab18354005f0d65a in term 1.
I20260806 09:14:56.261766 16296 raft_consensus.cc:2454] T 554a32238571462a90a2854e2e7df666 P 1f4f9a298c1b4a628e364b5d24072350 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 450745faba8b4e7dab18354005f0d65a in term 1.
I20260806 09:14:56.262234 16361 leader_election.cc:302] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 450745faba8b4e7dab18354005f0d65a, 9f0a2ff4046847e7b407f432b021d971; no voters:
I20260806 09:14:56.262570 16500 raft_consensus.cc:2781] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:14:56.263089 16500 raft_consensus.cc:686] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a [term 1 LEADER]: Becoming Leader. State: Replica: 450745faba8b4e7dab18354005f0d65a, State: Running, Role: LEADER
I20260806 09:14:56.263593 16500 consensus_queue.cc:237] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "450745faba8b4e7dab18354005f0d65a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34269 } } peers { permanent_uuid: "9f0a2ff4046847e7b407f432b021d971" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 38635 } } peers { permanent_uuid: "1f4f9a298c1b4a628e364b5d24072350" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 33871 } }
I20260806 09:14:56.269001 16018 catalog_manager.cc:5495] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a reported cstate change: term changed from 0 to 1, leader changed from <none> to 450745faba8b4e7dab18354005f0d65a (127.10.255.67). New cstate: current_term: 1 leader_uuid: "450745faba8b4e7dab18354005f0d65a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "450745faba8b4e7dab18354005f0d65a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f0a2ff4046847e7b407f432b021d971" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 38635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f4f9a298c1b4a628e364b5d24072350" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 33871 } health_report { overall_health: UNKNOWN } } }
I20260806 09:14:56.284694 16488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:56.282385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57106 (local address 127.10.255.67:34269)
0806 09:14:56.282576 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:56.282582 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:56.282603 (+ 21us) server_negotiation.cc:407] Connection header received
0806 09:14:56.282765 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:56.282769 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:56.282862 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:56.282949 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:56.283988 (+ 1039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:56.283992 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:56.283995 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:14:56.284032 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:56.284065 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:14:56.284077 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:56.284190 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:56.284337 (+ 147us) server_negotiation.cc:299] Negotiation successful
0806 09:14:56.284389 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 09:14:56.294420 16296 raft_consensus.cc:1261] T 554a32238571462a90a2854e2e7df666 P 1f4f9a298c1b4a628e364b5d24072350 [term 1 FOLLOWER]: Refusing update from remote peer 450745faba8b4e7dab18354005f0d65a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:14:56.294481 16162 raft_consensus.cc:1261] T 554a32238571462a90a2854e2e7df666 P 9f0a2ff4046847e7b407f432b021d971 [term 1 FOLLOWER]: Refusing update from remote peer 450745faba8b4e7dab18354005f0d65a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:14:56.295645 16500 consensus_queue.cc:1035] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f4f9a298c1b4a628e364b5d24072350" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:14:56.296000 16502 consensus_queue.cc:1035] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f0a2ff4046847e7b407f432b021d971" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 38635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:14:56.309172 16505 mvcc.cc:205] Tried to move back new op lower bound from 7315487524009172992 to 7315487523900092416. Current Snapshot: MvccSnapshot[applied={T|T < 7315487524009172992}]
I20260806 09:14:56.309646 16506 mvcc.cc:205] Tried to move back new op lower bound from 7315487524009172992 to 7315487523900092416. Current Snapshot: MvccSnapshot[applied={T|T < 7315487524009172992}]
I20260806 09:14:56.313750 16507 mvcc.cc:205] Tried to move back new op lower bound from 7315487524009172992 to 7315487523900092416. Current Snapshot: MvccSnapshot[applied={T|T < 7315487524009172992}]
I20260806 09:14:56.325913 16018 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46970:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:14:56.326216 16018 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46970:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:14:56.330487 16018 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 79fdf54b60904c81809cd0761ea1baf7: Sending DeleteTablet for 3 replicas of tablet 554a32238571462a90a2854e2e7df666
I20260806 09:14:56.332163 16142 tablet_service.cc:1514] Processing DeleteTablet for tablet 554a32238571462a90a2854e2e7df666 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:14:56 UTC) from {username='slave'} at 127.0.0.1:45324
I20260806 09:14:56.332178 16408 tablet_service.cc:1514] Processing DeleteTablet for tablet 554a32238571462a90a2854e2e7df666 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:14:56 UTC) from {username='slave'} at 127.0.0.1:51898
I20260806 09:14:56.333437 16276 tablet_service.cc:1514] Processing DeleteTablet for tablet 554a32238571462a90a2854e2e7df666 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:14:56 UTC) from {username='slave'} at 127.0.0.1:33050
I20260806 09:14:56.333959 16516 tablet_replica.cc:330] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a: stopping tablet replica
I20260806 09:14:56.334471 16516 raft_consensus.cc:2229] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:14:56.334563 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 16080
I20260806 09:14:56.335232 16516 raft_consensus.cc:2258] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:14:56.336082 16517 tablet_replica.cc:330] T 554a32238571462a90a2854e2e7df666 P 9f0a2ff4046847e7b407f432b021d971: stopping tablet replica
I20260806 09:14:56.336542 16517 raft_consensus.cc:2229] T 554a32238571462a90a2854e2e7df666 P 9f0a2ff4046847e7b407f432b021d971 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:14:56.337121 16517 raft_consensus.cc:2258] T 554a32238571462a90a2854e2e7df666 P 9f0a2ff4046847e7b407f432b021d971 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:14:56.337939 16518 tablet_replica.cc:330] T 554a32238571462a90a2854e2e7df666 P 1f4f9a298c1b4a628e364b5d24072350: stopping tablet replica
I20260806 09:14:56.338425 16518 raft_consensus.cc:2229] T 554a32238571462a90a2854e2e7df666 P 1f4f9a298c1b4a628e364b5d24072350 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:14:56.338976 16518 raft_consensus.cc:2258] T 554a32238571462a90a2854e2e7df666 P 1f4f9a298c1b4a628e364b5d24072350 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:14:56.339186 16516 ts_tablet_manager.cc:1905] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:14:56.341395 16517 ts_tablet_manager.cc:1905] T 554a32238571462a90a2854e2e7df666 P 9f0a2ff4046847e7b407f432b021d971: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:14:56.348111 16489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:56.337193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46212 (local address 127.10.255.65:38635)
0806 09:14:56.337391 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:56.337400 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:56.345212 (+ 7812us) server_negotiation.cc:407] Connection header received
0806 09:14:56.345436 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:56.345442 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:56.345582 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:56.345700 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:56.347207 (+ 1507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:56.347215 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:56.347219 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:14:56.347242 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:56.347286 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:14:56.347302 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:56.347415 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:56.347684 (+ 269us) server_negotiation.cc:299] Negotiation successful
0806 09:14:56.347762 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 09:14:56.348526 16518 ts_tablet_manager.cc:1905] T 554a32238571462a90a2854e2e7df666 P 1f4f9a298c1b4a628e364b5d24072350: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:14:56.349490 16204 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:56.354342 16516 ts_tablet_manager.cc:1918] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:14:56.354621 16516 log.cc:1196] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/554a32238571462a90a2854e2e7df666
I20260806 09:14:56.355154 16516 ts_tablet_manager.cc:1939] T 554a32238571462a90a2854e2e7df666 P 450745faba8b4e7dab18354005f0d65a: Deleting consensus metadata
I20260806 09:14:56.357075 16004 catalog_manager.cc:4841] TS 450745faba8b4e7dab18354005f0d65a (127.10.255.67:34269): tablet 554a32238571462a90a2854e2e7df666 (table test-table [id=71f5e161234f4b1ba86403918e6e9bdb]) successfully deleted
I20260806 09:14:56.357980 16518 ts_tablet_manager.cc:1918] T 554a32238571462a90a2854e2e7df666 P 1f4f9a298c1b4a628e364b5d24072350: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:14:56.358178 16518 log.cc:1196] T 554a32238571462a90a2854e2e7df666 P 1f4f9a298c1b4a628e364b5d24072350: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/554a32238571462a90a2854e2e7df666
I20260806 09:14:56.358836 16518 ts_tablet_manager.cc:1939] T 554a32238571462a90a2854e2e7df666 P 1f4f9a298c1b4a628e364b5d24072350: Deleting consensus metadata
I20260806 09:14:56.360997 16005 catalog_manager.cc:4841] TS 1f4f9a298c1b4a628e364b5d24072350 (127.10.255.66:33871): tablet 554a32238571462a90a2854e2e7df666 (table test-table [id=71f5e161234f4b1ba86403918e6e9bdb]) successfully deleted
I20260806 09:14:56.450739 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 16080
I20260806 09:14:56.470475 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 16213
W20260806 09:14:56.470283 16003 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.255.65:38635 (error 108)
I20260806 09:14:56.473385 16487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:56.472756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:38635 (local address 127.0.0.1:46216)
0806 09:14:56.473006 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:56.473231 (+ 225us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.65:38635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141}
W20260806 09:14:56.473625 16003 catalog_manager.cc:4584] TS 9f0a2ff4046847e7b407f432b021d971 (127.10.255.65:38635): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 554a32238571462a90a2854e2e7df666: Network error: Client connection negotiation failed: client connection to 127.10.255.65:38635: connect: Connection refused (error 111)
I20260806 09:14:56.474992 16490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:56.472167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54538 (local address 127.10.255.66:33871)
0806 09:14:56.472355 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:56.472364 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:56.472386 (+ 22us) server_negotiation.cc:407] Connection header received
0806 09:14:56.472455 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:56.472460 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:56.472579 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:56.472685 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:56.474345 (+ 1660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:56.474351 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:56.474355 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:14:56.474382 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:56.474417 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:14:56.474431 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:56.474583 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:56.474653 (+ 70us) server_negotiation.cc:299] Negotiation successful
0806 09:14:56.474718 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 09:14:56.476023 16336 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:56.527599 16487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:56.526971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:38635 (local address 127.0.0.1:46222)
0806 09:14:56.527237 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:56.527369 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.65:38635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260806 09:14:56.529096 16487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:56.528595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:38635 (local address 127.0.0.1:46228)
0806 09:14:56.528799 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:56.528926 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.65:38635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260806 09:14:56.576006 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 16213
I20260806 09:14:56.589988 16487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:56.589490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:38635 (local address 127.0.0.1:46236)
0806 09:14:56.589717 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:56.589819 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.65:38635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260806 09:14:56.591135 16487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:56.590774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:38635 (local address 127.0.0.1:46250)
0806 09:14:56.590930 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:56.591014 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.65:38635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260806 09:14:56.604822 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 16345
I20260806 09:14:56.608474 16488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:56.605742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57114 (local address 127.10.255.67:34269)
0806 09:14:56.605949 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:56.605954 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:56.605973 (+ 19us) server_negotiation.cc:407] Connection header received
0806 09:14:56.606227 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:56.606231 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:56.606287 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:56.606380 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:56.607486 (+ 1106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:56.607491 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:56.607494 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:14:56.607514 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:56.607550 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:14:56.607562 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:56.607679 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:56.608006 (+ 327us) server_negotiation.cc:299] Negotiation successful
0806 09:14:56.608105 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260806 09:14:56.609308 16468 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:56.672116 16487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:56.671455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:38635 (local address 127.0.0.1:46254)
0806 09:14:56.671769 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:56.671922 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.65:38635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
I20260806 09:14:56.673552 16487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:56.672990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:38635 (local address 127.0.0.1:46258)
0806 09:14:56.673263 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:56.673361 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.65:38635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
I20260806 09:14:56.741101 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 16345
I20260806 09:14:56.762480 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 15987
I20260806 09:14:56.763934 16048 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:56.879261 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 15987
2026-08-06T09:14:56Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2963 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260806 09:14:56.926344 11261 mini_oidc.cc:152] Starting JWKS server
I20260806 09:14:56.929787 11261 webserver.cc:460] Webserver started at https://127.0.0.1:38201/ using document root <none> and password file <none>
I20260806 09:14:56.930177 11261 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 09:14:56.930956 11261 webserver.cc:460] Webserver started at http://127.0.0.1:41289/ using document root <none> and password file <none>
2026-08-06T09:14:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:14:56Z Disabled control of system clock
I20260806 09:14:56.963683 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:35251
--webserver_interface=127.10.255.126
--webserver_port=0
--builtin_ntp_servers=127.10.255.84:44885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:35251
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38201/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786007647474472-11261-0/testchainca.cert with env {}
W20260806 09:14:57.327119 16530 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:57.327509 16530 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:57.327698 16530 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:57.335800 16530 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:14:57.336016 16530 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:57.336117 16530 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:57.336234 16530 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:14:57.336313 16530 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 09:14:57.336413 16530 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 09:14:57.336491 16530 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38201/jwks.json
I20260806 09:14:57.347124 16530 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:44885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:35251
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:35251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38201/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786007647474472-11261-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:57.348651 16530 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:57.350111 16530 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:57.365129 16535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:57.365583 16538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:57.365720 16536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:57.367187 16530 server_base.cc:1034] running on GCE node
I20260806 09:14:57.368237 16530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:57.370308 16530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:57.371647 16530 hybrid_clock.cc:648] HybridClock initialized: now 1786007697371525 us; error 109 us; skew 500 ppm
I20260806 09:14:57.372166 16530 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:14:57.375144 16530 webserver.cc:460] Webserver started at http://127.10.255.126:45917/ using document root <none> and password file <none>
I20260806 09:14:57.376113 16530 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:57.376266 16530 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:57.376644 16530 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:57.379957 16530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "f7ffbf86a11a4de0b7d451fbcbab1827"
format_stamp: "Formatted at 2026-08-06 09:14:57 on dist-test-slave-mvvj"
server_key: "d954140f147e8c28140847b4c238fd2d"
server_key_iv: "b20774b2aced2c66bdedc6e73dd80f09"
server_key_version: "encryptionkey@0"
I20260806 09:14:57.380892 16530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "f7ffbf86a11a4de0b7d451fbcbab1827"
format_stamp: "Formatted at 2026-08-06 09:14:57 on dist-test-slave-mvvj"
server_key: "d954140f147e8c28140847b4c238fd2d"
server_key_iv: "b20774b2aced2c66bdedc6e73dd80f09"
server_key_version: "encryptionkey@0"
I20260806 09:14:57.386957 16530 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260806 09:14:57.393230 16544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:57.395224 16530 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260806 09:14:57.395524 16530 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "f7ffbf86a11a4de0b7d451fbcbab1827"
format_stamp: "Formatted at 2026-08-06 09:14:57 on dist-test-slave-mvvj"
server_key: "d954140f147e8c28140847b4c238fd2d"
server_key_iv: "b20774b2aced2c66bdedc6e73dd80f09"
server_key_version: "encryptionkey@0"
I20260806 09:14:57.395888 16530 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:57.420856 16530 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:57.421866 16530 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:57.422228 16530 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:57.445564 16530 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:35251
I20260806 09:14:57.445747 16595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:35251 every 8 connection(s)
I20260806 09:14:57.447154 16530 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:14:57.449241 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 16530
I20260806 09:14:57.449502 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:14:57.450378 11261 external_mini_cluster.cc:1428] Setting key f37e3e253e54a6023e226d9ee812d707
I20260806 09:14:57.453111 16596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:57.469219 16599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:57.452833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50364 (local address 127.10.255.126:35251)
0806 09:14:57.454115 (+ 1282us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:57.454132 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:57.454195 (+ 63us) server_negotiation.cc:407] Connection header received
0806 09:14:57.456723 (+ 2528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:57.456765 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:57.457616 (+ 851us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:57.458208 (+ 592us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:57.459612 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:57.462316 (+ 2704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:57.464048 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:57.464818 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:57.465067 (+ 249us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:57.466440 (+ 1373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:57.466451 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:57.466473 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:14:57.467145 (+ 672us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:57.467236 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:14:57.467264 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:57.467424 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:57.467673 (+ 249us) server_negotiation.cc:299] Negotiation successful
0806 09:14:57.468115 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":704,"thread_start_us":446,"threads_started":1}
I20260806 09:14:57.469432 16596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7ffbf86a11a4de0b7d451fbcbab1827: Bootstrap starting.
I20260806 09:14:57.473805 16596 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7ffbf86a11a4de0b7d451fbcbab1827: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:57.474267 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:14:57.475091 16596 log.cc:824] T 00000000000000000000000000000000 P f7ffbf86a11a4de0b7d451fbcbab1827: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:57.479226 16596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7ffbf86a11a4de0b7d451fbcbab1827: No bootstrap required, opened a new log
I20260806 09:14:57.488417 16596 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7ffbf86a11a4de0b7d451fbcbab1827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7ffbf86a11a4de0b7d451fbcbab1827" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 35251 } }
I20260806 09:14:57.488915 16596 raft_consensus.cc:374] T 00000000000000000000000000000000 P f7ffbf86a11a4de0b7d451fbcbab1827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:57.489044 16596 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7ffbf86a11a4de0b7d451fbcbab1827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7ffbf86a11a4de0b7d451fbcbab1827, State: Initialized, Role: FOLLOWER
I20260806 09:14:57.489681 16596 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7ffbf86a11a4de0b7d451fbcbab1827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7ffbf86a11a4de0b7d451fbcbab1827" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 35251 } }
I20260806 09:14:57.489969 16596 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7ffbf86a11a4de0b7d451fbcbab1827 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:14:57.490136 16596 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7ffbf86a11a4de0b7d451fbcbab1827 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:14:57.490341 16596 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7ffbf86a11a4de0b7d451fbcbab1827 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:57.493129 16596 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7ffbf86a11a4de0b7d451fbcbab1827 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7ffbf86a11a4de0b7d451fbcbab1827" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 35251 } }
I20260806 09:14:57.493929 16596 leader_election.cc:302] T 00000000000000000000000000000000 P f7ffbf86a11a4de0b7d451fbcbab1827 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7ffbf86a11a4de0b7d451fbcbab1827; no voters:
I20260806 09:14:57.494598 16596 leader_election.cc:288] T 00000000000000000000000000000000 P f7ffbf86a11a4de0b7d451fbcbab1827 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:14:57.494813 16601 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7ffbf86a11a4de0b7d451fbcbab1827 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:14:57.495738 16601 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7ffbf86a11a4de0b7d451fbcbab1827 [term 1 LEADER]: Becoming Leader. State: Replica: f7ffbf86a11a4de0b7d451fbcbab1827, State: Running, Role: LEADER
I20260806 09:14:57.496345 16601 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7ffbf86a11a4de0b7d451fbcbab1827 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7ffbf86a11a4de0b7d451fbcbab1827" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 35251 } }
I20260806 09:14:57.497071 16596 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7ffbf86a11a4de0b7d451fbcbab1827 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:14:57.499918 16603 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7ffbf86a11a4de0b7d451fbcbab1827 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7ffbf86a11a4de0b7d451fbcbab1827. Latest consensus state: current_term: 1 leader_uuid: "f7ffbf86a11a4de0b7d451fbcbab1827" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7ffbf86a11a4de0b7d451fbcbab1827" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 35251 } } }
I20260806 09:14:57.500509 16603 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7ffbf86a11a4de0b7d451fbcbab1827 [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:57.500034 16602 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7ffbf86a11a4de0b7d451fbcbab1827 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f7ffbf86a11a4de0b7d451fbcbab1827" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7ffbf86a11a4de0b7d451fbcbab1827" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 35251 } } }
I20260806 09:14:57.500829 16602 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7ffbf86a11a4de0b7d451fbcbab1827 [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:57.504005 16610 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:14:57.511552 16610 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:14:57.526844 16610 catalog_manager.cc:1347] Generated new cluster ID: a39f6d29d2024cfe9f9a3957b2dcd53f
I20260806 09:14:57.527032 16610 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:14:57.543658 16610 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:14:57.545910 16610 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:14:57.560335 16610 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7ffbf86a11a4de0b7d451fbcbab1827: Generated new TSK 0
I20260806 09:14:57.561913 16610 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 09:14:57.619737 16626 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260806 09:14:57.620018 16626 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 09:14:57.627509 16599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:57.597207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50370 (local address 127.10.255.126:35251)
0806 09:14:57.597478 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:57.597488 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:57.598182 (+ 694us) server_negotiation.cc:407] Connection header received
0806 09:14:57.598822 (+ 640us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:57.598827 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:57.598914 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:57.599057 (+ 143us) server_negotiation.cc:226] Negotiated authn=JWT
0806 09:14:57.599812 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:57.600829 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:57.603178 (+ 2349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:57.603697 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:57.603819 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:57.604683 (+ 864us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 09:14:57.626746 (+ 22063us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38201/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 09:14:57.627218 (+ 472us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50370: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38201/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":75}
W20260806 09:14:57.627692 16599 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50370: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38201/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260806 09:14:57.630092 16625 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:14:57.597114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:35251 (local address 127.0.0.1:50370)
0806 09:14:57.598048 (+ 934us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:57.598071 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:57.598394 (+ 323us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:57.599138 (+ 744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:57.599145 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:57.599160 (+ 15us) client_negotiation.cc:189] Negotiated authn=JWT
0806 09:14:57.599583 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:57.599598 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:57.600996 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:57.601003 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:57.602955 (+ 1952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:57.602975 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:57.603960 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:57.603968 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:57.604183 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:57.604294 (+ 111us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 09:14:57.627186 (+ 22892us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38201/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 09:14:57.627795 (+ 609us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.255.126:35251: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38201/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":695,"thread_start_us":467,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.10.255.126:35251: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38201/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260806 09:14:57.631933 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 16530
I20260806 09:14:57.633249 16591 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:57.739693 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 16530
2026-08-06T09:14:57Z chronyd exiting
I20260806 09:14:57.792833 11261 test_util.cc:175] -----------------------------------------------
I20260806 09:14:57.792984 11261 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786007647474472-11261-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (874 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260806 09:14:57.797695 11261 mini_oidc.cc:152] Starting JWKS server
I20260806 09:14:57.800191 11261 webserver.cc:460] Webserver started at https://127.0.0.1:42423/ using document root <none> and password file <none>
I20260806 09:14:57.800437 11261 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 09:14:57.801188 11261 webserver.cc:460] Webserver started at http://127.0.0.1:46091/ using document root <none> and password file <none>
2026-08-06T09:14:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:14:57Z Disabled control of system clock
I20260806 09:14:57.836329 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:35797
--webserver_interface=127.10.255.126
--webserver_port=0
--builtin_ntp_servers=127.10.255.84:46787
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:35797
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42423/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786007647474472-11261-0/testchainca.cert with env {}
W20260806 09:14:58.207579 16633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:58.208009 16633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:58.208165 16633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:58.216727 16633 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:14:58.216878 16633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:58.216920 16633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:58.217068 16633 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:14:58.217137 16633 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 09:14:58.217224 16633 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 09:14:58.217283 16633 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42423/jwks.json
I20260806 09:14:58.229945 16633 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:46787
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:35797
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:35797
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42423/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786007647474472-11261-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:58.231619 16633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:58.233186 16633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:58.249212 16641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:58.249171 16638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:58.249266 16639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:58.254495 16633 server_base.cc:1034] running on GCE node
I20260806 09:14:58.255609 16633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:58.257421 16633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:58.258685 16633 hybrid_clock.cc:648] HybridClock initialized: now 1786007698258637 us; error 43 us; skew 500 ppm
I20260806 09:14:58.259135 16633 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:14:58.268350 16633 webserver.cc:460] Webserver started at http://127.10.255.126:40341/ using document root <none> and password file <none>
I20260806 09:14:58.269341 16633 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:58.269475 16633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:58.269876 16633 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:58.273810 16633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "14b8e395d1564853a5929c8ab5408916"
format_stamp: "Formatted at 2026-08-06 09:14:58 on dist-test-slave-mvvj"
server_key: "5d361fc386c4a173e4d5527457b7990e"
server_key_iv: "9546ca7e60f70e8f509e41fa21a2d41f"
server_key_version: "encryptionkey@0"
I20260806 09:14:58.274816 16633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "14b8e395d1564853a5929c8ab5408916"
format_stamp: "Formatted at 2026-08-06 09:14:58 on dist-test-slave-mvvj"
server_key: "5d361fc386c4a173e4d5527457b7990e"
server_key_iv: "9546ca7e60f70e8f509e41fa21a2d41f"
server_key_version: "encryptionkey@0"
I20260806 09:14:58.281769 16633 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260806 09:14:58.286068 16647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:58.287803 16633 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 09:14:58.288134 16633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "14b8e395d1564853a5929c8ab5408916"
format_stamp: "Formatted at 2026-08-06 09:14:58 on dist-test-slave-mvvj"
server_key: "5d361fc386c4a173e4d5527457b7990e"
server_key_iv: "9546ca7e60f70e8f509e41fa21a2d41f"
server_key_version: "encryptionkey@0"
I20260806 09:14:58.288398 16633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:58.309746 16633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:58.310720 16633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:58.311120 16633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:58.333685 16633 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:35797
I20260806 09:14:58.333740 16701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:35797 every 8 connection(s)
I20260806 09:14:58.335268 16633 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:14:58.340168 16702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:58.342304 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 16633
I20260806 09:14:58.342536 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:14:58.343379 11261 external_mini_cluster.cc:1428] Setting key 771c35e9acee8b59ceff785e7d9db324
I20260806 09:14:58.353634 16702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14b8e395d1564853a5929c8ab5408916: Bootstrap starting.
I20260806 09:14:58.357268 16702 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 14b8e395d1564853a5929c8ab5408916: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:58.358516 16702 log.cc:824] T 00000000000000000000000000000000 P 14b8e395d1564853a5929c8ab5408916: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:58.359119 16705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:58.345785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44516 (local address 127.10.255.126:35797)
0806 09:14:58.347036 (+ 1251us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:58.347049 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:58.347099 (+ 50us) server_negotiation.cc:407] Connection header received
0806 09:14:58.349119 (+ 2020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:58.349150 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:58.349759 (+ 609us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:58.350222 (+ 463us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:58.350886 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:58.352383 (+ 1497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:58.353813 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:58.354604 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:58.354830 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:58.356246 (+ 1416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:58.356255 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:58.356271 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:14:58.356858 (+ 587us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:58.356968 (+ 110us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:14:58.356993 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:58.357132 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:58.357387 (+ 255us) server_negotiation.cc:299] Negotiation successful
0806 09:14:58.357820 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":742,"thread_start_us":457,"threads_started":1}
I20260806 09:14:58.362545 16702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 14b8e395d1564853a5929c8ab5408916: No bootstrap required, opened a new log
I20260806 09:14:58.364130 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:14:58.371213 16702 raft_consensus.cc:348] T 00000000000000000000000000000000 P 14b8e395d1564853a5929c8ab5408916 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14b8e395d1564853a5929c8ab5408916" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 35797 } }
I20260806 09:14:58.371687 16702 raft_consensus.cc:374] T 00000000000000000000000000000000 P 14b8e395d1564853a5929c8ab5408916 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:58.371809 16702 raft_consensus.cc:729] T 00000000000000000000000000000000 P 14b8e395d1564853a5929c8ab5408916 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14b8e395d1564853a5929c8ab5408916, State: Initialized, Role: FOLLOWER
I20260806 09:14:58.372545 16702 consensus_queue.cc:260] T 00000000000000000000000000000000 P 14b8e395d1564853a5929c8ab5408916 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14b8e395d1564853a5929c8ab5408916" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 35797 } }
I20260806 09:14:58.372799 16702 raft_consensus.cc:388] T 00000000000000000000000000000000 P 14b8e395d1564853a5929c8ab5408916 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:14:58.372970 16702 raft_consensus.cc:482] T 00000000000000000000000000000000 P 14b8e395d1564853a5929c8ab5408916 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:14:58.373155 16702 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 14b8e395d1564853a5929c8ab5408916 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:58.375499 16702 raft_consensus.cc:504] T 00000000000000000000000000000000 P 14b8e395d1564853a5929c8ab5408916 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14b8e395d1564853a5929c8ab5408916" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 35797 } }
I20260806 09:14:58.376185 16702 leader_election.cc:302] T 00000000000000000000000000000000 P 14b8e395d1564853a5929c8ab5408916 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 14b8e395d1564853a5929c8ab5408916; no voters:
I20260806 09:14:58.376935 16702 leader_election.cc:288] T 00000000000000000000000000000000 P 14b8e395d1564853a5929c8ab5408916 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:14:58.377099 16707 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 14b8e395d1564853a5929c8ab5408916 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:14:58.378592 16707 raft_consensus.cc:686] T 00000000000000000000000000000000 P 14b8e395d1564853a5929c8ab5408916 [term 1 LEADER]: Becoming Leader. State: Replica: 14b8e395d1564853a5929c8ab5408916, State: Running, Role: LEADER
I20260806 09:14:58.379227 16707 consensus_queue.cc:237] T 00000000000000000000000000000000 P 14b8e395d1564853a5929c8ab5408916 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14b8e395d1564853a5929c8ab5408916" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 35797 } }
I20260806 09:14:58.379869 16702 sys_catalog.cc:564] T 00000000000000000000000000000000 P 14b8e395d1564853a5929c8ab5408916 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:14:58.382881 16708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14b8e395d1564853a5929c8ab5408916 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "14b8e395d1564853a5929c8ab5408916" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14b8e395d1564853a5929c8ab5408916" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 35797 } } }
I20260806 09:14:58.383399 16708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14b8e395d1564853a5929c8ab5408916 [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:58.382893 16709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 14b8e395d1564853a5929c8ab5408916 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 14b8e395d1564853a5929c8ab5408916. Latest consensus state: current_term: 1 leader_uuid: "14b8e395d1564853a5929c8ab5408916" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "14b8e395d1564853a5929c8ab5408916" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 35797 } } }
I20260806 09:14:58.387300 16714 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:14:58.387341 16709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 14b8e395d1564853a5929c8ab5408916 [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:58.399042 16714 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:14:58.411621 16714 catalog_manager.cc:1347] Generated new cluster ID: e4bc47b8fa2246d38ad409a228d39a0f
I20260806 09:14:58.411804 16714 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:14:58.428339 16714 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:14:58.429786 16714 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:14:58.439500 16714 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 14b8e395d1564853a5929c8ab5408916: Generated new TSK 0
I20260806 09:14:58.440878 16714 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 09:14:58.486145 16732 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260806 09:14:58.486369 16732 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 09:14:58.487673 16705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:58.462868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44520 (local address 127.10.255.126:35797)
0806 09:14:58.463189 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:58.463200 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:58.463820 (+ 620us) server_negotiation.cc:407] Connection header received
0806 09:14:58.464311 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:58.464319 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:58.464432 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:58.464900 (+ 468us) server_negotiation.cc:226] Negotiated authn=JWT
0806 09:14:58.465974 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:58.467315 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:58.469773 (+ 2458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:58.470688 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:58.470858 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:58.472003 (+ 1145us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 09:14:58.486937 (+ 14934us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42423/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 09:14:58.487306 (+ 369us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44520: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42423/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":64}
W20260806 09:14:58.487915 16705 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44520: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42423/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260806 09:14:58.488085 16731 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:14:58.462513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:35797 (local address 127.0.0.1:44520)
0806 09:14:58.463673 (+ 1160us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:58.463696 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:58.464016 (+ 320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:58.465260 (+ 1244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:58.465266 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:58.465283 (+ 17us) client_negotiation.cc:189] Negotiated authn=JWT
0806 09:14:58.465651 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:58.465667 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:58.467566 (+ 1899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:58.467573 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:58.469561 (+ 1988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:58.469583 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:58.470980 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:58.470989 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:58.471327 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:58.471403 (+ 76us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 09:14:58.487269 (+ 15866us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42423/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 09:14:58.487617 (+ 348us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.255.126:35797: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42423/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":973,"thread_start_us":1145,"threads_started":1}
I20260806 09:14:58.490193 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 16633
I20260806 09:14:58.491621 16696 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:14:58.592088 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 16633
2026-08-06T09:14:58Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (855 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260806 09:14:58.653050 11261 mini_oidc.cc:152] Starting JWKS server
I20260806 09:14:58.655211 11261 webserver.cc:460] Webserver started at https://127.0.0.1:43953/ using document root <none> and password file <none>
I20260806 09:14:58.655534 11261 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 09:14:58.656373 11261 webserver.cc:460] Webserver started at http://127.0.0.1:34309/ using document root <none> and password file <none>
2026-08-06T09:14:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:14:58Z Disabled control of system clock
I20260806 09:14:58.689334 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:44429
--webserver_interface=127.10.255.126
--webserver_port=0
--builtin_ntp_servers=127.10.255.84:42819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:44429
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43953/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 09:14:59.064090 16739 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:59.064471 16739 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:59.064646 16739 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:59.072244 16739 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:14:59.072422 16739 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:59.072525 16739 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:59.072649 16739 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:14:59.072741 16739 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 09:14:59.072837 16739 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 09:14:59.072899 16739 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43953/jwks.json
I20260806 09:14:59.082520 16739 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:42819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:44429
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:44429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43953/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:59.084017 16739 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:59.085903 16739 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:59.098897 16745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:59.098836 16746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:59.098860 16748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:59.099617 16739 server_base.cc:1034] running on GCE node
I20260806 09:14:59.100498 16739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:59.102109 16739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:59.103340 16739 hybrid_clock.cc:648] HybridClock initialized: now 1786007699103277 us; error 71 us; skew 500 ppm
I20260806 09:14:59.103909 16739 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:14:59.106889 16739 webserver.cc:460] Webserver started at http://127.10.255.126:40939/ using document root <none> and password file <none>
I20260806 09:14:59.107751 16739 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:59.107967 16739 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:59.108390 16739 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:59.112120 16739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "44faf5bf79c44c70b7a12cd98546b683"
format_stamp: "Formatted at 2026-08-06 09:14:59 on dist-test-slave-mvvj"
server_key: "7feeb2d4082092cfd99ffccbf9eb2470"
server_key_iv: "52ff9dd466fc0ae19ab5ac5df88fbf6b"
server_key_version: "encryptionkey@0"
I20260806 09:14:59.113076 16739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "44faf5bf79c44c70b7a12cd98546b683"
format_stamp: "Formatted at 2026-08-06 09:14:59 on dist-test-slave-mvvj"
server_key: "7feeb2d4082092cfd99ffccbf9eb2470"
server_key_iv: "52ff9dd466fc0ae19ab5ac5df88fbf6b"
server_key_version: "encryptionkey@0"
I20260806 09:14:59.119618 16739 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260806 09:14:59.124367 16754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:59.126497 16739 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:14:59.126794 16739 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "44faf5bf79c44c70b7a12cd98546b683"
format_stamp: "Formatted at 2026-08-06 09:14:59 on dist-test-slave-mvvj"
server_key: "7feeb2d4082092cfd99ffccbf9eb2470"
server_key_iv: "52ff9dd466fc0ae19ab5ac5df88fbf6b"
server_key_version: "encryptionkey@0"
I20260806 09:14:59.127079 16739 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:59.145435 16739 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:59.146399 16739 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:59.146744 16739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:59.168527 16739 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:44429
I20260806 09:14:59.168557 16806 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:44429 every 8 connection(s)
I20260806 09:14:59.170037 16739 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:14:59.174096 16807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:59.174747 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 16739
I20260806 09:14:59.174973 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:14:59.175922 11261 external_mini_cluster.cc:1428] Setting key 55c498fe220ab8e5f3b5d6e1d3c10e5a
I20260806 09:14:59.189247 16807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44faf5bf79c44c70b7a12cd98546b683: Bootstrap starting.
I20260806 09:14:59.191586 16810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:59.178077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42290 (local address 127.10.255.126:44429)
0806 09:14:59.179287 (+ 1210us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:59.179299 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:59.179345 (+ 46us) server_negotiation.cc:407] Connection header received
0806 09:14:59.181223 (+ 1878us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:59.181247 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:59.181777 (+ 530us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:59.182143 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:59.182808 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:59.184417 (+ 1609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:59.186382 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:59.187218 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:59.187370 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:59.188738 (+ 1368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:59.188746 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:59.188763 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:14:59.189503 (+ 740us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:59.189599 (+ 96us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:14:59.189624 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:59.189736 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:59.190023 (+ 287us) server_negotiation.cc:299] Negotiation successful
0806 09:14:59.190427 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":745,"thread_start_us":511,"threads_started":1}
I20260806 09:14:59.193001 16807 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44faf5bf79c44c70b7a12cd98546b683: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:59.194139 16807 log.cc:824] T 00000000000000000000000000000000 P 44faf5bf79c44c70b7a12cd98546b683: Log is configured to *not* fsync() on all Append() calls
I20260806 09:14:59.196372 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:14:59.198009 16807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44faf5bf79c44c70b7a12cd98546b683: No bootstrap required, opened a new log
I20260806 09:14:59.206149 16807 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44faf5bf79c44c70b7a12cd98546b683 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44faf5bf79c44c70b7a12cd98546b683" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 44429 } }
I20260806 09:14:59.206566 16807 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44faf5bf79c44c70b7a12cd98546b683 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:14:59.206647 16807 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44faf5bf79c44c70b7a12cd98546b683 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44faf5bf79c44c70b7a12cd98546b683, State: Initialized, Role: FOLLOWER
I20260806 09:14:59.207170 16807 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44faf5bf79c44c70b7a12cd98546b683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44faf5bf79c44c70b7a12cd98546b683" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 44429 } }
I20260806 09:14:59.207374 16807 raft_consensus.cc:388] T 00000000000000000000000000000000 P 44faf5bf79c44c70b7a12cd98546b683 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:14:59.207473 16807 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44faf5bf79c44c70b7a12cd98546b683 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:14:59.207626 16807 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44faf5bf79c44c70b7a12cd98546b683 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:14:59.210104 16807 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44faf5bf79c44c70b7a12cd98546b683 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44faf5bf79c44c70b7a12cd98546b683" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 44429 } }
I20260806 09:14:59.210673 16807 leader_election.cc:302] T 00000000000000000000000000000000 P 44faf5bf79c44c70b7a12cd98546b683 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44faf5bf79c44c70b7a12cd98546b683; no voters:
I20260806 09:14:59.211390 16807 leader_election.cc:288] T 00000000000000000000000000000000 P 44faf5bf79c44c70b7a12cd98546b683 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:14:59.211599 16812 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44faf5bf79c44c70b7a12cd98546b683 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:14:59.213222 16812 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44faf5bf79c44c70b7a12cd98546b683 [term 1 LEADER]: Becoming Leader. State: Replica: 44faf5bf79c44c70b7a12cd98546b683, State: Running, Role: LEADER
I20260806 09:14:59.213860 16807 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44faf5bf79c44c70b7a12cd98546b683 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:14:59.213869 16812 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44faf5bf79c44c70b7a12cd98546b683 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44faf5bf79c44c70b7a12cd98546b683" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 44429 } }
I20260806 09:14:59.217614 16813 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44faf5bf79c44c70b7a12cd98546b683 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44faf5bf79c44c70b7a12cd98546b683" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44faf5bf79c44c70b7a12cd98546b683" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 44429 } } }
I20260806 09:14:59.218113 16813 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44faf5bf79c44c70b7a12cd98546b683 [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:59.218794 16814 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44faf5bf79c44c70b7a12cd98546b683 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44faf5bf79c44c70b7a12cd98546b683. Latest consensus state: current_term: 1 leader_uuid: "44faf5bf79c44c70b7a12cd98546b683" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44faf5bf79c44c70b7a12cd98546b683" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 44429 } } }
I20260806 09:14:59.219228 16814 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44faf5bf79c44c70b7a12cd98546b683 [sys.catalog]: This master's current role is: LEADER
I20260806 09:14:59.221508 16821 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:14:59.226586 16821 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:14:59.236831 16821 catalog_manager.cc:1347] Generated new cluster ID: bd638ebb702f4f8cbc4f4eeb3acf01f1
I20260806 09:14:59.236961 16821 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:14:59.260588 16821 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:14:59.262017 16821 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:14:59.274211 16821 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44faf5bf79c44c70b7a12cd98546b683: Generated new TSK 0
I20260806 09:14:59.275408 16821 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:14:59.314706 16810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:59.305064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42294 (local address 127.10.255.126:44429)
0806 09:14:59.305293 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:59.305300 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:59.305900 (+ 600us) server_negotiation.cc:407] Connection header received
0806 09:14:59.306189 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:59.306193 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:59.306270 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:59.306406 (+ 136us) server_negotiation.cc:226] Negotiated authn=JWT
0806 09:14:59.307005 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:59.307815 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:59.310089 (+ 2274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:59.310555 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:59.310678 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:59.311343 (+ 665us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 09:14:59.314000 (+ 2657us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43953/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 09:14:59.314358 (+ 358us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42294: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43953/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":80}
W20260806 09:14:59.314844 16810 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42294: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43953/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260806 09:14:59.317173 16836 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:14:59.304946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:44429 (local address 127.0.0.1:42294)
0806 09:14:59.305762 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0806 09:14:59.305785 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 09:14:59.305960 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:14:59.306460 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:14:59.306466 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:14:59.306480 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0806 09:14:59.306834 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:59.306846 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:59.308023 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:59.308030 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:59.309874 (+ 1844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:14:59.309891 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:14:59.310788 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:14:59.310795 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:14:59.310989 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:59.311043 (+ 54us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 09:14:59.314264 (+ 3221us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43953/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 09:14:59.316704 (+ 2440us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.255.126:44429: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43953/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":664,"mutex_wait_us":2062,"thread_start_us":478,"threads_started":1}
I20260806 09:14:59.318606 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 16739
I20260806 09:14:59.320458 16802 generic_service.cc:196] Checking for leaks (request via RPC)
E20260806 09:14:59.328024 16837 webserver.cc:533] Webserver: sslize failed:
E20260806 09:14:59.328130 16837 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 09:14:59.419684 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 16739
2026-08-06T09:14:59Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (824 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-06T09:14:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:14:59Z Disabled control of system clock
I20260806 09:14:59.510041 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:37719
--webserver_interface=127.10.255.126
--webserver_port=0
--builtin_ntp_servers=127.10.255.84:39097
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:37719
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786007647474472-11261-0/testchainca.cert with env {}
W20260806 09:14:59.869513 16842 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:14:59.869859 16842 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:14:59.870002 16842 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:14:59.877744 16842 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:14:59.877877 16842 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:14:59.877964 16842 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:14:59.878055 16842 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:14:59.878175 16842 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 09:14:59.878298 16842 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 09:14:59.878400 16842 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260806 09:14:59.889246 16842 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:39097
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:37719
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:37719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786007647474472-11261-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:14:59.890734 16842 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:14:59.892191 16842 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:14:59.905576 16848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:59.905601 16849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:14:59.905632 16851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:14:59.906502 16842 server_base.cc:1034] running on GCE node
I20260806 09:14:59.907423 16842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:14:59.909060 16842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:14:59.910300 16842 hybrid_clock.cc:648] HybridClock initialized: now 1786007699910254 us; error 38 us; skew 500 ppm
I20260806 09:14:59.910701 16842 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:14:59.913435 16842 webserver.cc:460] Webserver started at http://127.10.255.126:34987/ using document root <none> and password file <none>
I20260806 09:14:59.914143 16842 fs_manager.cc:359] Metadata directory not provided
I20260806 09:14:59.914240 16842 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:14:59.914539 16842 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:14:59.917719 16842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "66598270f4a94c9783a4c839cc4c9ffd"
format_stamp: "Formatted at 2026-08-06 09:14:59 on dist-test-slave-mvvj"
server_key: "d4a81602bed467da852a612da609463f"
server_key_iv: "593e71beb8f99fdf667e790460453385"
server_key_version: "encryptionkey@0"
I20260806 09:14:59.918671 16842 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "66598270f4a94c9783a4c839cc4c9ffd"
format_stamp: "Formatted at 2026-08-06 09:14:59 on dist-test-slave-mvvj"
server_key: "d4a81602bed467da852a612da609463f"
server_key_iv: "593e71beb8f99fdf667e790460453385"
server_key_version: "encryptionkey@0"
I20260806 09:14:59.924654 16842 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260806 09:14:59.928772 16857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:14:59.930421 16842 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:14:59.930693 16842 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "66598270f4a94c9783a4c839cc4c9ffd"
format_stamp: "Formatted at 2026-08-06 09:14:59 on dist-test-slave-mvvj"
server_key: "d4a81602bed467da852a612da609463f"
server_key_iv: "593e71beb8f99fdf667e790460453385"
server_key_version: "encryptionkey@0"
I20260806 09:14:59.930960 16842 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:14:59.952057 16842 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:14:59.953003 16842 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:14:59.953327 16842 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:14:59.974371 16842 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:37719
I20260806 09:14:59.974390 16910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:37719 every 8 connection(s)
I20260806 09:14:59.976018 16842 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:14:59.980275 16911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:14:59.984974 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 16842
I20260806 09:14:59.985196 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:14:59.985868 11261 external_mini_cluster.cc:1428] Setting key fe823c2894fe4df0af004b078c236c15
I20260806 09:14:59.992323 16911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66598270f4a94c9783a4c839cc4c9ffd: Bootstrap starting.
I20260806 09:14:59.995801 16911 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66598270f4a94c9783a4c839cc4c9ffd: Neither blocks nor log segments found. Creating new log.
I20260806 09:14:59.997115 16911 log.cc:824] T 00000000000000000000000000000000 P 66598270f4a94c9783a4c839cc4c9ffd: Log is configured to *not* fsync() on all Append() calls
I20260806 09:15:00.001298 16911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66598270f4a94c9783a4c839cc4c9ffd: No bootstrap required, opened a new log
I20260806 09:15:00.001255 16914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:14:59.987948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41672 (local address 127.10.255.126:37719)
0806 09:14:59.989197 (+ 1249us) server_negotiation.cc:206] Beginning negotiation
0806 09:14:59.989209 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 09:14:59.989258 (+ 49us) server_negotiation.cc:407] Connection header received
0806 09:14:59.991119 (+ 1861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:14:59.991145 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:14:59.991654 (+ 509us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:14:59.992175 (+ 521us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:14:59.992815 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:59.994180 (+ 1365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:59.995575 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:14:59.996490 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:14:59.996745 (+ 255us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:14:59.998128 (+ 1383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:14:59.998137 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:14:59.998153 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:14:59.998838 (+ 685us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:14:59.998978 (+ 140us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:14:59.999013 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:14:59.999140 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 09:14:59.999421 (+ 281us) server_negotiation.cc:299] Negotiation successful
0806 09:14:59.999798 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":758,"thread_start_us":430,"threads_started":1}
I20260806 09:15:00.007354 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:15:00.011355 16911 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66598270f4a94c9783a4c839cc4c9ffd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66598270f4a94c9783a4c839cc4c9ffd" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37719 } }
I20260806 09:15:00.011817 16911 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66598270f4a94c9783a4c839cc4c9ffd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:00.011950 16911 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66598270f4a94c9783a4c839cc4c9ffd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66598270f4a94c9783a4c839cc4c9ffd, State: Initialized, Role: FOLLOWER
I20260806 09:15:00.012630 16911 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66598270f4a94c9783a4c839cc4c9ffd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66598270f4a94c9783a4c839cc4c9ffd" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37719 } }
I20260806 09:15:00.012902 16911 raft_consensus.cc:388] T 00000000000000000000000000000000 P 66598270f4a94c9783a4c839cc4c9ffd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:15:00.013144 16911 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66598270f4a94c9783a4c839cc4c9ffd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:15:00.013376 16911 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66598270f4a94c9783a4c839cc4c9ffd [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:00.015933 16911 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66598270f4a94c9783a4c839cc4c9ffd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66598270f4a94c9783a4c839cc4c9ffd" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37719 } }
I20260806 09:15:00.016507 16911 leader_election.cc:302] T 00000000000000000000000000000000 P 66598270f4a94c9783a4c839cc4c9ffd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66598270f4a94c9783a4c839cc4c9ffd; no voters:
I20260806 09:15:00.017303 16911 leader_election.cc:288] T 00000000000000000000000000000000 P 66598270f4a94c9783a4c839cc4c9ffd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:15:00.017500 16916 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66598270f4a94c9783a4c839cc4c9ffd [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:15:00.018380 16916 raft_consensus.cc:686] T 00000000000000000000000000000000 P 66598270f4a94c9783a4c839cc4c9ffd [term 1 LEADER]: Becoming Leader. State: Replica: 66598270f4a94c9783a4c839cc4c9ffd, State: Running, Role: LEADER
I20260806 09:15:00.019047 16916 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66598270f4a94c9783a4c839cc4c9ffd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66598270f4a94c9783a4c839cc4c9ffd" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37719 } }
I20260806 09:15:00.019714 16911 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66598270f4a94c9783a4c839cc4c9ffd [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:15:00.022518 16917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66598270f4a94c9783a4c839cc4c9ffd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66598270f4a94c9783a4c839cc4c9ffd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66598270f4a94c9783a4c839cc4c9ffd" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37719 } } }
I20260806 09:15:00.022910 16917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66598270f4a94c9783a4c839cc4c9ffd [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:00.023555 16918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66598270f4a94c9783a4c839cc4c9ffd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66598270f4a94c9783a4c839cc4c9ffd. Latest consensus state: current_term: 1 leader_uuid: "66598270f4a94c9783a4c839cc4c9ffd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66598270f4a94c9783a4c839cc4c9ffd" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37719 } } }
I20260806 09:15:00.024060 16922 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:15:00.024137 16918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66598270f4a94c9783a4c839cc4c9ffd [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:00.030455 16922 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:15:00.040560 16922 catalog_manager.cc:1347] Generated new cluster ID: 5a81c3f783b84238b7d193c729c6869f
I20260806 09:15:00.040789 16922 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:15:00.051599 16922 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:15:00.053396 16922 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:15:00.068760 16922 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 66598270f4a94c9783a4c839cc4c9ffd: Generated new TSK 0
I20260806 09:15:00.070282 16922 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:15:00.144394 16914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:00.084342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41678 (local address 127.10.255.126:37719)
0806 09:15:00.084571 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:00.084577 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:00.084886 (+ 309us) server_negotiation.cc:407] Connection header received
0806 09:15:00.085176 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:00.085185 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:00.085271 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:00.085443 (+ 172us) server_negotiation.cc:226] Negotiated authn=JWT
0806 09:15:00.085951 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:00.086711 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:00.088220 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:00.088867 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:00.089054 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:00.089651 (+ 597us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 09:15:00.143629 (+ 53978us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 09:15:00.144135 (+ 506us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:41678: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":56}
W20260806 09:15:00.144572 16914 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:41678: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260806 09:15:00.144824 16940 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:00.084178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37719 (local address 127.0.0.1:41678)
0806 09:15:00.084755 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:00.084781 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:00.084972 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:00.085482 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:00.085487 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:00.085508 (+ 21us) client_negotiation.cc:189] Negotiated authn=JWT
0806 09:15:00.085794 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:00.085803 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:00.086860 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:00.086866 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:00.088068 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:00.088080 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:00.089102 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:00.089109 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:00.089286 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:00.089338 (+ 52us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 09:15:00.144034 (+ 54696us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 09:15:00.144385 (+ 351us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.255.126:37719: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":414,"threads_started":1}
I20260806 09:15:00.146523 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 16842
I20260806 09:15:00.148049 16905 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:00.250547 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 16842
2026-08-06T09:15:00Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (810 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (476 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (1700 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:15:02 dist-test-slave-mvvj krb5kdc[16956](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:15:02 dist-test-slave-mvvj krb5kdc[16956](info): set up 2 sockets
Aug 06 09:15:02 dist-test-slave-mvvj krb5kdc[16956](info): commencing operation
krb5kdc: starting...
W20260806 09:15:03.591231 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.001s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:15:03 dist-test-slave-mvvj krb5kdc[16956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007703, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:15:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:15:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:15:03.838320 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:37871
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:34607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:37871
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:15:04.211246 16969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:04.211680 16969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:04.211902 16969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:04.220268 16969 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:15:04.220466 16969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:04.220583 16969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:04.220690 16969 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:15:04.220778 16969 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:15:04.231189 16969 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:34607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:37871
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:37871
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:04.232728 16969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:04.234149 16969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:04.247139 16974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:04.247119 16977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:04.247349 16975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:04.248577 16969 server_base.cc:1034] running on GCE node
I20260806 09:15:04.249527 16969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:04.251196 16969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:04.252460 16969 hybrid_clock.cc:648] HybridClock initialized: now 1786007704252438 us; error 82 us; skew 500 ppm
I20260806 09:15:04.252856 16969 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:04 dist-test-slave-mvvj krb5kdc[16956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007704, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:04.256323 16969 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:15:04.258072 16969 webserver.cc:460] Webserver started at http://127.10.255.126:40471/ using document root <none> and password file <none>
I20260806 09:15:04.258834 16969 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:04.258989 16969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:04.259330 16969 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:04.262682 16969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "d42cc20b853c41a2ae9eccc264ee5961"
format_stamp: "Formatted at 2026-08-06 09:15:04 on dist-test-slave-mvvj"
server_key: "19d628341e706d0021bc3d4c9827e9c2"
server_key_iv: "56544160cb471bf6c5ccbfc0b5ca30d6"
server_key_version: "encryptionkey@0"
I20260806 09:15:04.263576 16969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "d42cc20b853c41a2ae9eccc264ee5961"
format_stamp: "Formatted at 2026-08-06 09:15:04 on dist-test-slave-mvvj"
server_key: "19d628341e706d0021bc3d4c9827e9c2"
server_key_iv: "56544160cb471bf6c5ccbfc0b5ca30d6"
server_key_version: "encryptionkey@0"
I20260806 09:15:04.269690 16969 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260806 09:15:04.273855 16984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:04.275583 16969 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 09:15:04.275870 16969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "d42cc20b853c41a2ae9eccc264ee5961"
format_stamp: "Formatted at 2026-08-06 09:15:04 on dist-test-slave-mvvj"
server_key: "19d628341e706d0021bc3d4c9827e9c2"
server_key_iv: "56544160cb471bf6c5ccbfc0b5ca30d6"
server_key_version: "encryptionkey@0"
I20260806 09:15:04.276129 16969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:04.300999 16969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:04.306348 16969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:04.306689 16969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:04.332983 16969 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:37871
I20260806 09:15:04.333000 17037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:37871 every 8 connection(s)
I20260806 09:15:04.334503 16969 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:15:04.334909 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 16969
I20260806 09:15:04.335139 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:15:04.336069 11261 external_mini_cluster.cc:1428] Setting key 33fc021e345a472a0b961766b20dc3e8
I20260806 09:15:04.339538 17038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 09:15:04 dist-test-slave-mvvj krb5kdc[16956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007703, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:15:04.353863 17038 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d42cc20b853c41a2ae9eccc264ee5961: Bootstrap starting.
I20260806 09:15:04.357949 17038 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d42cc20b853c41a2ae9eccc264ee5961: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:04.359362 17038 log.cc:824] T 00000000000000000000000000000000 P d42cc20b853c41a2ae9eccc264ee5961: Log is configured to *not* fsync() on all Append() calls
I20260806 09:15:04.363360 17038 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d42cc20b853c41a2ae9eccc264ee5961: No bootstrap required, opened a new log
I20260806 09:15:04.364135 17041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:04.338478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36140 (local address 127.10.255.126:37871)
0806 09:15:04.339406 (+ 928us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:04.339422 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:04.339477 (+ 55us) server_negotiation.cc:407] Connection header received
0806 09:15:04.342076 (+ 2599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:04.342108 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:04.342645 (+ 537us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:04.343163 (+ 518us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:04.344756 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:04.346965 (+ 2209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:04.348459 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:04.349540 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:04.349768 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:04.354963 (+ 5195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:04.354973 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:04.354990 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:04.355046 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:04.358628 (+ 3582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:04.359794 (+ 1166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:04.359802 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:04.359809 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:04.360175 (+ 366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:04.360650 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:04.360662 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:04.360665 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:04.361444 (+ 779us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:04.361692 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:04.362360 (+ 668us) server_negotiation.cc:299] Negotiation successful
0806 09:15:04.362873 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":612,"thread_start_us":362,"threads_started":1}
I20260806 09:15:04.372435 17038 raft_consensus.cc:348] T 00000000000000000000000000000000 P d42cc20b853c41a2ae9eccc264ee5961 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d42cc20b853c41a2ae9eccc264ee5961" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37871 } }
I20260806 09:15:04.372862 17038 raft_consensus.cc:374] T 00000000000000000000000000000000 P d42cc20b853c41a2ae9eccc264ee5961 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:04.373006 17038 raft_consensus.cc:729] T 00000000000000000000000000000000 P d42cc20b853c41a2ae9eccc264ee5961 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d42cc20b853c41a2ae9eccc264ee5961, State: Initialized, Role: FOLLOWER
I20260806 09:15:04.373718 17038 consensus_queue.cc:260] T 00000000000000000000000000000000 P d42cc20b853c41a2ae9eccc264ee5961 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d42cc20b853c41a2ae9eccc264ee5961" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37871 } }
I20260806 09:15:04.374027 17038 raft_consensus.cc:388] T 00000000000000000000000000000000 P d42cc20b853c41a2ae9eccc264ee5961 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:15:04.374197 17038 raft_consensus.cc:482] T 00000000000000000000000000000000 P d42cc20b853c41a2ae9eccc264ee5961 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:15:04.374418 17038 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d42cc20b853c41a2ae9eccc264ee5961 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:04.377100 17038 raft_consensus.cc:504] T 00000000000000000000000000000000 P d42cc20b853c41a2ae9eccc264ee5961 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d42cc20b853c41a2ae9eccc264ee5961" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37871 } }
I20260806 09:15:04.377725 17038 leader_election.cc:302] T 00000000000000000000000000000000 P d42cc20b853c41a2ae9eccc264ee5961 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d42cc20b853c41a2ae9eccc264ee5961; no voters:
I20260806 09:15:04.378432 17038 leader_election.cc:288] T 00000000000000000000000000000000 P d42cc20b853c41a2ae9eccc264ee5961 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:15:04.378620 17043 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d42cc20b853c41a2ae9eccc264ee5961 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:15:04.379866 17043 raft_consensus.cc:686] T 00000000000000000000000000000000 P d42cc20b853c41a2ae9eccc264ee5961 [term 1 LEADER]: Becoming Leader. State: Replica: d42cc20b853c41a2ae9eccc264ee5961, State: Running, Role: LEADER
I20260806 09:15:04.380611 17043 consensus_queue.cc:237] T 00000000000000000000000000000000 P d42cc20b853c41a2ae9eccc264ee5961 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d42cc20b853c41a2ae9eccc264ee5961" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37871 } }
I20260806 09:15:04.381000 17038 sys_catalog.cc:564] T 00000000000000000000000000000000 P d42cc20b853c41a2ae9eccc264ee5961 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:15:04.384135 17044 sys_catalog.cc:455] T 00000000000000000000000000000000 P d42cc20b853c41a2ae9eccc264ee5961 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d42cc20b853c41a2ae9eccc264ee5961" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d42cc20b853c41a2ae9eccc264ee5961" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37871 } } }
I20260806 09:15:04.384583 17044 sys_catalog.cc:458] T 00000000000000000000000000000000 P d42cc20b853c41a2ae9eccc264ee5961 [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:04.383792 17045 sys_catalog.cc:455] T 00000000000000000000000000000000 P d42cc20b853c41a2ae9eccc264ee5961 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d42cc20b853c41a2ae9eccc264ee5961. Latest consensus state: current_term: 1 leader_uuid: "d42cc20b853c41a2ae9eccc264ee5961" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d42cc20b853c41a2ae9eccc264ee5961" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37871 } } }
I20260806 09:15:04.385363 17045 sys_catalog.cc:458] T 00000000000000000000000000000000 P d42cc20b853c41a2ae9eccc264ee5961 [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:04.385560 17052 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:15:04.393851 17052 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:15:04.406592 17052 catalog_manager.cc:1347] Generated new cluster ID: 8ada32510e704559a7e2d6733afe4523
I20260806 09:15:04.406749 17052 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:15:04.423791 17052 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:15:04.425640 17052 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:15:04.438870 17052 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d42cc20b853c41a2ae9eccc264ee5961: Generated new TSK 0
I20260806 09:15:04.440136 17052 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.255.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
I20260806 09:15:04.522837 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:37871
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:34607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:15:04.951040 17065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:04.951436 17065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:04.951614 17065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:04.959426 17065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:04.959630 17065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:04.959872 17065 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:15:04.970942 17065 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:34607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:37871
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:04.972486 17065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:04.973902 17065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:04.990518 17071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:04.990545 17073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:04.990617 17070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:04.992703 17065 server_base.cc:1034] running on GCE node
I20260806 09:15:04.993453 17065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:04.994590 17065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:04.995918 17065 hybrid_clock.cc:648] HybridClock initialized: now 1786007704995788 us; error 43 us; skew 500 ppm
I20260806 09:15:04.996311 17065 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:04 dist-test-slave-mvvj krb5kdc[16956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007704, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:05.000433 17065 init.cc:377] Logged in from keytab as kudu/127.10.255.65@KRBTEST.COM (short username kudu)
I20260806 09:15:05.002521 17065 webserver.cc:460] Webserver started at http://127.10.255.65:45075/ using document root <none> and password file <none>
I20260806 09:15:05.003434 17065 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:05.003623 17065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:05.004068 17065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:05.007578 17065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "a6edd75cafe54b1bafe457069da5fcc0"
format_stamp: "Formatted at 2026-08-06 09:15:05 on dist-test-slave-mvvj"
server_key: "6f0fbfa47b76f8b3ba7643f9e3f89e4c"
server_key_iv: "38044c9479b5356ed730d01fcf09bf0a"
server_key_version: "encryptionkey@0"
I20260806 09:15:05.008874 17065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "a6edd75cafe54b1bafe457069da5fcc0"
format_stamp: "Formatted at 2026-08-06 09:15:05 on dist-test-slave-mvvj"
server_key: "6f0fbfa47b76f8b3ba7643f9e3f89e4c"
server_key_iv: "38044c9479b5356ed730d01fcf09bf0a"
server_key_version: "encryptionkey@0"
I20260806 09:15:05.015584 17065 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260806 09:15:05.020452 17080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:05.022353 17065 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:15:05.022635 17065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "a6edd75cafe54b1bafe457069da5fcc0"
format_stamp: "Formatted at 2026-08-06 09:15:05 on dist-test-slave-mvvj"
server_key: "6f0fbfa47b76f8b3ba7643f9e3f89e4c"
server_key_iv: "38044c9479b5356ed730d01fcf09bf0a"
server_key_version: "encryptionkey@0"
I20260806 09:15:05.022923 17065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:05.046826 17065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:05.051915 17065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:05.052194 17065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:05.053213 17065 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:15:05.054798 17065 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:05.054877 17065 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:05.054979 17065 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:05.055027 17065 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:05.097782 17065 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:35923
I20260806 09:15:05.097818 17193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:35923 every 8 connection(s)
I20260806 09:15:05.099277 17065 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:15:05.105630 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 17065
I20260806 09:15:05.105877 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:15:05.106655 11261 external_mini_cluster.cc:1428] Setting key 4525958e515cd299905c69d3c9d2b466
Aug 06 09:15:05 dist-test-slave-mvvj krb5kdc[16956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007704, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:15:05.133740 17196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:05.102641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:39871 (local address 127.10.255.126:37871)
0806 09:15:05.103168 (+ 527us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:05.103173 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:05.104229 (+ 1056us) server_negotiation.cc:407] Connection header received
0806 09:15:05.106396 (+ 2167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:05.106402 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:05.106508 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:05.106639 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:05.109606 (+ 2967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:05.111537 (+ 1931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:05.115198 (+ 3661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:05.117122 (+ 1924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:05.117334 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:05.125821 (+ 8487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:05.125827 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:05.125831 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:05.125879 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:05.129446 (+ 3567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:05.130787 (+ 1341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:05.130792 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:05.130795 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:05.130953 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:05.131584 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:05.131589 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:05.131593 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:05.132005 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:05.132148 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:05.133208 (+ 1060us) server_negotiation.cc:299] Negotiation successful
0806 09:15:05.133450 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":285,"threads_started":1}
I20260806 09:15:05.135499 17197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:05.103119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37871 (local address 127.10.255.65:39871)
0806 09:15:05.104043 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:05.104093 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:05.106077 (+ 1984us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:05.107023 (+ 946us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:05.107035 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:05.108082 (+ 1047us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:05.109170 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:05.109204 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:05.111903 (+ 2699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:05.111909 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:05.114858 (+ 2949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:05.114885 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:05.117864 (+ 2979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:05.117880 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:05.118453 (+ 573us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:05.120173 (+ 1720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:05.120214 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:05.125314 (+ 5100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:05.129690 (+ 4376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:05.129705 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:05.129728 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:05.130574 (+ 846us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:05.131096 (+ 522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:05.131105 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:05.131111 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:05.131426 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:05.132149 (+ 723us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:05.132162 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:05.132732 (+ 570us) client_negotiation.cc:769] Sending connection context
0806 09:15:05.133082 (+ 350us) client_negotiation.cc:240] Negotiation successful
0806 09:15:05.133784 (+ 702us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":378,"threads_started":1}
WARNING: no policy specified for kudu/127.10.255.66@KRBTEST.COM; defaulting to no policy
I20260806 09:15:05.137470 17194 heartbeater.cc:347] Connected to a master server at 127.10.255.126:37871
I20260806 09:15:05.137948 17194 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:05.138988 17194 heartbeater.cc:511] Master 127.10.255.126:37871 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.66@KRBTEST.COM" created.
I20260806 09:15:05.141999 17002 ts_manager.cc:194] Registered new tserver with Master: a6edd75cafe54b1bafe457069da5fcc0 (127.10.255.65:35923)
I20260806 09:15:05.144373 17002 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.65@KRBTEST.COM'} at 127.10.255.65:39871
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
I20260806 09:15:05.173810 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:37871
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:34607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:15:05.561685 17200 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:05.562110 17200 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:05.562306 17200 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:05.570662 17200 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:05.570874 17200 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:05.571086 17200 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:15:05.582367 17200 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:34607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:37871
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:05.583999 17200 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:05.585685 17200 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:05.603922 17206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:05.604214 17208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:05.603922 17205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:05.606683 17200 server_base.cc:1034] running on GCE node
I20260806 09:15:05.608345 17200 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:05.610330 17200 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:05.611908 17200 hybrid_clock.cc:648] HybridClock initialized: now 1786007705611751 us; error 76 us; skew 500 ppm
I20260806 09:15:05.612394 17200 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:05 dist-test-slave-mvvj krb5kdc[16956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007705, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:05.616425 17200 init.cc:377] Logged in from keytab as kudu/127.10.255.66@KRBTEST.COM (short username kudu)
I20260806 09:15:05.619455 17200 webserver.cc:460] Webserver started at http://127.10.255.66:45319/ using document root <none> and password file <none>
I20260806 09:15:05.620779 17200 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:05.620960 17200 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:05.621667 17200 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:05.626407 17200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "79496d4e2ecb4bb0a6bd722c68472387"
format_stamp: "Formatted at 2026-08-06 09:15:05 on dist-test-slave-mvvj"
server_key: "d0df4e41712c3ee8191fecd9e6be5b77"
server_key_iv: "88c118f20d3fdf601696d6ee0e70a9b1"
server_key_version: "encryptionkey@0"
I20260806 09:15:05.627472 17200 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "79496d4e2ecb4bb0a6bd722c68472387"
format_stamp: "Formatted at 2026-08-06 09:15:05 on dist-test-slave-mvvj"
server_key: "d0df4e41712c3ee8191fecd9e6be5b77"
server_key_iv: "88c118f20d3fdf601696d6ee0e70a9b1"
server_key_version: "encryptionkey@0"
I20260806 09:15:05.634567 17200 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260806 09:15:05.639297 17215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:05.641858 17200 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260806 09:15:05.642102 17200 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "79496d4e2ecb4bb0a6bd722c68472387"
format_stamp: "Formatted at 2026-08-06 09:15:05 on dist-test-slave-mvvj"
server_key: "d0df4e41712c3ee8191fecd9e6be5b77"
server_key_iv: "88c118f20d3fdf601696d6ee0e70a9b1"
server_key_version: "encryptionkey@0"
I20260806 09:15:05.642362 17200 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:05.661368 17200 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:05.666972 17200 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:05.667269 17200 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:05.668407 17200 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:15:05.670446 17200 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:05.670560 17200 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:05.670691 17200 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:05.670753 17200 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:05.718796 17200 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:41203
I20260806 09:15:05.718850 17328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:41203 every 8 connection(s)
I20260806 09:15:05.721276 17200 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:15:05.721730 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 17200
I20260806 09:15:05.721911 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:15:05.722421 11261 external_mini_cluster.cc:1428] Setting key faf5646b5b0614c23335c6f3cc94715d
Aug 06 09:15:05 dist-test-slave-mvvj krb5kdc[16956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007705, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.255.67@KRBTEST.COM; defaulting to no policy
I20260806 09:15:05.751763 17331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:05.724812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:60285 (local address 127.10.255.126:37871)
0806 09:15:05.725620 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:05.725629 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:05.726863 (+ 1234us) server_negotiation.cc:407] Connection header received
0806 09:15:05.729383 (+ 2520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:05.729394 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:05.729536 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:05.729690 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:05.731723 (+ 2033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:05.733120 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:05.735451 (+ 2331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:05.736059 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:05.736240 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:05.741616 (+ 5376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:05.741622 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:05.741626 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:05.741672 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:05.746508 (+ 4836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:05.748351 (+ 1843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:05.748365 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:05.748368 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:05.748637 (+ 269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:05.749507 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:05.749512 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:05.749514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:05.749931 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:05.750076 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:05.751230 (+ 1154us) server_negotiation.cc:299] Negotiation successful
0806 09:15:05.751475 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":281,"threads_started":1}
I20260806 09:15:05.753114 17332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:05.725593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37871 (local address 127.10.255.66:60285)
0806 09:15:05.726632 (+ 1039us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:05.726696 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:05.728946 (+ 2250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:05.730051 (+ 1105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:05.730062 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:05.730727 (+ 665us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:05.731443 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:05.731466 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:05.733419 (+ 1953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:05.733424 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:05.735185 (+ 1761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:05.735208 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:05.736395 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:05.736406 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:05.736714 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:05.737629 (+ 915us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:05.737660 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:05.740950 (+ 3290us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:05.746842 (+ 5892us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:05.746859 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:05.746885 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:05.748087 (+ 1202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:05.748850 (+ 763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:05.748859 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:05.748864 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:05.749269 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:05.750126 (+ 857us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:05.750135 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:05.750656 (+ 521us) client_negotiation.cc:769] Sending connection context
0806 09:15:05.751015 (+ 359us) client_negotiation.cc:240] Negotiation successful
0806 09:15:05.751521 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":702,"thread_start_us":436,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.67@KRBTEST.COM" created.
I20260806 09:15:05.755529 17329 heartbeater.cc:347] Connected to a master server at 127.10.255.126:37871
I20260806 09:15:05.756039 17329 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:05.756942 17329 heartbeater.cc:511] Master 127.10.255.126:37871 requested a full tablet report, sending...
I20260806 09:15:05.759886 17002 ts_manager.cc:194] Registered new tserver with Master: 79496d4e2ecb4bb0a6bd722c68472387 (127.10.255.66:41203)
I20260806 09:15:05.761389 17002 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.66@KRBTEST.COM'} at 127.10.255.66:60285
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
I20260806 09:15:05.791059 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:37871
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:34607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:15:06.149156 17194 heartbeater.cc:503] Master 127.10.255.126:37871 was elected leader, sending a full tablet report...
W20260806 09:15:06.189388 17335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:06.189779 17335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:06.189955 17335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:06.198057 17335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:06.198247 17335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:06.198398 17335 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:15:06.211396 17335 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:34607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:37871
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:06.212965 17335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:06.214352 17335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:06.231355 17341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:06.231433 17343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:06.231395 17340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:06.231971 17335 server_base.cc:1034] running on GCE node
I20260806 09:15:06.232774 17335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:06.233897 17335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:06.235160 17335 hybrid_clock.cc:648] HybridClock initialized: now 1786007706235102 us; error 42 us; skew 500 ppm
I20260806 09:15:06.235563 17335 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:06 dist-test-slave-mvvj krb5kdc[16956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007706, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:06.239290 17335 init.cc:377] Logged in from keytab as kudu/127.10.255.67@KRBTEST.COM (short username kudu)
I20260806 09:15:06.241839 17335 webserver.cc:460] Webserver started at http://127.10.255.67:35083/ using document root <none> and password file <none>
I20260806 09:15:06.242651 17335 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:06.242780 17335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:06.243078 17335 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:06.246605 17335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "b6814b0b86944a2a98b4a27b03773782"
format_stamp: "Formatted at 2026-08-06 09:15:06 on dist-test-slave-mvvj"
server_key: "2f1a34ebac5de9b64f1edd33437e0592"
server_key_iv: "224e133ad5d6296cf76c9db91839a7f4"
server_key_version: "encryptionkey@0"
I20260806 09:15:06.247592 17335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "b6814b0b86944a2a98b4a27b03773782"
format_stamp: "Formatted at 2026-08-06 09:15:06 on dist-test-slave-mvvj"
server_key: "2f1a34ebac5de9b64f1edd33437e0592"
server_key_iv: "224e133ad5d6296cf76c9db91839a7f4"
server_key_version: "encryptionkey@0"
I20260806 09:15:06.254674 17335 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 09:15:06.259140 17350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:06.261096 17335 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:15:06.261325 17335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "b6814b0b86944a2a98b4a27b03773782"
format_stamp: "Formatted at 2026-08-06 09:15:06 on dist-test-slave-mvvj"
server_key: "2f1a34ebac5de9b64f1edd33437e0592"
server_key_iv: "224e133ad5d6296cf76c9db91839a7f4"
server_key_version: "encryptionkey@0"
I20260806 09:15:06.261565 17335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:06.312855 17335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:06.318388 17335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:06.318782 17335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:06.320007 17335 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:15:06.321753 17335 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:06.321847 17335 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:06.322022 17335 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:06.322093 17335 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:06.362437 17335 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:34287
I20260806 09:15:06.362573 17463 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:34287 every 8 connection(s)
I20260806 09:15:06.363966 17335 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:15:06.372326 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 17335
I20260806 09:15:06.372529 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:15:06.373097 11261 external_mini_cluster.cc:1428] Setting key 05301ec18677c39c6534f71969542fb8
Aug 06 09:15:06 dist-test-slave-mvvj krb5kdc[16956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007706, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:15:06.392266 17466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:06.367131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:55245 (local address 127.10.255.126:37871)
0806 09:15:06.367660 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:06.367665 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:06.368900 (+ 1235us) server_negotiation.cc:407] Connection header received
0806 09:15:06.371096 (+ 2196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:06.371102 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:06.371210 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:06.371340 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:06.374010 (+ 2670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:06.375513 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:06.377936 (+ 2423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:06.378397 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:06.378521 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:06.383064 (+ 4543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:06.383070 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:06.383074 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:06.383120 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:06.386866 (+ 3746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:06.388074 (+ 1208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:06.388079 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:06.388081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:06.388251 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:06.389193 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:06.389198 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:06.389202 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:06.389825 (+ 623us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:06.390071 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:06.391492 (+ 1421us) server_negotiation.cc:299] Negotiation successful
0806 09:15:06.391819 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":287,"threads_started":1}
I20260806 09:15:06.393672 17467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:06.367623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37871 (local address 127.10.255.67:55245)
0806 09:15:06.368699 (+ 1076us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:06.368740 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:06.370752 (+ 2012us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:06.371645 (+ 893us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:06.371654 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:06.372569 (+ 915us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:06.373674 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:06.373714 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:06.375753 (+ 2039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:06.375762 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:06.377741 (+ 1979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:06.377761 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:06.378674 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:06.378680 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:06.378904 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:06.379752 (+ 848us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:06.379779 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:06.382774 (+ 2995us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:06.387133 (+ 4359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:06.387148 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:06.387174 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:06.387820 (+ 646us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:06.388411 (+ 591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:06.388417 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:06.388421 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:06.388839 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:06.390280 (+ 1441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:06.390291 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:06.390793 (+ 502us) client_negotiation.cc:769] Sending connection context
0806 09:15:06.391228 (+ 435us) client_negotiation.cc:240] Negotiation successful
0806 09:15:06.391940 (+ 712us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":832,"thread_start_us":642,"threads_started":1}
I20260806 09:15:06.395782 17464 heartbeater.cc:347] Connected to a master server at 127.10.255.126:37871
I20260806 09:15:06.396536 17464 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:06.397459 17464 heartbeater.cc:511] Master 127.10.255.126:37871 requested a full tablet report, sending...
I20260806 09:15:06.399277 17002 ts_manager.cc:194] Registered new tserver with Master: b6814b0b86944a2a98b4a27b03773782 (127.10.255.67:34287)
I20260806 09:15:06.400779 17002 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.67@KRBTEST.COM'} at 127.10.255.67:55245
I20260806 09:15:06.404965 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/test-admin.keytab.
Aug 06 09:15:06 dist-test-slave-mvvj krb5kdc[16956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:06.439276 11261 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260806 09:15:06.446913 17472 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:06.443167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45862 (local address 127.10.255.65:35923)
0806 09:15:06.444201 (+ 1034us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:06.444214 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:06.444357 (+ 143us) server_negotiation.cc:407] Connection header received
0806 09:15:06.444627 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:06.444637 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:06.444892 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:06.445081 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:06.446330 (+ 1249us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45862: BlockingRecv error: recv got EOF from 127.0.0.1:45862 (error 108)
Metrics: {"server-negotiator.queue_time_us":788,"thread_start_us":465,"threads_started":1}
W20260806 09:15:06.447069 11261 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/krb5cc' of type FILE
Aug 06 09:15:06 dist-test-slave-mvvj krb5kdc[16956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:06.449126 11261 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 09:15:06 dist-test-slave-mvvj krb5kdc[16956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:06.450975 11261 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 09:15:06 dist-test-slave-mvvj krb5kdc[16956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.65@KRBTEST.COM
I20260806 09:15:06.470710 17472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:06.453303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45874 (local address 127.10.255.65:35923)
0806 09:15:06.453536 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:06.453541 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:06.453656 (+ 115us) server_negotiation.cc:407] Connection header received
0806 09:15:06.453832 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:06.453836 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:06.453927 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:06.454019 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:06.455257 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:06.456586 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:06.458039 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:06.458689 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:06.458802 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:06.463516 (+ 4714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:06.463536 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:06.463554 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:06.463601 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:06.467083 (+ 3482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:06.468093 (+ 1010us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:06.468103 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:06.468106 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:06.468263 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:06.468799 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:06.468803 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:06.468806 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:06.469259 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:06.469625 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:06.470052 (+ 427us) server_negotiation.cc:299] Negotiation successful
0806 09:15:06.470373 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
W20260806 09:15:06.477861 17472 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:06.475991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45884 (local address 127.10.255.65:35923)
0806 09:15:06.476252 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:06.476258 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:06.476472 (+ 214us) server_negotiation.cc:407] Connection header received
0806 09:15:06.476598 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:06.476601 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:06.476686 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:06.476773 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:06.477603 (+ 830us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45884: BlockingRecv error: recv got EOF from 127.0.0.1:45884 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
W20260806 09:15:06.477995 11261 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/krb5cc' of type FILE
Aug 06 09:15:06 dist-test-slave-mvvj krb5kdc[16956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:06.479741 11261 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 09:15:06 dist-test-slave-mvvj krb5kdc[16956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:06.481519 11261 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 09:15:06 dist-test-slave-mvvj krb5kdc[16956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.65@KRBTEST.COM
I20260806 09:15:06.499982 17472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:06.483591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45900 (local address 127.10.255.65:35923)
0806 09:15:06.483810 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:06.483815 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:06.483891 (+ 76us) server_negotiation.cc:407] Connection header received
0806 09:15:06.484129 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:06.484133 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:06.484226 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:06.484332 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:06.485761 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:06.486546 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:06.488021 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:06.488621 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:06.488760 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:06.493231 (+ 4471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:06.493238 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:06.493242 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:06.493290 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:06.496610 (+ 3320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:06.497583 (+ 973us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:06.497588 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:06.497591 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:06.497745 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:06.498203 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:06.498208 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:06.498210 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:06.498620 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:06.498876 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:06.499217 (+ 341us) server_negotiation.cc:299] Negotiation successful
0806 09:15:06.499575 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
W20260806 09:15:06.505851 17472 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:06.503469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45902 (local address 127.10.255.65:35923)
0806 09:15:06.503766 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:06.503776 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:06.504164 (+ 388us) server_negotiation.cc:407] Connection header received
0806 09:15:06.504387 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:06.504394 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:06.504489 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:06.504613 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:06.505548 (+ 935us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45902: BlockingRecv error: recv got EOF from 127.0.0.1:45902 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
W20260806 09:15:06.506193 11261 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786007647474472-11261-0/krb5kdc/krb5cc' of type FILE
Aug 06 09:15:06 dist-test-slave-mvvj krb5kdc[16956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:06.508297 11261 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 09:15:06 dist-test-slave-mvvj krb5kdc[16956](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:06.509936 11261 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 09:15:06 dist-test-slave-mvvj krb5kdc[16956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.65@KRBTEST.COM
I20260806 09:15:06.528702 17472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:06.511629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45908 (local address 127.10.255.65:35923)
0806 09:15:06.511975 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:06.511982 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:06.512291 (+ 309us) server_negotiation.cc:407] Connection header received
0806 09:15:06.512424 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:06.512428 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:06.512501 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:06.512608 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:06.513818 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:06.514625 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:06.516283 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:06.516753 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:06.516878 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:06.521840 (+ 4962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:06.521847 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:06.521851 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:06.521906 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:06.525279 (+ 3373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:06.526225 (+ 946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:06.526231 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:06.526233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:06.526420 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:06.526832 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:06.526836 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:06.526838 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:06.527204 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:06.527588 (+ 384us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:06.527983 (+ 395us) server_negotiation.cc:299] Negotiation successful
0806 09:15:06.528306 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126}
I20260806 09:15:06.531265 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 17065
I20260806 09:15:06.548307 17472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:06.532174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45922 (local address 127.10.255.65:35923)
0806 09:15:06.532350 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:06.532354 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:06.532768 (+ 414us) server_negotiation.cc:407] Connection header received
0806 09:15:06.533015 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:06.533020 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:06.533103 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:06.533209 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:06.534376 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:06.535111 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:06.536674 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:06.537423 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:06.537563 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:06.540662 (+ 3099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:06.540669 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:06.540673 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:06.540722 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:06.544901 (+ 4179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:06.545890 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:06.545896 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:06.545898 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:06.546073 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:06.546527 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:06.546531 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:06.546533 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:06.546960 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:06.547192 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:06.547692 (+ 500us) server_negotiation.cc:299] Negotiation successful
0806 09:15:06.548009 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 09:15:06.548993 17189 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:06.644343 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 17065
I20260806 09:15:06.663662 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 17200
Aug 06 09:15:06 dist-test-slave-mvvj krb5kdc[16956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.66@KRBTEST.COM
I20260806 09:15:06.683593 17486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:06.664762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60718 (local address 127.10.255.66:41203)
0806 09:15:06.665321 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:06.665328 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:06.665376 (+ 48us) server_negotiation.cc:407] Connection header received
0806 09:15:06.665439 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:06.665446 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:06.665661 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:06.665860 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:06.666932 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:06.668117 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:06.669494 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:06.670106 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:06.670269 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:06.675522 (+ 5253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:06.675543 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:06.675561 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:06.675619 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:06.679092 (+ 3473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:06.680403 (+ 1311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:06.680412 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:06.680415 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:06.680886 (+ 471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:06.681756 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:06.681761 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:06.681765 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:06.682210 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:06.682499 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:06.682938 (+ 439us) server_negotiation.cc:299] Negotiation successful
0806 09:15:06.683205 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":271,"threads_started":1}
I20260806 09:15:06.685279 17324 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:06.784978 17329 heartbeater.cc:503] Master 127.10.255.126:37871 was elected leader, sending a full tablet report...
I20260806 09:15:06.786268 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 17200
I20260806 09:15:06.804790 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 17335
W20260806 09:15:06.804715 16987 connection.cc:535] server connection from 127.10.255.66:60285 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Aug 06 09:15:06 dist-test-slave-mvvj krb5kdc[16956](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007706, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.67@KRBTEST.COM
I20260806 09:15:06.825466 17488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:06.805953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41182 (local address 127.10.255.67:34287)
0806 09:15:06.806867 (+ 914us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:06.806876 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:06.806914 (+ 38us) server_negotiation.cc:407] Connection header received
0806 09:15:06.806986 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:06.806994 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:06.807268 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:06.807497 (+ 229us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:06.808960 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:06.810180 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:06.811750 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:06.812648 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:06.812831 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:06.818183 (+ 5352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:06.818202 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:06.818220 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:06.818268 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:06.821826 (+ 3558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:06.822921 (+ 1095us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:06.822930 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:06.822933 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:06.823122 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:06.823596 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:06.823603 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:06.823606 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:06.824107 (+ 501us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:06.824463 (+ 356us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:06.824814 (+ 351us) server_negotiation.cc:299] Negotiation successful
0806 09:15:06.825132 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":312,"threads_started":1}
I20260806 09:15:06.827136 17459 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:06.920383 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 17335
I20260806 09:15:06.940714 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 16969
I20260806 09:15:06.942147 17033 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:07.054397 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 16969
2026-08-06T09:15:07Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4632 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:15:07 dist-test-slave-mvvj krb5kdc[17493](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:15:07 dist-test-slave-mvvj krb5kdc[17493](info): set up 2 sockets
Aug 06 09:15:07 dist-test-slave-mvvj krb5kdc[17493](info): commencing operation
krb5kdc: starting...
W20260806 09:15:08.199339 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.000s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:15:08 dist-test-slave-mvvj krb5kdc[17493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:15:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:15:08Z Disabled control of system clock
WARNING: no policy specified for oryx/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.126.keytab.
Entry for principal oryx/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.126.keytab.
I20260806 09:15:08.466131 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:37659
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.126.keytab
--principal=oryx/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:37659
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:15:08.853096 17506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:08.853436 17506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:08.853601 17506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:08.861931 17506 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:15:08.862080 17506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:08.862176 17506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:08.862286 17506 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:15:08.862350 17506 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:15:08.873618 17506 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:37659
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.126.keytab
--principal=oryx/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:37659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:08.875166 17506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:08.876682 17506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:08.892976 17514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:08.893196 17512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:08.893280 17511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:08.894484 17506 server_base.cc:1034] running on GCE node
I20260806 09:15:08.895375 17506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:08.897305 17506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:08.898931 17506 hybrid_clock.cc:648] HybridClock initialized: now 1786007708898840 us; error 70 us; skew 500 ppm
I20260806 09:15:08.899382 17506 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:08 dist-test-slave-mvvj krb5kdc[17493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007708, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:08.910835 17506 init.cc:377] Logged in from keytab as oryx/127.10.255.126@KRBTEST.COM (short username oryx)
I20260806 09:15:08.913401 17506 webserver.cc:460] Webserver started at http://127.10.255.126:33145/ using document root <none> and password file <none>
I20260806 09:15:08.914402 17506 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:08.914611 17506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:08.914973 17506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:08.919670 17506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "d08c975cad4141ee9b400d9aaf0a2271"
format_stamp: "Formatted at 2026-08-06 09:15:08 on dist-test-slave-mvvj"
server_key: "e02de2b99734c020dd94de2b59ef2ed7"
server_key_iv: "845f9f85ebeca6beb76af5a2d6802cc5"
server_key_version: "encryptionkey@0"
I20260806 09:15:08.920873 17506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "d08c975cad4141ee9b400d9aaf0a2271"
format_stamp: "Formatted at 2026-08-06 09:15:08 on dist-test-slave-mvvj"
server_key: "e02de2b99734c020dd94de2b59ef2ed7"
server_key_iv: "845f9f85ebeca6beb76af5a2d6802cc5"
server_key_version: "encryptionkey@0"
I20260806 09:15:08.928467 17506 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260806 09:15:08.933871 17521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:08.936108 17506 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.007s sys 0.000s
I20260806 09:15:08.936350 17506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "d08c975cad4141ee9b400d9aaf0a2271"
format_stamp: "Formatted at 2026-08-06 09:15:08 on dist-test-slave-mvvj"
server_key: "e02de2b99734c020dd94de2b59ef2ed7"
server_key_iv: "845f9f85ebeca6beb76af5a2d6802cc5"
server_key_version: "encryptionkey@0"
I20260806 09:15:08.936614 17506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:08.954747 17506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:08.960136 17506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:08.960498 17506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:08.984148 17573 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:37659 every 8 connection(s)
I20260806 09:15:08.984287 17506 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:37659
I20260806 09:15:08.987044 17506 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:15:08.992476 17574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:08.993934 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 17506
I20260806 09:15:08.994195 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:15:08.995167 11261 external_mini_cluster.cc:1428] Setting key ca07c893bd1eea0af7bef40173c504fd
I20260806 09:15:09.012535 17574 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271: Bootstrap starting.
Aug 06 09:15:09 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM
I20260806 09:15:09.016745 17574 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:09.018321 17574 log.cc:824] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271: Log is configured to *not* fsync() on all Append() calls
I20260806 09:15:09.022799 17574 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271: No bootstrap required, opened a new log
I20260806 09:15:09.027345 17577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:08.997685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49322 (local address 127.10.255.126:37659)
0806 09:15:08.998661 (+ 976us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:08.998678 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:08.998730 (+ 52us) server_negotiation.cc:407] Connection header received
0806 09:15:09.000611 (+ 1881us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:09.000641 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:09.001214 (+ 573us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:09.001668 (+ 454us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:09.004152 (+ 2484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:09.005595 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:09.008466 (+ 2871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:09.009853 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:09.010064 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:09.016128 (+ 6064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:09.016142 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:09.016164 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:09.016227 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:09.021278 (+ 5051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:09.022241 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:09.022251 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:09.022261 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:09.022619 (+ 358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:09.023150 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:09.023158 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:09.023165 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:09.024147 (+ 982us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:09.024538 (+ 391us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:09.025050 (+ 512us) server_negotiation.cc:299] Negotiation successful
0806 09:15:09.025653 (+ 603us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":725,"thread_start_us":472,"threads_started":1}
I20260806 09:15:09.034121 17574 raft_consensus.cc:348] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } }
I20260806 09:15:09.034559 17574 raft_consensus.cc:374] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:09.034677 17574 raft_consensus.cc:729] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d08c975cad4141ee9b400d9aaf0a2271, State: Initialized, Role: FOLLOWER
I20260806 09:15:09.035372 17574 consensus_queue.cc:260] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } }
I20260806 09:15:09.035636 17574 raft_consensus.cc:388] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:15:09.035796 17574 raft_consensus.cc:482] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:15:09.036013 17574 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:09.038692 17574 raft_consensus.cc:504] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } }
I20260806 09:15:09.039422 17574 leader_election.cc:302] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d08c975cad4141ee9b400d9aaf0a2271; no voters:
I20260806 09:15:09.040292 17574 leader_election.cc:288] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:15:09.040388 17579 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:15:09.041280 17579 raft_consensus.cc:686] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [term 1 LEADER]: Becoming Leader. State: Replica: d08c975cad4141ee9b400d9aaf0a2271, State: Running, Role: LEADER
I20260806 09:15:09.041935 17579 consensus_queue.cc:237] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } }
I20260806 09:15:09.043062 17574 sys_catalog.cc:564] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:15:09.045054 17580 sys_catalog.cc:455] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d08c975cad4141ee9b400d9aaf0a2271" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } }
I20260806 09:15:09.045866 17580 sys_catalog.cc:458] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:09.045913 17581 sys_catalog.cc:455] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d08c975cad4141ee9b400d9aaf0a2271. Latest consensus state: current_term: 1 leader_uuid: "d08c975cad4141ee9b400d9aaf0a2271" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } }
I20260806 09:15:09.046269 17581 sys_catalog.cc:458] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:09.048231 17585 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:15:09.054214 17585 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:15:09.065339 17585 catalog_manager.cc:1347] Generated new cluster ID: f63b1981128744e8a739fd60116c2f6c
I20260806 09:15:09.065487 17585 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:15:09.094122 17585 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:15:09.095654 17585 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:15:09.107445 17585 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271: Generated new TSK 0
I20260806 09:15:09.109376 17585 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.10.255.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.255.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.255.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.65.keytab.
Entry for principal oryx/127.10.255.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.65.keytab.
I20260806 09:15:09.185439 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:37659
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.65.keytab
--principal=oryx/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:15:09.565798 17600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:09.566145 17600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:09.566323 17600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:09.574290 17600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:09.574440 17600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:09.574643 17600 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:15:09.586215 17600 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.65.keytab
--principal=oryx/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:37659
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:09.587738 17600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:09.589332 17600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:09.605930 17606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:09.606007 17605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:09.606117 17608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:09.608059 17600 server_base.cc:1034] running on GCE node
I20260806 09:15:09.609014 17600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:09.610839 17600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:09.612188 17600 hybrid_clock.cc:648] HybridClock initialized: now 1786007709612189 us; error 157 us; skew 500 ppm
I20260806 09:15:09.612648 17600 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:09 dist-test-slave-mvvj krb5kdc[17493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007709, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:09.616982 17600 init.cc:377] Logged in from keytab as oryx/127.10.255.65@KRBTEST.COM (short username oryx)
I20260806 09:15:09.619626 17600 webserver.cc:460] Webserver started at http://127.10.255.65:36529/ using document root <none> and password file <none>
I20260806 09:15:09.620536 17600 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:09.620715 17600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:09.621086 17600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:09.624665 17600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "f81d092a894e4c32af04f0737606f460"
format_stamp: "Formatted at 2026-08-06 09:15:09 on dist-test-slave-mvvj"
server_key: "96e159403926cecec1c4b108f6e3455e"
server_key_iv: "664bb6256aa5d822f2d57376c5377eba"
server_key_version: "encryptionkey@0"
I20260806 09:15:09.625670 17600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "f81d092a894e4c32af04f0737606f460"
format_stamp: "Formatted at 2026-08-06 09:15:09 on dist-test-slave-mvvj"
server_key: "96e159403926cecec1c4b108f6e3455e"
server_key_iv: "664bb6256aa5d822f2d57376c5377eba"
server_key_version: "encryptionkey@0"
I20260806 09:15:09.632994 17600 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260806 09:15:09.637998 17615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:09.640458 17600 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.001s
I20260806 09:15:09.640738 17600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "f81d092a894e4c32af04f0737606f460"
format_stamp: "Formatted at 2026-08-06 09:15:09 on dist-test-slave-mvvj"
server_key: "96e159403926cecec1c4b108f6e3455e"
server_key_iv: "664bb6256aa5d822f2d57376c5377eba"
server_key_version: "encryptionkey@0"
I20260806 09:15:09.641053 17600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:09.670671 17600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:09.676878 17600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:09.677289 17600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:09.678618 17600 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:15:09.680456 17600 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:09.680589 17600 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:09.680765 17600 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:09.680852 17600 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:09.725214 17600 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:41895
I20260806 09:15:09.725288 17728 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:41895 every 8 connection(s)
I20260806 09:15:09.726691 17600 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:15:09.732664 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 17600
I20260806 09:15:09.732939 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:15:09.734004 11261 external_mini_cluster.cc:1428] Setting key bccb736a130ce4e4ebee9b22dcc96f74
Aug 06 09:15:09 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007709, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM
I20260806 09:15:09.757171 17731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:09.730304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:49497 (local address 127.10.255.126:37659)
0806 09:15:09.730899 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:09.730906 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:09.732308 (+ 1402us) server_negotiation.cc:407] Connection header received
0806 09:15:09.735679 (+ 3371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:09.735685 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:09.735788 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:09.735933 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:09.738585 (+ 2652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:09.739394 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:09.742358 (+ 2964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:09.742909 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:09.743074 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:09.747647 (+ 4573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:09.747658 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:09.747666 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:09.747721 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:09.752489 (+ 4768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:09.753728 (+ 1239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:09.753738 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:09.753744 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:09.753934 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:09.754597 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:09.754606 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:09.754610 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:09.755053 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:09.755221 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:09.756333 (+ 1112us) server_negotiation.cc:299] Negotiation successful
0806 09:15:09.756636 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":318,"threads_started":1}
I20260806 09:15:09.757956 17732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:09.730966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.10.255.65:49497)
0806 09:15:09.732058 (+ 1092us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:09.732136 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:09.735213 (+ 3077us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:09.736307 (+ 1094us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:09.736322 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:09.737211 (+ 889us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:09.738233 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:09.738272 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:09.739619 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:09.739627 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:09.742093 (+ 2466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:09.742121 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:09.743238 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:09.743248 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:09.743646 (+ 398us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:09.744672 (+ 1026us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:09.744700 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:09.747328 (+ 2628us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:09.752795 (+ 5467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:09.752806 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:09.752824 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:09.753564 (+ 740us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:09.754136 (+ 572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:09.754140 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:09.754142 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:09.754400 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:09.755241 (+ 841us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:09.755248 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:09.755761 (+ 513us) client_negotiation.cc:769] Sending connection context
0806 09:15:09.756155 (+ 394us) client_negotiation.cc:240] Negotiation successful
0806 09:15:09.756654 (+ 499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":651,"thread_start_us":376,"threads_started":1}
I20260806 09:15:09.760095 17729 heartbeater.cc:347] Connected to a master server at 127.10.255.126:37659
I20260806 09:15:09.760519 17729 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:09.761605 17729 heartbeater.cc:511] Master 127.10.255.126:37659 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.10.255.66@KRBTEST.COM; defaulting to no policy
I20260806 09:15:09.765010 17538 ts_manager.cc:194] Registered new tserver with Master: f81d092a894e4c32af04f0737606f460 (127.10.255.65:41895)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.255.66@KRBTEST.COM" created.
I20260806 09:15:09.766930 17538 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.255.65@KRBTEST.COM'} at 127.10.255.65:49497
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.255.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.66.keytab.
Entry for principal oryx/127.10.255.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.66.keytab.
I20260806 09:15:09.796254 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:37659
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.66.keytab
--principal=oryx/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:15:10.194344 17735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:10.194720 17735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:10.194905 17735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:10.203060 17735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:10.203240 17735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:10.203428 17735 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:15:10.215595 17735 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.66.keytab
--principal=oryx/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:37659
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:10.217250 17735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:10.219058 17735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:10.234916 17741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:10.235759 17743 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:10.235945 17740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:10.236217 17735 server_base.cc:1034] running on GCE node
I20260806 09:15:10.236984 17735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:10.238140 17735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:10.239427 17735 hybrid_clock.cc:648] HybridClock initialized: now 1786007710239372 us; error 77 us; skew 500 ppm
I20260806 09:15:10.239929 17735 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:10 dist-test-slave-mvvj krb5kdc[17493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007710, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:10.243808 17735 init.cc:377] Logged in from keytab as oryx/127.10.255.66@KRBTEST.COM (short username oryx)
I20260806 09:15:10.245779 17735 webserver.cc:460] Webserver started at http://127.10.255.66:44005/ using document root <none> and password file <none>
I20260806 09:15:10.246564 17735 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:10.246707 17735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:10.247035 17735 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:10.250463 17735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "9aae9d56b455429982b1ef53f4a2851e"
format_stamp: "Formatted at 2026-08-06 09:15:10 on dist-test-slave-mvvj"
server_key: "7b0f9b8cf1bfe79b84ea8b2fd2f3f10f"
server_key_iv: "93308376180854ffcf0ff83a62ebeb5f"
server_key_version: "encryptionkey@0"
I20260806 09:15:10.251411 17735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "9aae9d56b455429982b1ef53f4a2851e"
format_stamp: "Formatted at 2026-08-06 09:15:10 on dist-test-slave-mvvj"
server_key: "7b0f9b8cf1bfe79b84ea8b2fd2f3f10f"
server_key_iv: "93308376180854ffcf0ff83a62ebeb5f"
server_key_version: "encryptionkey@0"
I20260806 09:15:10.257861 17735 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260806 09:15:10.262672 17750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:10.264560 17735 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 09:15:10.264791 17735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "9aae9d56b455429982b1ef53f4a2851e"
format_stamp: "Formatted at 2026-08-06 09:15:10 on dist-test-slave-mvvj"
server_key: "7b0f9b8cf1bfe79b84ea8b2fd2f3f10f"
server_key_iv: "93308376180854ffcf0ff83a62ebeb5f"
server_key_version: "encryptionkey@0"
I20260806 09:15:10.265090 17735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:10.311316 17735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:10.317150 17735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:10.317543 17735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:10.318735 17735 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:15:10.320484 17735 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:10.320604 17735 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:10.320775 17735 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:10.320853 17735 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:10.360740 17735 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:43671
I20260806 09:15:10.360831 17864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:43671 every 8 connection(s)
I20260806 09:15:10.362349 17735 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:15:10.366672 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 17735
I20260806 09:15:10.366870 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:15:10.367398 11261 external_mini_cluster.cc:1428] Setting key 5125b1a6db95cdb1aec0a105f8d9db25
Aug 06 09:15:10 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007710, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM
I20260806 09:15:10.389994 17867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:10.365986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:44607 (local address 127.10.255.126:37659)
0806 09:15:10.366541 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:10.366548 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:10.367946 (+ 1398us) server_negotiation.cc:407] Connection header received
0806 09:15:10.370490 (+ 2544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:10.370497 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:10.370598 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:10.370721 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:10.372713 (+ 1992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:10.373875 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:10.375891 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:10.376601 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:10.376721 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:10.381848 (+ 5127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:10.381855 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:10.381859 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:10.381903 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:10.385258 (+ 3355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:10.386637 (+ 1379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:10.386642 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:10.386645 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:10.386804 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:10.387508 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:10.387513 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:10.387516 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:10.388096 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:10.388244 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:10.389438 (+ 1194us) server_negotiation.cc:299] Negotiation successful
0806 09:15:10.389684 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":265,"threads_started":1}
I20260806 09:15:10.391800 17868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:10.366609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.10.255.66:44607)
0806 09:15:10.367694 (+ 1085us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:10.367757 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:10.370097 (+ 2340us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:10.370980 (+ 883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:10.370990 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:10.371723 (+ 733us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:10.372498 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:10.372521 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:10.374112 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:10.374117 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:10.375656 (+ 1539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:10.375672 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:10.376911 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:10.376919 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:10.377344 (+ 425us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:10.378291 (+ 947us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:10.378319 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:10.381479 (+ 3160us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:10.385523 (+ 4044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:10.385540 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:10.385567 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:10.386404 (+ 837us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:10.386969 (+ 565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:10.386978 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:10.386985 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:10.387312 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:10.388274 (+ 962us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:10.388287 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:10.388916 (+ 629us) client_negotiation.cc:769] Sending connection context
0806 09:15:10.389314 (+ 398us) client_negotiation.cc:240] Negotiation successful
0806 09:15:10.390011 (+ 697us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":737,"thread_start_us":483,"threads_started":1}
WARNING: no policy specified for oryx/127.10.255.67@KRBTEST.COM; defaulting to no policy
I20260806 09:15:10.393549 17865 heartbeater.cc:347] Connected to a master server at 127.10.255.126:37659
I20260806 09:15:10.393946 17865 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:10.394923 17865 heartbeater.cc:511] Master 127.10.255.126:37659 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.255.67@KRBTEST.COM" created.
I20260806 09:15:10.396952 17538 ts_manager.cc:194] Registered new tserver with Master: 9aae9d56b455429982b1ef53f4a2851e (127.10.255.66:43671)
I20260806 09:15:10.398056 17538 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.255.66@KRBTEST.COM'} at 127.10.255.66:44607
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.255.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.67.keytab.
Entry for principal oryx/127.10.255.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.67.keytab.
I20260806 09:15:10.437220 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:37659
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.67.keytab
--principal=oryx/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:15:10.771778 17729 heartbeater.cc:503] Master 127.10.255.126:37659 was elected leader, sending a full tablet report...
W20260806 09:15:10.836500 17871 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:10.836834 17871 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:10.837001 17871 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:10.845206 17871 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:10.845341 17871 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:10.845548 17871 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:15:10.856976 17871 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.67.keytab
--principal=oryx/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:37659
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:10.858444 17871 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:10.859926 17871 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:10.875136 17876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:10.875103 17877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:10.875160 17879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:10.876569 17871 server_base.cc:1034] running on GCE node
I20260806 09:15:10.877300 17871 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:10.878464 17871 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:10.879715 17871 hybrid_clock.cc:648] HybridClock initialized: now 1786007710879655 us; error 48 us; skew 500 ppm
I20260806 09:15:10.880146 17871 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:10 dist-test-slave-mvvj krb5kdc[17493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007710, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:10.884439 17871 init.cc:377] Logged in from keytab as oryx/127.10.255.67@KRBTEST.COM (short username oryx)
I20260806 09:15:10.886405 17871 webserver.cc:460] Webserver started at http://127.10.255.67:40291/ using document root <none> and password file <none>
I20260806 09:15:10.887233 17871 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:10.887388 17871 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:10.887758 17871 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:10.891405 17871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "49c087aa22794e949203a2da505e57d7"
format_stamp: "Formatted at 2026-08-06 09:15:10 on dist-test-slave-mvvj"
server_key: "35d6351f2544e5944cff7641e9e08483"
server_key_iv: "28dd0c89c680eb5d29b1ffcf2c85fcd7"
server_key_version: "encryptionkey@0"
I20260806 09:15:10.892542 17871 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "49c087aa22794e949203a2da505e57d7"
format_stamp: "Formatted at 2026-08-06 09:15:10 on dist-test-slave-mvvj"
server_key: "35d6351f2544e5944cff7641e9e08483"
server_key_iv: "28dd0c89c680eb5d29b1ffcf2c85fcd7"
server_key_version: "encryptionkey@0"
I20260806 09:15:10.898844 17871 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.003s
I20260806 09:15:10.903779 17886 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:10.905548 17871 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:15:10.905797 17871 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "49c087aa22794e949203a2da505e57d7"
format_stamp: "Formatted at 2026-08-06 09:15:10 on dist-test-slave-mvvj"
server_key: "35d6351f2544e5944cff7641e9e08483"
server_key_iv: "28dd0c89c680eb5d29b1ffcf2c85fcd7"
server_key_version: "encryptionkey@0"
I20260806 09:15:10.906054 17871 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:10.937780 17871 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:10.943173 17871 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:10.943534 17871 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:10.944844 17871 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:15:10.946496 17871 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:10.946575 17871 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:10.946749 17871 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:10.946833 17871 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:10.984593 17871 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:39139
I20260806 09:15:10.984625 17999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:39139 every 8 connection(s)
I20260806 09:15:10.986405 17871 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:15:10.987766 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 17871
I20260806 09:15:10.987975 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:15:10.988664 11261 external_mini_cluster.cc:1428] Setting key 1ffc1f350f6ecfbe66d55c6bc3caaea9
Aug 06 09:15:11 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007710, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM
I20260806 09:15:11.025677 18002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:10.990407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:40103 (local address 127.10.255.126:37659)
0806 09:15:11.004280 (+ 13873us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:11.004287 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:11.007940 (+ 3653us) server_negotiation.cc:407] Connection header received
0806 09:15:11.008025 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:11.008030 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:11.008134 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:11.008275 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:11.010317 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.011296 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.013180 (+ 1884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.013636 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.013803 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:11.018322 (+ 4519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:11.018332 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:11.018339 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:11.018398 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:11.022170 (+ 3772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:11.023145 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:11.023150 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:11.023153 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:11.023303 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:11.023783 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:11.023787 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:11.023790 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:11.024187 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:11.024324 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:11.025143 (+ 819us) server_negotiation.cc:299] Negotiation successful
0806 09:15:11.025352 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13718,"thread_start_us":13882,"threads_started":1}
I20260806 09:15:11.026695 18003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:10.991116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.10.255.67:40103)
0806 09:15:11.004822 (+ 13706us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:11.004892 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:11.007611 (+ 2719us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:11.008616 (+ 1005us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:11.008627 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:11.009278 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:11.010097 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:11.010123 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.011515 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.011521 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:11.012991 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:11.013007 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.013935 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.013944 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:11.014232 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:11.015085 (+ 853us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:11.015114 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:11.017894 (+ 2780us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:11.022375 (+ 4481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:11.022386 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:11.022403 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:11.022959 (+ 556us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:11.023416 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:11.023419 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:11.023421 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:11.023634 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:11.024324 (+ 690us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:11.024331 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:11.024726 (+ 395us) client_negotiation.cc:769] Sending connection context
0806 09:15:11.024976 (+ 250us) client_negotiation.cc:240] Negotiation successful
0806 09:15:11.025458 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13107,"thread_start_us":12872,"threads_started":1}
I20260806 09:15:11.028613 18000 heartbeater.cc:347] Connected to a master server at 127.10.255.126:37659
I20260806 09:15:11.028932 18000 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:11.029735 18000 heartbeater.cc:511] Master 127.10.255.126:37659 requested a full tablet report, sending...
I20260806 09:15:11.031621 17537 ts_manager.cc:194] Registered new tserver with Master: 49c087aa22794e949203a2da505e57d7 (127.10.255.67:39139)
I20260806 09:15:11.032867 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 09:15:11.032953 17537 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.255.67@KRBTEST.COM'} at 127.10.255.67:40103
WARNING: no policy specified for oryx/127.10.255.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.255.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.255.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.125.keytab.
Entry for principal oryx/127.10.255.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.125.keytab.
I20260806 09:15:11.089047 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.125:34367
--webserver_interface=127.10.255.125
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.125.keytab
--principal=oryx/127.10.255.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:37659,127.10.255.125:34367
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:15:11.402288 17865 heartbeater.cc:503] Master 127.10.255.126:37659 was elected leader, sending a full tablet report...
W20260806 09:15:11.451414 18006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:11.452005 18006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:11.452195 18006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:11.461745 18006 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:15:11.461957 18006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:11.462095 18006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:11.462198 18006 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:15:11.462270 18006 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:15:11.474853 18006 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:37659,127.10.255.125:34367
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.125.keytab
--principal=oryx/127.10.255.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.125:34367
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.255.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
W20260806 09:15:11.475338 18006 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.10.255.126:37659,127.10.255.125:34367'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260806 09:15:11.476577 18006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:11.478039 18006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:11.491632 18011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:11.491652 18014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:11.491683 18012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:11.493119 18006 server_base.cc:1034] running on GCE node
I20260806 09:15:11.494271 18006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:11.496089 18006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:11.497390 18006 hybrid_clock.cc:648] HybridClock initialized: now 1786007711497328 us; error 43 us; skew 500 ppm
I20260806 09:15:11.497851 18006 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:11 dist-test-slave-mvvj krb5kdc[17493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007711, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:11.501690 18006 init.cc:377] Logged in from keytab as oryx/127.10.255.125@KRBTEST.COM (short username oryx)
I20260806 09:15:11.503944 18006 webserver.cc:460] Webserver started at http://127.10.255.125:45761/ using document root <none> and password file <none>
I20260806 09:15:11.504845 18006 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:11.505002 18006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:11.505354 18006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:11.508847 18006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/data/instance:
uuid: "ec89e5a865984246932e8121ee719094"
format_stamp: "Formatted at 2026-08-06 09:15:11 on dist-test-slave-mvvj"
server_key: "27416878ac85b4c252966a3c39ca27c4"
server_key_iv: "6b9ececf839c32a5e6cabb3f95518aa3"
server_key_version: "encryptionkey@0"
I20260806 09:15:11.509766 18006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/wal/instance:
uuid: "ec89e5a865984246932e8121ee719094"
format_stamp: "Formatted at 2026-08-06 09:15:11 on dist-test-slave-mvvj"
server_key: "27416878ac85b4c252966a3c39ca27c4"
server_key_iv: "6b9ececf839c32a5e6cabb3f95518aa3"
server_key_version: "encryptionkey@0"
I20260806 09:15:11.515684 18006 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260806 09:15:11.519944 18021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:11.521680 18006 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260806 09:15:11.521857 18006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/wal
uuid: "ec89e5a865984246932e8121ee719094"
format_stamp: "Formatted at 2026-08-06 09:15:11 on dist-test-slave-mvvj"
server_key: "27416878ac85b4c252966a3c39ca27c4"
server_key_iv: "6b9ececf839c32a5e6cabb3f95518aa3"
server_key_version: "encryptionkey@0"
I20260806 09:15:11.522084 18006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:11.551316 18006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:11.556535 18006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:11.556890 18006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:11.579257 18006 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.125:34367
I20260806 09:15:11.579279 18073 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.125:34367 every 8 connection(s)
I20260806 09:15:11.581050 18006 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/data/info.pb
I20260806 09:15:11.584434 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 18006
I20260806 09:15:11.586050 18074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:11.597654 18074 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 09:15:11 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.255.125@KRBTEST.COM
Aug 06 09:15:11 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007711, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.125@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM
I20260806 09:15:11.614378 18077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:11.587078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44270 (local address 127.10.255.125:34367)
0806 09:15:11.588006 (+ 928us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:11.588019 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:11.588064 (+ 45us) server_negotiation.cc:407] Connection header received
0806 09:15:11.589703 (+ 1639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:11.589728 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:11.590177 (+ 449us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:11.590601 (+ 424us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:11.593016 (+ 2415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.594557 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.596664 (+ 2107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.597470 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.597737 (+ 267us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:11.603886 (+ 6149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:11.603898 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:11.603918 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:11.603972 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:11.608659 (+ 4687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:11.609811 (+ 1152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:11.609826 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:11.609836 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:11.610139 (+ 303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:11.610743 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:11.610747 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:11.610749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:11.611484 (+ 735us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:11.611783 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:11.612426 (+ 643us) server_negotiation.cc:299] Negotiation successful
0806 09:15:11.613006 (+ 580us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":685,"thread_start_us":431,"threads_started":1}
I20260806 09:15:11.622150 18079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:11.601725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49330 (local address 127.10.255.126:37659)
0806 09:15:11.603338 (+ 1613us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:11.603345 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:11.603368 (+ 23us) server_negotiation.cc:407] Connection header received
0806 09:15:11.603541 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:11.603550 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:11.603669 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:11.603758 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:11.605760 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.606970 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.609235 (+ 2265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.610036 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.610199 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:11.614660 (+ 4461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:11.614671 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:11.614676 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:11.614738 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:11.618696 (+ 3958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:11.619613 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:11.619619 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:11.619621 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:11.619789 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:11.620556 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:11.620560 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:11.620563 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:11.620968 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:11.621115 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:11.621678 (+ 563us) server_negotiation.cc:299] Negotiation successful
0806 09:15:11.621886 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1472,"thread_start_us":1350,"threads_started":1}
I20260806 09:15:11.622164 18078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:11.601627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.0.0.1:49330)
0806 09:15:11.602652 (+ 1025us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:11.602721 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:11.602981 (+ 260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:11.603883 (+ 902us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:11.603893 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:11.604942 (+ 1049us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:11.605481 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:11.605497 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.607165 (+ 1668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.607171 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:11.609041 (+ 1870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:11.609055 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.610416 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.610426 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:11.610751 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:11.611613 (+ 862us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:11.611640 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:11.614347 (+ 2707us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:11.618860 (+ 4513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:11.618873 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:11.618878 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:11.619423 (+ 545us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:11.620149 (+ 726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:11.620153 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:11.620156 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:11.620317 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:11.621119 (+ 802us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:11.621126 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:11.621300 (+ 174us) client_negotiation.cc:769] Sending connection context
0806 09:15:11.621528 (+ 228us) client_negotiation.cc:240] Negotiation successful
0806 09:15:11.621839 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":410,"threads_started":1}
I20260806 09:15:11.624198 18074 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 09:15:11 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007711, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.125@KRBTEST.COM for oryx/127.10.255.125@KRBTEST.COM
I20260806 09:15:11.638936 18078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:11.625119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:34367 (local address 127.0.0.1:44278)
0806 09:15:11.625344 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:11.625360 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:11.625513 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:11.625915 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:11.625920 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:11.626500 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:11.626678 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:11.626688 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.627899 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.627903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:11.628926 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:11.628941 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.629801 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.629807 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:11.629992 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:11.630659 (+ 667us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:11.630677 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:11.632941 (+ 2264us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:11.636328 (+ 3387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:11.636333 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:11.636335 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:11.636786 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:11.637264 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:11.637268 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:11.637271 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:11.637410 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:11.638027 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:11.638030 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:11.638177 (+ 147us) client_negotiation.cc:769] Sending connection context
0806 09:15:11.638294 (+ 117us) client_negotiation.cc:240] Negotiation successful
0806 09:15:11.638545 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96}
I20260806 09:15:11.639369 18077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:11.625377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44278 (local address 127.10.255.125:34367)
0806 09:15:11.625528 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:11.625533 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:11.625654 (+ 121us) server_negotiation.cc:407] Connection header received
0806 09:15:11.625701 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:11.625704 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:11.625762 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:11.625833 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:11.626853 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.627675 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.629106 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.629611 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.629723 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:11.633152 (+ 3429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:11.633157 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:11.633161 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:11.633196 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:11.636178 (+ 2982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:11.636931 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:11.636936 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:11.636939 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:11.637110 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:11.637557 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:11.637561 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:11.637563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:11.637891 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:11.638017 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:11.638501 (+ 484us) server_negotiation.cc:299] Negotiation successful
0806 09:15:11.638772 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 09:15:11.645839 18074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094: Bootstrap starting.
I20260806 09:15:11.649397 18074 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:11.650563 18074 log.cc:824] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094: Log is configured to *not* fsync() on all Append() calls
I20260806 09:15:11.653614 18074 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094: No bootstrap required, opened a new log
I20260806 09:15:11.661109 18074 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } }
I20260806 09:15:11.661514 18074 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:11.661644 18074 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec89e5a865984246932e8121ee719094, State: Initialized, Role: FOLLOWER
I20260806 09:15:11.662261 18074 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } }
I20260806 09:15:11.663229 18081 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } } }
I20260806 09:15:11.663580 18081 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:15:11.664467 18074 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 09:15:11.675406 18092 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 09:15:11.675712 18092 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 09:15:11.679970 18006 master_runner.cc:428] Detected that this master ec89e5a865984246932e8121ee719094 is joining an existing cluster
I20260806 09:15:11.680130 18006 master_runner.cc:432] Initiating AddMaster RPC to add 127.10.255.125:34367
I20260806 09:15:11.702893 18098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:11.685949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:34367 (local address 127.0.0.1:44292)
0806 09:15:11.686975 (+ 1026us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:11.687010 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:11.687240 (+ 230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:11.687902 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:11.687907 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:11.688632 (+ 725us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:11.689139 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:11.689153 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.690949 (+ 1796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.690959 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:11.692960 (+ 2001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:11.692980 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.694292 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.694298 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:11.694518 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:11.695313 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:11.695338 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:11.696300 (+ 962us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:11.699860 (+ 3560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:11.699866 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:11.699870 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:11.700381 (+ 511us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:11.700846 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:11.700851 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:11.700855 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:11.701038 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:11.701649 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:11.701655 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:11.701825 (+ 170us) client_negotiation.cc:769] Sending connection context
0806 09:15:11.701975 (+ 150us) client_negotiation.cc:240] Negotiation successful
0806 09:15:11.702341 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":794,"thread_start_us":569,"threads_started":1}
I20260806 09:15:11.702996 18077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:11.685615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44292 (local address 127.10.255.125:34367)
0806 09:15:11.685862 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:11.685874 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:11.687164 (+ 1290us) server_negotiation.cc:407] Connection header received
0806 09:15:11.687402 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:11.687412 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:11.687512 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:11.687652 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:11.689320 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.690700 (+ 1380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.693195 (+ 2495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.694044 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.694216 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:11.696515 (+ 2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:11.696524 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:11.696531 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:11.696571 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:11.699678 (+ 3107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:11.700514 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:11.700529 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:11.700531 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:11.700715 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:11.701173 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:11.701179 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:11.701182 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:11.701520 (+ 338us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:11.701688 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:11.702140 (+ 452us) server_negotiation.cc:299] Negotiation successful
0806 09:15:11.702556 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":118,"server-negotiator.queue_time_us":73}
I20260806 09:15:11.703440 18079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:11.685646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49334 (local address 127.10.255.126:37659)
0806 09:15:11.685864 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:11.685872 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:11.688035 (+ 2163us) server_negotiation.cc:407] Connection header received
0806 09:15:11.688173 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:11.688181 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:11.688316 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:11.688437 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:11.689747 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.690686 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.692400 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.692883 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.693063 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:11.695736 (+ 2673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:11.695744 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:11.695749 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:11.695799 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:11.699682 (+ 3883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:11.700684 (+ 1002us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:11.700690 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:11.700693 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:11.700871 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:11.701341 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:11.701346 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:11.701350 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:11.701739 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:11.701904 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:11.702585 (+ 681us) server_negotiation.cc:299] Negotiation successful
0806 09:15:11.702869 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 09:15:11.704389 18099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:11.686079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.0.0.1:49334)
0806 09:15:11.687908 (+ 1829us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:11.687924 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:11.688051 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:11.688480 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:11.688485 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:11.689251 (+ 766us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:11.689573 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:11.689583 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.690841 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.690853 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:11.692200 (+ 1347us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:11.692215 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.693115 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.693123 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:11.693313 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:11.694002 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:11.694026 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:11.695470 (+ 1444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:11.699907 (+ 4437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:11.699913 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:11.699917 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:11.700541 (+ 624us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:11.701002 (+ 461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:11.701006 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:11.701010 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:11.701194 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:11.701868 (+ 674us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:11.701873 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:11.702070 (+ 197us) client_negotiation.cc:769] Sending connection context
0806 09:15:11.702274 (+ 204us) client_negotiation.cc:240] Negotiation successful
0806 09:15:11.703889 (+ 1615us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1670,"mutex_wait_us":1251,"spinlock_wait_cycles":35072,"thread_start_us":1487,"threads_started":1}
Aug 06 09:15:11 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007708, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.126@KRBTEST.COM for oryx/127.10.255.125@KRBTEST.COM
I20260806 09:15:11.735208 18077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:11.712996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44300 (local address 127.10.255.125:34367)
0806 09:15:11.713248 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:11.713256 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:11.713872 (+ 616us) server_negotiation.cc:407] Connection header received
0806 09:15:11.714251 (+ 379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:11.714256 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:11.714341 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:11.714450 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:11.716281 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.717160 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.719324 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.719977 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.720162 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:11.725583 (+ 5421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:11.725593 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:11.725650 (+ 57us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:11.725705 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:11.730848 (+ 5143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:11.732375 (+ 1527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:11.732385 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:11.732391 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:11.732624 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:11.733308 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:11.733317 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:11.733320 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:11.733699 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:11.733907 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:11.734499 (+ 592us) server_negotiation.cc:299] Negotiation successful
0806 09:15:11.734797 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 09:15:11.735275 18100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:11.712967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:34367 (local address 127.0.0.1:44300)
0806 09:15:11.713691 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:11.713741 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:11.713964 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:11.714584 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:11.714593 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:11.715650 (+ 1057us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:11.716050 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:11.716066 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.717337 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.717344 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:11.719088 (+ 1744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:11.719109 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.720234 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.720241 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:11.720488 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:11.721319 (+ 831us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:11.721352 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:11.725274 (+ 3922us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:11.731224 (+ 5950us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:11.731252 (+ 28us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:11.731262 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:11.732151 (+ 889us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:11.732790 (+ 639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:11.732798 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:11.732805 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:11.733104 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:11.733880 (+ 776us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:11.733890 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:11.734142 (+ 252us) client_negotiation.cc:769] Sending connection context
0806 09:15:11.734376 (+ 234us) client_negotiation.cc:240] Negotiation successful
0806 09:15:11.734797 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":271,"threads_started":1}
I20260806 09:15:11.737993 17537 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.10.255.125:34367: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "ec89e5a865984246932e8121ee719094"
member_type: NON_VOTER
last_known_addr {
host: "127.10.255.125"
port: 34367
}
attrs {
promote: true
}
}
dest_uuid: "d08c975cad4141ee9b400d9aaf0a2271"
cas_config_opid_index: -1
I20260806 09:15:11.739425 17537 consensus_queue.cc:237] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: NON_VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: true } }
I20260806 09:15:11.749630 18048 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [term 0 FOLLOWER]: Advancing to term 1
WARNING: no policy specified for oryx/127.10.255.124@KRBTEST.COM; defaulting to no policy
I20260806 09:15:11.753331 18104 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER ec89e5a865984246932e8121ee719094 (127.10.255.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: NON_VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: true } } }
I20260806 09:15:11.756552 18048 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [term 1 FOLLOWER]: Refusing update from remote peer d08c975cad4141ee9b400d9aaf0a2271: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260806 09:15:11.759850 18103 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: NON_VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.255.124@KRBTEST.COM" created.
I20260806 09:15:11.761054 18104 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.10.255.125:34367
I20260806 09:15:11.767035 18006 master.cc:537] Master@127.10.255.125:34367 shutting down...
W20260806 09:15:11.775517 17525 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
I20260806 09:15:11.781045 18105 sys_catalog.cc:455] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "d08c975cad4141ee9b400d9aaf0a2271" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: NON_VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: true } } }
I20260806 09:15:11.781544 18105 sys_catalog.cc:458] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:11.787039 18006 raft_consensus.cc:2229] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:15:11.787724 18006 raft_consensus.cc:2258] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:15:11.788092 18006 tablet_replica.cc:330] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094: stopping tablet replica
W20260806 09:15:11.789742 17525 consensus_peers.cc:487] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 -> Peer ec89e5a865984246932e8121ee719094 (127.10.255.125:34367): Couldn't send request to peer ec89e5a865984246932e8121ee719094. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 09:15:11.798647 18006 master.cc:552] Master@127.10.255.125:34367 shutdown complete.
I20260806 09:15:11.798802 18006 master_runner.cc:305] Clearing existing system tablet
I20260806 09:15:11.799347 18006 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:11.799532 18006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:11.802636 18006 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.001s
I20260806 09:15:11.805603 18111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:11.806116 18006 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:11.806406 18006 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s
I20260806 09:15:11.806509 18006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/wal
uuid: "ec89e5a865984246932e8121ee719094"
format_stamp: "Formatted at 2026-08-06 09:15:11 on dist-test-slave-mvvj"
server_key: "27416878ac85b4c252966a3c39ca27c4"
server_key_iv: "6b9ececf839c32a5e6cabb3f95518aa3"
server_key_version: "encryptionkey@0"
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.255.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.124.keytab.
Entry for principal oryx/127.10.255.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.124.keytab.
I20260806 09:15:11.809667 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.124:42095
--webserver_interface=127.10.255.124
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.124.keytab
--principal=oryx/127.10.255.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:37659,127.10.255.125:34367,127.10.255.124:42095
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:15:11.813095 18006 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:15:11.821893 18006 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 09:15:11.822145 18006 log.cc:1196] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260806 09:15:11.822710 18006 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094: Deleting consensus metadata
I20260806 09:15:11.823040 18006 master_runner.cc:315] Copying system tablet from 127.10.255.126:37659
I20260806 09:15:11.830082 18006 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094: tablet copy: Beginning tablet copy session from remote peer at address 127.10.255.126:37659
I20260806 09:15:11.854116 18079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:11.831312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49338 (local address 127.10.255.126:37659)
0806 09:15:11.831720 (+ 408us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:11.831728 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:11.840718 (+ 8990us) server_negotiation.cc:407] Connection header received
0806 09:15:11.840989 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:11.840993 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:11.841067 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:11.841184 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:11.842347 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.843203 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.844736 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.845221 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.845373 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:11.847709 (+ 2336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:11.847718 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:11.847722 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:11.847761 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:11.850744 (+ 2983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:11.851537 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:11.851544 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:11.851548 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:11.851687 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:11.852222 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:11.852229 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:11.852232 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:11.852645 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:11.852809 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:11.853418 (+ 609us) server_negotiation.cc:299] Negotiation successful
0806 09:15:11.853727 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247}
I20260806 09:15:11.854168 18118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:11.831275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.0.0.1:49338)
0806 09:15:11.840554 (+ 9279us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:11.840582 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:11.840810 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:11.841226 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:11.841231 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:11.841889 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:11.842152 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:11.842163 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.843374 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.843379 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:11.844529 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:11.844543 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:11.845418 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:11.845425 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:11.845619 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:11.846428 (+ 809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:11.846458 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:11.847316 (+ 858us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:11.850933 (+ 3617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:11.850939 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:11.850944 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:11.851381 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:11.851823 (+ 442us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:11.851855 (+ 32us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:11.851867 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:11.852098 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:11.852875 (+ 777us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:11.852879 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:11.853048 (+ 169us) client_negotiation.cc:769] Sending connection context
0806 09:15:11.853292 (+ 244us) client_negotiation.cc:240] Negotiation successful
0806 09:15:11.853694 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9050,"thread_start_us":8875,"threads_started":1}
I20260806 09:15:11.855204 17559 tablet_copy_service.cc:140] P d08c975cad4141ee9b400d9aaf0a2271: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer ec89e5a865984246932e8121ee719094 ({username='oryx', principal='oryx/127.10.255.125@KRBTEST.COM'} at 127.0.0.1:49338)
I20260806 09:15:11.855654 17559 tablet_copy_service.cc:161] P d08c975cad4141ee9b400d9aaf0a2271: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer ec89e5a865984246932e8121ee719094 at {username='oryx', principal='oryx/127.10.255.125@KRBTEST.COM'} at 127.0.0.1:49338: session id = ec89e5a865984246932e8121ee719094-00000000000000000000000000000000
I20260806 09:15:11.860005 17559 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 09:15:11.862931 18006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 09:15:11.869837 18006 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094: tablet copy: Starting download of 0 data blocks...
I20260806 09:15:11.870329 18006 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094: tablet copy: Starting download of 1 WAL segments...
I20260806 09:15:11.874462 18006 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 09:15:11.878758 17559 tablet_copy_service.cc:342] P d08c975cad4141ee9b400d9aaf0a2271: Request end of tablet copy session ec89e5a865984246932e8121ee719094-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.10.255.125@KRBTEST.COM'} at 127.0.0.1:49338
I20260806 09:15:11.879067 17559 tablet_copy_service.cc:433] P d08c975cad4141ee9b400d9aaf0a2271: ending tablet copy session ec89e5a865984246932e8121ee719094-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer ec89e5a865984246932e8121ee719094
I20260806 09:15:11.892717 18006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:11.895934 18119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:11.901095 18120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:11.907173 18006 server_base.cc:1034] running on GCE node
W20260806 09:15:11.907675 18122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:11.908238 18006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:11.908962 18006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:11.910400 18006 hybrid_clock.cc:648] HybridClock initialized: now 1786007711910291 us; error 56 us; skew 500 ppm
I20260806 09:15:11.910732 18006 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:11 dist-test-slave-mvvj krb5kdc[17493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007711, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:11.913193 18006 init.cc:377] Logged in from keytab as oryx/127.10.255.125@KRBTEST.COM (short username oryx)
I20260806 09:15:11.914961 18006 webserver.cc:460] Webserver started at http://127.10.255.125:38465/ using document root <none> and password file <none>
I20260806 09:15:11.915347 18006 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:11.915457 18006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:11.918448 18006 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 09:15:11.920774 18129 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:11.921355 18006 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 09:15:11.921602 18006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/wal
uuid: "ec89e5a865984246932e8121ee719094"
format_stamp: "Formatted at 2026-08-06 09:15:11 on dist-test-slave-mvvj"
server_key: "27416878ac85b4c252966a3c39ca27c4"
server_key_iv: "6b9ececf839c32a5e6cabb3f95518aa3"
server_key_version: "encryptionkey@0"
I20260806 09:15:11.921797 18006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:11.930594 18006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:11.934485 18006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:11.964833 18006 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.125:34367
I20260806 09:15:11.965246 18180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.125:34367 every 8 connection(s)
I20260806 09:15:11.966421 18006 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-1/data/info.pb
I20260806 09:15:11.974488 18181 sys_catalog.cc:263] Verifying existing consensus state
I20260806 09:15:11.977515 18181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094: Bootstrap starting.
I20260806 09:15:12.020733 18181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 09:15:12.021391 18181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094: Bootstrap complete.
I20260806 09:15:12.022493 18181 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: NON_VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: true } }
I20260806 09:15:12.022766 18181 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: ec89e5a865984246932e8121ee719094, State: Initialized, Role: LEARNER
I20260806 09:15:12.023062 18181 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: NON_VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: true } }
I20260806 09:15:12.024076 18184 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: NON_VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: true } } }
I20260806 09:15:12.024461 18181 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:15:12.024506 18184 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [sys.catalog]: This master's current role is: LEARNER
I20260806 09:15:12.036350 18000 heartbeater.cc:503] Master 127.10.255.126:37659 was elected leader, sending a full tablet report...
I20260806 09:15:12.043812 18195 catalog_manager.cc:1259] Loaded cluster ID: f63b1981128744e8a739fd60116c2f6c
I20260806 09:15:12.043979 18195 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094: loading cluster ID for follower catalog manager: success
I20260806 09:15:12.048267 18195 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094: acquiring CA information for follower catalog manager: success
I20260806 09:15:12.051570 18195 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 09:15:12.240370 18100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:12.224334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:34367 (local address 127.0.0.1:44312)
0806 09:15:12.224936 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:12.224962 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:12.225112 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:12.229007 (+ 3895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:12.229016 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:12.229060 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:12.229309 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:12.229325 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.233044 (+ 3719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.233053 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:12.236504 (+ 3451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:12.236534 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.239183 (+ 2649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.239191 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:12.239478 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:12.239562 (+ 84us) client_negotiation.cc:769] Sending connection context
0806 09:15:12.239716 (+ 154us) client_negotiation.cc:240] Negotiation successful
0806 09:15:12.239916 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442}
I20260806 09:15:12.240615 18196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:12.224536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44312 (local address 127.10.255.125:34367)
0806 09:15:12.228462 (+ 3926us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:12.228470 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:12.228497 (+ 27us) server_negotiation.cc:407] Connection header received
0806 09:15:12.228597 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:12.228603 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:12.228723 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:12.228900 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:12.229572 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.232698 (+ 3126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.236788 (+ 4090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.238836 (+ 2048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.239287 (+ 451us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:12.239602 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:12.239786 (+ 184us) server_negotiation.cc:299] Negotiation successful
0806 09:15:12.240021 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3746,"thread_start_us":3526,"threads_started":1}
I20260806 09:15:12.242305 18156 raft_consensus.cc:1203] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260806 09:15:12.243024 18184 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d08c975cad4141ee9b400d9aaf0a2271. Latest consensus state: current_term: 1 leader_uuid: "d08c975cad4141ee9b400d9aaf0a2271" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: NON_VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: true } } }
I20260806 09:15:12.243378 18184 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [sys.catalog]: This master's current role is: LEARNER
W20260806 09:15:12.321983 18112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:12.322422 18112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:12.322604 18112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:12.330854 18112 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:15:12.331048 18112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:12.331169 18112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:12.331269 18112 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:15:12.331393 18112 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:15:12.343654 18112 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:37659,127.10.255.125:34367,127.10.255.124:42095
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.124.keytab
--principal=oryx/127.10.255.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.124:42095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.255.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:12.345302 18112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:12.346861 18112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:12.360596 18201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:12.360564 18204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:12.360528 18202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:12.364653 18112 server_base.cc:1034] running on GCE node
I20260806 09:15:12.366003 18112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:12.367962 18112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:12.369264 18112 hybrid_clock.cc:648] HybridClock initialized: now 1786007712369202 us; error 55 us; skew 500 ppm
I20260806 09:15:12.369728 18112 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:12 dist-test-slave-mvvj krb5kdc[17493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007712, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:12.373847 18112 init.cc:377] Logged in from keytab as oryx/127.10.255.124@KRBTEST.COM (short username oryx)
I20260806 09:15:12.376005 18112 webserver.cc:460] Webserver started at http://127.10.255.124:45579/ using document root <none> and password file <none>
I20260806 09:15:12.376950 18112 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:12.377136 18112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:12.377481 18112 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:12.381036 18112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/data/instance:
uuid: "0e79a3072efc49659fe63e43e9ec9439"
format_stamp: "Formatted at 2026-08-06 09:15:12 on dist-test-slave-mvvj"
server_key: "3f11b02e239bbc0de76bc496b9eb2e09"
server_key_iv: "c53915dda3ab1fd4535636470bfc5e57"
server_key_version: "encryptionkey@0"
I20260806 09:15:12.382022 18112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/wal/instance:
uuid: "0e79a3072efc49659fe63e43e9ec9439"
format_stamp: "Formatted at 2026-08-06 09:15:12 on dist-test-slave-mvvj"
server_key: "3f11b02e239bbc0de76bc496b9eb2e09"
server_key_iv: "c53915dda3ab1fd4535636470bfc5e57"
server_key_version: "encryptionkey@0"
I20260806 09:15:12.389936 18112 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260806 09:15:12.394488 18211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:12.396240 18112 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 09:15:12.396538 18112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/wal
uuid: "0e79a3072efc49659fe63e43e9ec9439"
format_stamp: "Formatted at 2026-08-06 09:15:12 on dist-test-slave-mvvj"
server_key: "3f11b02e239bbc0de76bc496b9eb2e09"
server_key_iv: "c53915dda3ab1fd4535636470bfc5e57"
server_key_version: "encryptionkey@0"
I20260806 09:15:12.396831 18112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:12.433130 18112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:12.438293 18112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:12.438687 18112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:12.463135 18112 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.124:42095
I20260806 09:15:12.463199 18263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.124:42095 every 8 connection(s)
I20260806 09:15:12.464776 18112 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/data/info.pb
I20260806 09:15:12.469380 18264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:12.469918 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 18112
I20260806 09:15:12.480206 18264 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 09:15:12 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.255.124@KRBTEST.COM
Aug 06 09:15:12 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007712, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.124@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM
I20260806 09:15:12.500566 18267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:12.472342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54260 (local address 127.10.255.124:42095)
0806 09:15:12.474094 (+ 1752us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:12.474107 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:12.474153 (+ 46us) server_negotiation.cc:407] Connection header received
0806 09:15:12.476497 (+ 2344us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:12.476527 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:12.477032 (+ 505us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:12.477441 (+ 409us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:12.479483 (+ 2042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.481229 (+ 1746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.482750 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.483815 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.485167 (+ 1352us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:12.490477 (+ 5310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:12.490491 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:12.490508 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:12.490573 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:12.494393 (+ 3820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:12.495402 (+ 1009us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:12.495410 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:12.495423 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:12.495630 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:12.496376 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:12.496381 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:12.496384 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:12.497460 (+ 1076us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:12.497847 (+ 387us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:12.498476 (+ 629us) server_negotiation.cc:299] Negotiation successful
0806 09:15:12.499180 (+ 704us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1519,"spinlock_wait_cycles":36224,"thread_start_us":1306,"threads_started":1}
I20260806 09:15:12.505412 18269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:12.483911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49352 (local address 127.10.255.126:37659)
0806 09:15:12.485548 (+ 1637us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:12.485553 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:12.485570 (+ 17us) server_negotiation.cc:407] Connection header received
0806 09:15:12.485625 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:12.485628 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:12.485691 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:12.485785 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:12.487761 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.488844 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.490762 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.491257 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.491616 (+ 359us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:12.496760 (+ 5144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:12.496766 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:12.496770 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:12.496808 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:12.500251 (+ 3443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:12.502565 (+ 2314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:12.502571 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:12.502573 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:12.502743 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:12.503437 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:12.503442 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:12.503445 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:12.504146 (+ 701us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:12.504336 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:12.504910 (+ 574us) server_negotiation.cc:299] Negotiation successful
0806 09:15:12.505127 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1523,"thread_start_us":1418,"threads_started":1}
I20260806 09:15:12.505457 18268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:12.483611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.0.0.1:49352)
0806 09:15:12.484664 (+ 1053us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:12.484734 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:12.484897 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:12.485911 (+ 1014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:12.485921 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:12.486936 (+ 1015us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:12.487450 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:12.487487 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.489090 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.489095 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:12.490554 (+ 1459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:12.490575 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.491771 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.491784 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:12.492116 (+ 332us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:12.492944 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:12.492965 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:12.496469 (+ 3504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:12.500414 (+ 3945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:12.500425 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:12.500432 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:12.502343 (+ 1911us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:12.503024 (+ 681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:12.503030 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:12.503034 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:12.503271 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:12.504335 (+ 1064us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:12.504342 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:12.504544 (+ 202us) client_negotiation.cc:769] Sending connection context
0806 09:15:12.504783 (+ 239us) client_negotiation.cc:240] Negotiation successful
0806 09:15:12.505133 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":723,"thread_start_us":528,"threads_started":1}
I20260806 09:15:12.507107 18264 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 09:15:12 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007712, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.124@KRBTEST.COM for oryx/127.10.255.125@KRBTEST.COM
I20260806 09:15:12.524688 18196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:12.508292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44314 (local address 127.10.255.125:34367)
0806 09:15:12.508557 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:12.508565 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:12.508586 (+ 21us) server_negotiation.cc:407] Connection header received
0806 09:15:12.508762 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:12.508766 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:12.508833 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:12.508938 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:12.509899 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.511016 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.512496 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.512948 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.513169 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:12.517956 (+ 4787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:12.517962 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:12.517967 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:12.518021 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:12.521324 (+ 3303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:12.522328 (+ 1004us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:12.522333 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:12.522335 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:12.522495 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:12.522947 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:12.522951 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:12.522953 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:12.523369 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:12.523539 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:12.523958 (+ 419us) server_negotiation.cc:299] Negotiation successful
0806 09:15:12.524247 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 09:15:12.524672 18268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:12.508187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:34367 (local address 127.0.0.1:44314)
0806 09:15:12.508453 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:12.508475 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:12.508596 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:12.508964 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:12.508969 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:12.509443 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:12.509596 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:12.509700 (+ 104us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.511204 (+ 1504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.511212 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:12.512327 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:12.512343 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.513244 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.513258 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:12.513480 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:12.514409 (+ 929us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:12.514432 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:12.517645 (+ 3213us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:12.521555 (+ 3910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:12.521562 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:12.521566 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:12.522161 (+ 595us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:12.522636 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:12.522642 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:12.522646 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:12.522808 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:12.523495 (+ 687us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:12.523508 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:12.523674 (+ 166us) client_negotiation.cc:769] Sending connection context
0806 09:15:12.523820 (+ 146us) client_negotiation.cc:240] Negotiation successful
0806 09:15:12.524217 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81}
I20260806 09:15:12.526209 18264 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42095 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 09:15:12 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007712, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.124@KRBTEST.COM for oryx/127.10.255.124@KRBTEST.COM
I20260806 09:15:12.542553 18267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:12.527313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54274 (local address 127.10.255.124:42095)
0806 09:15:12.527501 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:12.527508 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:12.527527 (+ 19us) server_negotiation.cc:407] Connection header received
0806 09:15:12.527562 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:12.527565 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:12.527616 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:12.527717 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:12.528501 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.529260 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.530459 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.530905 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.531077 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:12.535016 (+ 3939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:12.535022 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:12.535026 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:12.535063 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:12.539395 (+ 4332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:12.540289 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:12.540302 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:12.540305 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:12.540443 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:12.540900 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:12.540904 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:12.540906 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:12.541260 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:12.541428 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:12.541839 (+ 411us) server_negotiation.cc:299] Negotiation successful
0806 09:15:12.542214 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":139,"server-negotiator.queue_time_us":59}
I20260806 09:15:12.542603 18268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:12.527050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42095 (local address 127.0.0.1:54274)
0806 09:15:12.527249 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:12.527274 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:12.527394 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:12.527737 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:12.527741 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:12.528217 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:12.528365 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:12.528374 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.529394 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.529401 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:12.530308 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:12.530321 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.531125 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.531131 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:12.531356 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:12.532151 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:12.532172 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:12.534741 (+ 2569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:12.539625 (+ 4884us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:12.539630 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:12.539633 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:12.540142 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:12.540600 (+ 458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:12.540603 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:12.540605 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:12.540765 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:12.541394 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:12.541398 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:12.541568 (+ 170us) client_negotiation.cc:769] Sending connection context
0806 09:15:12.541734 (+ 166us) client_negotiation.cc:240] Negotiation successful
0806 09:15:12.542062 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64}
I20260806 09:15:12.548478 18264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439: Bootstrap starting.
I20260806 09:15:12.552330 18264 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:12.553850 18264 log.cc:824] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439: Log is configured to *not* fsync() on all Append() calls
I20260806 09:15:12.557265 18264 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439: No bootstrap required, opened a new log
I20260806 09:15:12.565528 18264 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42095 } }
I20260806 09:15:12.565979 18264 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:12.566128 18264 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e79a3072efc49659fe63e43e9ec9439, State: Initialized, Role: FOLLOWER
I20260806 09:15:12.566821 18264 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42095 } }
I20260806 09:15:12.567997 18272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42095 } } }
I20260806 09:15:12.568403 18272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:15:12.569103 18264 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 09:15:12.580772 18283 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 09:15:12.580993 18283 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 09:15:12.586556 18112 master_runner.cc:428] Detected that this master 0e79a3072efc49659fe63e43e9ec9439 is joining an existing cluster
I20260806 09:15:12.586721 18112 master_runner.cc:432] Initiating AddMaster RPC to add 127.10.255.124:42095
I20260806 09:15:12.609664 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 17600
I20260806 09:15:12.624056 18269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:12.592053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49354 (local address 127.10.255.126:37659)
0806 09:15:12.592268 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:12.592277 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:12.593340 (+ 1063us) server_negotiation.cc:407] Connection header received
0806 09:15:12.593649 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:12.593655 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:12.593751 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:12.593832 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:12.595551 (+ 1719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.596797 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.599314 (+ 2517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.600117 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.600240 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:12.604376 (+ 4136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:12.604387 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:12.604392 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:12.604552 (+ 160us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:12.613288 (+ 8736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:12.618716 (+ 5428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:12.618723 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:12.618727 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:12.618989 (+ 262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:12.621463 (+ 2474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:12.621470 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:12.621475 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:12.622086 (+ 611us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:12.622250 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:12.623180 (+ 930us) server_negotiation.cc:299] Negotiation successful
0806 09:15:12.623576 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 09:15:12.625854 18289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:12.592248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.0.0.1:49354)
0806 09:15:12.593202 (+ 954us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:12.593232 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:12.593474 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:12.594092 (+ 618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:12.594097 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:12.594902 (+ 805us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:12.595338 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:12.595353 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.597080 (+ 1727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.597086 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:12.599080 (+ 1994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:12.599102 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.600649 (+ 1547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.600662 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:12.600907 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:12.601867 (+ 960us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:12.601894 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:12.604047 (+ 2153us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:12.617108 (+ 13061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:12.617120 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:12.617125 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:12.617711 (+ 586us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:12.619245 (+ 1534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:12.619250 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:12.619255 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:12.619492 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:12.622406 (+ 2914us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:12.622412 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:12.622749 (+ 337us) client_negotiation.cc:769] Sending connection context
0806 09:15:12.624453 (+ 1704us) client_negotiation.cc:240] Negotiation successful
0806 09:15:12.624985 (+ 532us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":780,"spinlock_wait_cycles":7040,"thread_start_us":571,"threads_started":1}
I20260806 09:15:12.628786 18267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:12.593571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54284 (local address 127.10.255.124:42095)
0806 09:15:12.593749 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:12.593755 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:12.603147 (+ 9392us) server_negotiation.cc:407] Connection header received
0806 09:15:12.603497 (+ 350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:12.603503 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:12.603586 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:12.603660 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:12.605843 (+ 2183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.607406 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.613542 (+ 6136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.614377 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.614538 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:12.617328 (+ 2790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:12.617335 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:12.617339 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:12.617391 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:12.621811 (+ 4420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:12.624101 (+ 2290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:12.624108 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:12.624111 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:12.624540 (+ 429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:12.627096 (+ 2556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:12.627102 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:12.627106 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:12.627493 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:12.627634 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:12.628132 (+ 498us) server_negotiation.cc:299] Negotiation successful
0806 09:15:12.628391 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 09:15:12.628793 18196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:12.592148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44320 (local address 127.10.255.125:34367)
0806 09:15:12.592382 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:12.592388 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:12.600513 (+ 8125us) server_negotiation.cc:407] Connection header received
0806 09:15:12.601274 (+ 761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:12.601285 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:12.601416 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:12.601507 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:12.604598 (+ 3091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.605914 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.610445 (+ 4531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.611213 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.611335 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:12.616012 (+ 4677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:12.616023 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:12.616031 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:12.616092 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:12.621051 (+ 4959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:12.623246 (+ 2195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:12.623252 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:12.623256 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:12.623498 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:12.625353 (+ 1855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:12.625360 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:12.625364 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:12.625912 (+ 548us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:12.626374 (+ 462us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:12.628123 (+ 1749us) server_negotiation.cc:299] Negotiation successful
0806 09:15:12.628405 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 09:15:12.630757 18290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:12.592880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:34367 (local address 127.0.0.1:44320)
0806 09:15:12.600311 (+ 7431us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:12.600366 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:12.601023 (+ 657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:12.601966 (+ 943us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:12.601975 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:12.603691 (+ 1716us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:12.604318 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:12.604335 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.606173 (+ 1838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.606178 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:12.610185 (+ 4007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:12.610208 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.612026 (+ 1818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.612035 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:12.612254 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:12.613123 (+ 869us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:12.613149 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:12.615700 (+ 2551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:12.621256 (+ 5556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:12.621263 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:12.621268 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:12.622729 (+ 1461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:12.623666 (+ 937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:12.623671 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:12.623675 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:12.623916 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:12.626467 (+ 2551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:12.626470 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:12.626856 (+ 386us) client_negotiation.cc:769] Sending connection context
0806 09:15:12.629201 (+ 2345us) client_negotiation.cc:240] Negotiation successful
0806 09:15:12.629692 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7107,"spinlock_wait_cycles":2304,"thread_start_us":7622,"threads_started":1}
I20260806 09:15:12.632110 18291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:12.593734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42095 (local address 127.0.0.1:54284)
0806 09:15:12.603007 (+ 9273us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:12.603031 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:12.603308 (+ 277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:12.603945 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:12.603960 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:12.605195 (+ 1235us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:12.605640 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:12.605660 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.608453 (+ 2793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.608460 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:12.613359 (+ 4899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:12.613380 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.614609 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.614620 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:12.614799 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:12.615589 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:12.615673 (+ 84us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:12.617085 (+ 1412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:12.621967 (+ 4882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:12.621971 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:12.621976 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:12.623095 (+ 1119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:12.624736 (+ 1641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:12.624740 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:12.624744 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:12.625010 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:12.627688 (+ 2678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:12.627690 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:12.627808 (+ 118us) client_negotiation.cc:769] Sending connection context
0806 09:15:12.629385 (+ 1577us) client_negotiation.cc:240] Negotiation successful
0806 09:15:12.631515 (+ 2130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8985,"mutex_wait_us":1784,"spinlock_wait_cycles":62336,"thread_start_us":8796,"threads_started":1}
Aug 06 09:15:12 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.255.65@KRBTEST.COM
Aug 06 09:15:12 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007708, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.126@KRBTEST.COM for oryx/127.10.255.124@KRBTEST.COM
I20260806 09:15:12.655354 18292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:12.611161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51548 (local address 127.10.255.65:41895)
0806 09:15:12.626078 (+ 14917us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:12.626089 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:12.626128 (+ 39us) server_negotiation.cc:407] Connection header received
0806 09:15:12.626209 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:12.626219 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:12.626901 (+ 682us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:12.629685 (+ 2784us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:12.629975 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.634613 (+ 4638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.636933 (+ 2320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.638015 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.638180 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:12.645828 (+ 7648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:12.645857 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:12.645886 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:12.645996 (+ 110us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:12.650713 (+ 4717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:12.651962 (+ 1249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:12.651973 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:12.652071 (+ 98us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:12.652357 (+ 286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:12.653029 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:12.653042 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:12.653044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:12.653553 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:12.653993 (+ 440us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:12.654416 (+ 423us) server_negotiation.cc:299] Negotiation successful
0806 09:15:12.654806 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14185,"thread_start_us":14488,"threads_started":1}
I20260806 09:15:12.657352 17724 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:12.659253 18100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:12.636544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42095 (local address 127.0.0.1:54292)
0806 09:15:12.636899 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:12.636921 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:12.637069 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:12.637797 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:12.637826 (+ 29us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:12.638717 (+ 891us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:12.638967 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:12.638983 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.640888 (+ 1905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.640894 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:12.642460 (+ 1566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:12.642483 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.644196 (+ 1713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.644203 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:12.644406 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:12.645085 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:12.645105 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:12.648986 (+ 3881us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:12.654521 (+ 5535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:12.654530 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:12.654535 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:12.655243 (+ 708us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:12.655918 (+ 675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:12.655924 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:12.655932 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:12.656172 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:12.657208 (+ 1036us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:12.657215 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:12.657565 (+ 350us) client_negotiation.cc:769] Sending connection context
0806 09:15:12.658071 (+ 506us) client_negotiation.cc:240] Negotiation successful
0806 09:15:12.658604 (+ 533us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215}
I20260806 09:15:12.660739 18267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:12.636672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54292 (local address 127.10.255.124:42095)
0806 09:15:12.636856 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:12.636860 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:12.637025 (+ 165us) server_negotiation.cc:407] Connection header received
0806 09:15:12.637242 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:12.637248 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:12.637409 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:12.637530 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:12.639177 (+ 1647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.640647 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.642764 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.643702 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.643920 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:12.649307 (+ 5387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:12.649315 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:12.649321 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:12.649369 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:12.654248 (+ 4879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:12.655441 (+ 1193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:12.655448 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:12.655453 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:12.655685 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:12.656340 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:12.656347 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:12.656351 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:12.657028 (+ 677us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:12.657209 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:12.659869 (+ 2660us) server_negotiation.cc:299] Negotiation successful
0806 09:15:12.660236 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 09:15:12.663627 17537 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.10.255.124:42095: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439"
member_type: NON_VOTER
last_known_addr {
host: "127.10.255.124"
port: 42095
}
attrs {
promote: true
}
}
dest_uuid: "d08c975cad4141ee9b400d9aaf0a2271"
cas_config_opid_index: 5
I20260806 09:15:12.664633 17537 consensus_queue.cc:237] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: NON_VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: true } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: NON_VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: true } }
I20260806 09:15:12.666862 18105 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 0e79a3072efc49659fe63e43e9ec9439 (127.10.255.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: NON_VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: true } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: NON_VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: true } } }
I20260806 09:15:12.670538 18156 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [term 1 LEARNER]: Refusing update from remote peer d08c975cad4141ee9b400d9aaf0a2271: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 09:15:12.672264 18238 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:12.676605 18295 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: NON_VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260806 09:15:12.679759 18238 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [term 1 FOLLOWER]: Refusing update from remote peer d08c975cad4141ee9b400d9aaf0a2271: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 09:15:12.678324 18105 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.10.255.124:42095
I20260806 09:15:12.681725 18112 master.cc:537] Master@127.10.255.124:42095 shutting down...
I20260806 09:15:12.682713 18105 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: NON_VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:15:12.685561 18294 sys_catalog.cc:455] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "d08c975cad4141ee9b400d9aaf0a2271" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: NON_VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: true } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: NON_VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: true } } }
I20260806 09:15:12.687951 18294 sys_catalog.cc:458] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:12.700570 18156 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 0e79a3072efc49659fe63e43e9ec9439 (127.10.255.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: NON_VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: true } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: NON_VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: true } } }
W20260806 09:15:12.702659 17522 consensus_peers.cc:487] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 -> Peer 0e79a3072efc49659fe63e43e9ec9439 (127.10.255.124:42095): Couldn't send request to peer 0e79a3072efc49659fe63e43e9ec9439. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 09:15:12.705395 18184 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d08c975cad4141ee9b400d9aaf0a2271" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: NON_VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: true } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: NON_VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: true } } }
I20260806 09:15:12.705776 18184 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [sys.catalog]: This master's current role is: LEARNER
I20260806 09:15:12.706634 18294 raft_consensus.cc:1050] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271: attempting to promote NON_VOTER ec89e5a865984246932e8121ee719094 to VOTER
I20260806 09:15:12.707515 18294 consensus_queue.cc:237] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: NON_VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: true } }
I20260806 09:15:12.709725 18156 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [term 1 LEARNER]: Refusing update from remote peer d08c975cad4141ee9b400d9aaf0a2271: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260806 09:15:12.710443 18105 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260806 09:15:12.712481 17522 consensus_peers.cc:487] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 -> Peer 0e79a3072efc49659fe63e43e9ec9439 (127.10.255.124:42095): Couldn't send request to peer 0e79a3072efc49659fe63e43e9ec9439. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 09:15:12.715013 18295 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, ec89e5a865984246932e8121ee719094 (127.10.255.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: NON_VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: true } } }
I20260806 09:15:12.716130 18156 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, ec89e5a865984246932e8121ee719094 (127.10.255.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: NON_VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: true } } }
W20260806 09:15:12.718937 18217 tablet.cc:2369] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:15:12.721236 18184 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d08c975cad4141ee9b400d9aaf0a2271" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: NON_VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: true } } }
I20260806 09:15:12.721585 18184 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:15:12.727329 18112 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:15:12.727856 18112 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:15:12.728107 18112 tablet_replica.cc:330] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439: stopping tablet replica
I20260806 09:15:12.734500 18105 sys_catalog.cc:455] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "d08c975cad4141ee9b400d9aaf0a2271" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: NON_VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: true } } }
I20260806 09:15:12.734850 18105 sys_catalog.cc:458] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:12.735168 18105 sys_catalog.cc:455] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d08c975cad4141ee9b400d9aaf0a2271" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: NON_VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: true } } }
I20260806 09:15:12.735405 18105 sys_catalog.cc:458] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:12.736613 18112 master.cc:552] Master@127.10.255.124:42095 shutdown complete.
I20260806 09:15:12.736707 18112 master_runner.cc:305] Clearing existing system tablet
I20260806 09:15:12.737185 18112 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:12.737370 18112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:12.740697 18112 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260806 09:15:12.742740 18301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:12.743212 18112 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:12.743481 18112 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260806 09:15:12.743587 18112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/wal
uuid: "0e79a3072efc49659fe63e43e9ec9439"
format_stamp: "Formatted at 2026-08-06 09:15:12 on dist-test-slave-mvvj"
server_key: "3f11b02e239bbc0de76bc496b9eb2e09"
server_key_iv: "c53915dda3ab1fd4535636470bfc5e57"
server_key_version: "encryptionkey@0"
I20260806 09:15:12.749344 18112 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:15:12.758073 18112 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 09:15:12.758311 18112 log.cc:1196] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260806 09:15:12.759303 18112 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439: Deleting consensus metadata
I20260806 09:15:12.759666 18112 master_runner.cc:315] Copying system tablet from 127.10.255.126:37659
I20260806 09:15:12.764642 18112 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439: tablet copy: Beginning tablet copy session from remote peer at address 127.10.255.126:37659
I20260806 09:15:12.789848 18307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:12.765736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.0.0.1:49366)
0806 09:15:12.768502 (+ 2766us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:12.768540 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:12.768754 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:12.769624 (+ 870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:12.769630 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:12.770409 (+ 779us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:12.770876 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:12.770899 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.772844 (+ 1945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.772852 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:12.774858 (+ 2006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:12.774882 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.776250 (+ 1368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.776258 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:12.776541 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:12.777449 (+ 908us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:12.777492 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:12.778882 (+ 1390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:12.783744 (+ 4862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:12.783752 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:12.783757 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:12.785880 (+ 2123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:12.786507 (+ 627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:12.786514 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:12.786518 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:12.786776 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:12.787677 (+ 901us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:12.787684 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:12.788394 (+ 710us) client_negotiation.cc:769] Sending connection context
0806 09:15:12.788696 (+ 302us) client_negotiation.cc:240] Negotiation successful
0806 09:15:12.789126 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2512,"thread_start_us":2343,"threads_started":1}
I20260806 09:15:12.790684 18269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:12.765737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49366 (local address 127.10.255.126:37659)
0806 09:15:12.766051 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:12.766058 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:12.768732 (+ 2674us) server_negotiation.cc:407] Connection header received
0806 09:15:12.769130 (+ 398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:12.769142 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:12.769310 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:12.769435 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:12.771187 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.772636 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.775124 (+ 2488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:12.776032 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:12.776212 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:12.779215 (+ 3003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:12.779223 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:12.779228 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:12.779279 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:12.783529 (+ 4250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:12.786113 (+ 2584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:12.786122 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:12.786126 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:12.786345 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:12.786934 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:12.786940 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:12.786943 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:12.787412 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:12.787556 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:12.788856 (+ 1300us) server_negotiation.cc:299] Negotiation successful
0806 09:15:12.789502 (+ 646us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140}
I20260806 09:15:12.791917 17559 tablet_copy_service.cc:140] P d08c975cad4141ee9b400d9aaf0a2271: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 0e79a3072efc49659fe63e43e9ec9439 ({username='oryx', principal='oryx/127.10.255.124@KRBTEST.COM'} at 127.0.0.1:49366)
I20260806 09:15:12.792111 17559 tablet_copy_service.cc:161] P d08c975cad4141ee9b400d9aaf0a2271: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 0e79a3072efc49659fe63e43e9ec9439 at {username='oryx', principal='oryx/127.10.255.124@KRBTEST.COM'} at 127.0.0.1:49366: session id = 0e79a3072efc49659fe63e43e9ec9439-00000000000000000000000000000000
I20260806 09:15:12.796582 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 17600
I20260806 09:15:12.796602 17559 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 09:15:12.801883 18112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 09:15:12.812194 18112 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439: tablet copy: Starting download of 0 data blocks...
I20260806 09:15:12.812579 18112 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439: tablet copy: Starting download of 1 WAL segments...
I20260806 09:15:12.815718 18112 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 09:15:12.822219 17559 tablet_copy_service.cc:342] P d08c975cad4141ee9b400d9aaf0a2271: Request end of tablet copy session 0e79a3072efc49659fe63e43e9ec9439-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.10.255.124@KRBTEST.COM'} at 127.0.0.1:49366
I20260806 09:15:12.822431 17559 tablet_copy_service.cc:433] P d08c975cad4141ee9b400d9aaf0a2271: ending tablet copy session 0e79a3072efc49659fe63e43e9ec9439-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 0e79a3072efc49659fe63e43e9ec9439
W20260806 09:15:12.822520 17523 connection.cc:535] server connection from 127.10.255.65:49497 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 09:15:12.823755 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:41895
--local_ip_for_outbound_sockets=127.10.255.65
--tserver_master_addrs=127.10.255.126:37659
--webserver_port=36529
--webserver_interface=127.10.255.65
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.65.keytab
--principal=oryx/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.255.126:37659,127.10.255.125:34367
--tserver_master_addrs=127.10.255.126:37659,127.10.255.125:34367,127.10.255.124:42095 with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:15:12.836932 18112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:12.841638 18309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:12.847661 18310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:12.853147 18112 server_base.cc:1034] running on GCE node
W20260806 09:15:12.854132 18312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:12.854668 18112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:12.855433 18112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:12.856657 18112 hybrid_clock.cc:648] HybridClock initialized: now 1786007712856608 us; error 41 us; skew 500 ppm
I20260806 09:15:12.856966 18112 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:12 dist-test-slave-mvvj krb5kdc[17493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007712, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:12.860188 18112 init.cc:377] Logged in from keytab as oryx/127.10.255.124@KRBTEST.COM (short username oryx)
I20260806 09:15:12.865064 18112 webserver.cc:460] Webserver started at http://127.10.255.124:43743/ using document root <none> and password file <none>
I20260806 09:15:12.865597 18112 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:12.865738 18112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:12.869549 18112 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260806 09:15:12.872478 18319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:12.872989 18112 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260806 09:15:12.873135 18112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/wal
uuid: "0e79a3072efc49659fe63e43e9ec9439"
format_stamp: "Formatted at 2026-08-06 09:15:12 on dist-test-slave-mvvj"
server_key: "3f11b02e239bbc0de76bc496b9eb2e09"
server_key_iv: "c53915dda3ab1fd4535636470bfc5e57"
server_key_version: "encryptionkey@0"
I20260806 09:15:12.873347 18112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:12.919045 18112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:12.924242 18112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:12.956621 18112 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.124:42095
I20260806 09:15:12.956689 18371 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.124:42095 every 8 connection(s)
I20260806 09:15:12.957799 18112 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/master-2/data/info.pb
I20260806 09:15:12.976096 18372 sys_catalog.cc:263] Verifying existing consensus state
I20260806 09:15:12.980567 18372 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439: Bootstrap starting.
I20260806 09:15:13.018831 18372 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 09:15:13.019502 18372 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439: Bootstrap complete.
I20260806 09:15:13.020972 18372 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: NON_VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: true } }
I20260806 09:15:13.021319 18372 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 0e79a3072efc49659fe63e43e9ec9439, State: Initialized, Role: LEARNER
I20260806 09:15:13.021608 18372 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: NON_VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: true } }
I20260806 09:15:13.022982 18372 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:15:13.022645 18375 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: NON_VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: true } } }
I20260806 09:15:13.023494 18375 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [sys.catalog]: This master's current role is: LEARNER
I20260806 09:15:13.037358 18386 catalog_manager.cc:1259] Loaded cluster ID: f63b1981128744e8a739fd60116c2f6c
I20260806 09:15:13.037746 18386 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439: loading cluster ID for follower catalog manager: success
I20260806 09:15:13.042496 18386 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439: acquiring CA information for follower catalog manager: success
I20260806 09:15:13.045890 18386 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 09:15:13.242010 18387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:13.233145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42095 (local address 127.0.0.1:54306)
0806 09:15:13.233884 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:13.233908 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:13.234097 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:13.235044 (+ 947us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:13.235048 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:13.235074 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:13.235278 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:13.235286 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:13.237430 (+ 2144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:13.237437 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:13.238777 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:13.238795 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:13.240941 (+ 2146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:13.240962 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:13.241194 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:13.241231 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 09:15:13.241337 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 09:15:13.241578 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":392,"threads_started":1}
I20260806 09:15:13.242111 18388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:13.233266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54306 (local address 127.10.255.124:42095)
0806 09:15:13.234509 (+ 1243us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:13.234516 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:13.234558 (+ 42us) server_negotiation.cc:407] Connection header received
0806 09:15:13.234692 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:13.234705 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:13.234828 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:13.235039 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:13.235510 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:13.237229 (+ 1719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:13.238984 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:13.240714 (+ 1730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:13.241061 (+ 347us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:13.241293 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:13.241358 (+ 65us) server_negotiation.cc:299] Negotiation successful
0806 09:15:13.241539 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1037,"thread_start_us":819,"threads_started":1}
I20260806 09:15:13.243414 18347 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260806 09:15:13.244251 18375 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d08c975cad4141ee9b400d9aaf0a2271. Latest consensus state: current_term: 1 leader_uuid: "d08c975cad4141ee9b400d9aaf0a2271" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: NON_VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: true } } }
I20260806 09:15:13.244637 18375 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [sys.catalog]: This master's current role is: LEARNER
W20260806 09:15:13.309564 18308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:13.309971 18308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:13.310156 18308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:13.318377 18308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:13.318583 18308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:13.318987 18308 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:15:13.330785 18308 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.65.keytab
--principal=oryx/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:41895
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=36529
--tserver_master_addrs=127.10.255.126:37659,127.10.255.125:34367,127.10.255.124:42095
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:13.332314 18308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:13.333796 18308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:13.349836 18396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:13.349788 18394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:13.349748 18393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:13.350829 18308 server_base.cc:1034] running on GCE node
I20260806 09:15:13.351490 18308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:13.352722 18308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:13.353978 18308 hybrid_clock.cc:648] HybridClock initialized: now 1786007713353913 us; error 53 us; skew 500 ppm
I20260806 09:15:13.354300 18308 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:13 dist-test-slave-mvvj krb5kdc[17493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007713, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:13.357966 18308 init.cc:377] Logged in from keytab as oryx/127.10.255.65@KRBTEST.COM (short username oryx)
I20260806 09:15:13.359969 18308 webserver.cc:460] Webserver started at http://127.10.255.65:36529/ using document root <none> and password file <none>
I20260806 09:15:13.360750 18308 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:13.360972 18308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:13.368219 18308 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 09:15:13.372156 18403 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:13.374089 18308 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:15:13.374333 18308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "f81d092a894e4c32af04f0737606f460"
format_stamp: "Formatted at 2026-08-06 09:15:09 on dist-test-slave-mvvj"
server_key: "96e159403926cecec1c4b108f6e3455e"
server_key_iv: "664bb6256aa5d822f2d57376c5377eba"
server_key_version: "encryptionkey@0"
I20260806 09:15:13.375700 18308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:13.395277 18308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:13.400484 18308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:13.400841 18308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:13.402071 18308 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:15:13.403785 18308 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:13.403924 18308 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260806 09:15:13.404120 18308 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:13.404211 18308 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:13.456022 18516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:41895 every 8 connection(s)
I20260806 09:15:13.456015 18308 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:41895
I20260806 09:15:13.459271 18308 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:15:13.461189 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 18308
I20260806 09:15:13.462002 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 17735
Aug 06 09:15:13 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007713, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.125@KRBTEST.COM
Aug 06 09:15:13 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.255.66@KRBTEST.COM
Aug 06 09:15:13 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007713, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.124@KRBTEST.COM
Aug 06 09:15:13 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007713, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM
I20260806 09:15:13.531400 18525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:13.464859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40008 (local address 127.10.255.66:43671)
0806 09:15:13.479132 (+ 14273us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:13.479147 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:13.497988 (+ 18841us) server_negotiation.cc:407] Connection header received
0806 09:15:13.499728 (+ 1740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:13.499739 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:13.500125 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:13.500395 (+ 270us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:13.503614 (+ 3219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:13.505561 (+ 1947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:13.508084 (+ 2523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:13.509506 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:13.509645 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:13.517588 (+ 7943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:13.517615 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:13.517636 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:13.517688 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:13.525931 (+ 8243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:13.526941 (+ 1010us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:13.526954 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:13.526961 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:13.527177 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:13.527784 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:13.527791 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:13.527794 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:13.528892 (+ 1098us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:13.529479 (+ 587us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:13.530523 (+ 1044us) server_negotiation.cc:299] Negotiation successful
0806 09:15:13.530876 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13989,"thread_start_us":13830,"threads_started":1}
I20260806 09:15:13.534093 18388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:13.496992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:52647 (local address 127.10.255.124:42095)
0806 09:15:13.497668 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:13.497675 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:13.498495 (+ 820us) server_negotiation.cc:407] Connection header received
0806 09:15:13.498673 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:13.498680 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:13.498779 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:13.498883 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:13.502042 (+ 3159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:13.503270 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:13.511374 (+ 8104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:13.512309 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:13.512464 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:13.520588 (+ 8124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:13.520598 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:13.520605 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:13.520662 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:13.530121 (+ 9459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:13.531219 (+ 1098us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:13.531226 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:13.531229 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:13.531421 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:13.532010 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:13.532017 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:13.532022 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:13.532426 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:13.532576 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:13.533440 (+ 864us) server_negotiation.cc:299] Negotiation successful
0806 09:15:13.533735 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449}
I20260806 09:15:13.534247 18524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:13.464898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:50407 (local address 127.10.255.126:37659)
0806 09:15:13.477720 (+ 12822us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:13.477730 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:13.496729 (+ 18999us) server_negotiation.cc:407] Connection header received
0806 09:15:13.496948 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:13.496956 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:13.497103 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:13.497261 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:13.503469 (+ 6208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:13.504702 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:13.509175 (+ 4473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:13.509960 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:13.510065 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:13.520531 (+ 10466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:13.520548 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:13.520554 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:13.520611 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:13.530674 (+ 10063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:13.531742 (+ 1068us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:13.531747 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:13.531750 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:13.531933 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:13.532408 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:13.532413 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:13.532415 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:13.532824 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:13.532972 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:13.533548 (+ 576us) server_negotiation.cc:299] Negotiation successful
0806 09:15:13.533815 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12607,"thread_start_us":12753,"threads_started":1}
I20260806 09:15:13.534298 17860 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:13.535915 18527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:13.497368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42095 (local address 127.10.255.65:52647)
0806 09:15:13.498367 (+ 999us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:13.498384 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:13.498543 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:13.499456 (+ 913us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:13.499471 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:13.500771 (+ 1300us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:13.501792 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:13.501821 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:13.505307 (+ 3486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:13.505313 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:13.507114 (+ 1801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:13.507130 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:13.512977 (+ 5847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:13.512986 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:13.513250 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:13.515878 (+ 2628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:13.515903 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:13.520215 (+ 4312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:13.530326 (+ 10111us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:13.530332 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:13.530336 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:13.531041 (+ 705us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:13.531608 (+ 567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:13.531615 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:13.531623 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:13.531827 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:13.532916 (+ 1089us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:13.532923 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:13.533104 (+ 181us) client_negotiation.cc:769] Sending connection context
0806 09:15:13.534352 (+ 1248us) client_negotiation.cc:240] Negotiation successful
0806 09:15:13.535163 (+ 811us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":751,"mutex_wait_us":487,"thread_start_us":421,"threads_started":1}
I20260806 09:15:13.536237 18526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:13.466496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.10.255.65:50407)
0806 09:15:13.496549 (+ 30053us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:13.496581 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:13.496775 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:13.499721 (+ 2946us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:13.499726 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:13.502175 (+ 2449us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:13.502558 (+ 383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:13.502572 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:13.507290 (+ 4718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:13.507298 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:13.508949 (+ 1651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:13.508964 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:13.510678 (+ 1714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:13.510688 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:13.510964 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:13.515669 (+ 4705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:13.515711 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:13.520059 (+ 4348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:13.530926 (+ 10867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:13.530930 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:13.530933 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:13.531557 (+ 624us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:13.532102 (+ 545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:13.532106 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:13.532109 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:13.532259 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:13.533083 (+ 824us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:13.533090 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:13.533258 (+ 168us) client_negotiation.cc:769] Sending connection context
0806 09:15:13.534525 (+ 1267us) client_negotiation.cc:240] Negotiation successful
0806 09:15:13.534896 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29872,"thread_start_us":29620,"threads_started":1}
I20260806 09:15:13.538445 18518 heartbeater.cc:347] Connected to a master server at 127.10.255.126:37659
I20260806 09:15:13.538545 18517 heartbeater.cc:347] Connected to a master server at 127.10.255.124:42095
I20260806 09:15:13.538872 18517 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:13.538888 18518 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:13.540208 18518 heartbeater.cc:511] Master 127.10.255.126:37659 requested a full tablet report, sending...
I20260806 09:15:13.541631 18517 heartbeater.cc:511] Master 127.10.255.124:42095 requested a full tablet report, sending...
I20260806 09:15:13.542166 18521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:13.463864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:45527 (local address 127.10.255.125:34367)
0806 09:15:13.498727 (+ 34863us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:13.498735 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:13.498764 (+ 29us) server_negotiation.cc:407] Connection header received
0806 09:15:13.498856 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:13.498862 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:13.498979 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:13.499142 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:13.502035 (+ 2893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:13.503488 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:13.506547 (+ 3059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:13.507290 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:13.507487 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:13.513457 (+ 5970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:13.513467 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:13.513473 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:13.513527 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:13.527093 (+ 13566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:13.528544 (+ 1451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:13.528552 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:13.528557 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:13.528755 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:13.529431 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:13.529439 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:13.529444 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:13.529826 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:13.541042 (+ 11216us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:13.541283 (+ 241us) server_negotiation.cc:299] Negotiation successful
0806 09:15:13.541603 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34663,"thread_start_us":39469,"threads_started":1}
I20260806 09:15:13.542860 17537 ts_manager.cc:194] Re-registered known tserver with Master: f81d092a894e4c32af04f0737606f460 (127.10.255.65:41895)
I20260806 09:15:13.542958 18523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:13.464365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:34367 (local address 127.10.255.65:45527)
0806 09:15:13.481724 (+ 17359us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:13.481813 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:13.488030 (+ 6217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:13.499456 (+ 11426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:13.499471 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:13.500670 (+ 1199us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:13.501780 (+ 1110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:13.501821 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:13.503691 (+ 1870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:13.503696 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:13.506333 (+ 2637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:13.506350 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:13.507604 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:13.507615 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:13.508012 (+ 397us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:13.508943 (+ 931us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:13.508977 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:13.513038 (+ 4061us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:13.527316 (+ 14278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:13.527330 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:13.527352 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:13.528320 (+ 968us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:13.528928 (+ 608us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:13.528935 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:13.528940 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:13.529250 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:13.529998 (+ 748us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:13.530008 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:13.530804 (+ 796us) client_negotiation.cc:769] Sending connection context
0806 09:15:13.531181 (+ 377us) client_negotiation.cc:240] Negotiation successful
0806 09:15:13.532279 (+ 1098us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16789,"mutex_wait_us":30,"thread_start_us":19341,"threads_started":1}
I20260806 09:15:13.544075 17537 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.255.65@KRBTEST.COM'} at 127.10.255.65:50407
I20260806 09:15:13.545764 18336 ts_manager.cc:194] Registered new tserver with Master: f81d092a894e4c32af04f0737606f460 (127.10.255.65:41895)
I20260806 09:15:13.546715 18519 heartbeater.cc:347] Connected to a master server at 127.10.255.125:34367
I20260806 09:15:13.546876 18519 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:13.547523 18519 heartbeater.cc:511] Master 127.10.255.125:34367 requested a full tablet report, sending...
I20260806 09:15:13.550905 18146 ts_manager.cc:194] Registered new tserver with Master: f81d092a894e4c32af04f0737606f460 (127.10.255.65:41895)
I20260806 09:15:13.652779 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 17735
I20260806 09:15:13.672479 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:43671
--local_ip_for_outbound_sockets=127.10.255.66
--tserver_master_addrs=127.10.255.126:37659
--webserver_port=44005
--webserver_interface=127.10.255.66
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.66.keytab
--principal=oryx/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.255.126:37659,127.10.255.125:34367
--tserver_master_addrs=127.10.255.126:37659,127.10.255.125:34367,127.10.255.124:42095 with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:15:13.810590 18530 sys_catalog.cc:455] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d08c975cad4141ee9b400d9aaf0a2271" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: NON_VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: true } } }
I20260806 09:15:13.811322 18530 sys_catalog.cc:458] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:13.812271 18532 raft_consensus.cc:1050] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271: attempting to promote NON_VOTER 0e79a3072efc49659fe63e43e9ec9439 to VOTER
I20260806 09:15:13.813087 18532 consensus_queue.cc:237] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: false } }
I20260806 09:15:13.815662 18156 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [term 1 FOLLOWER]: Refusing update from remote peer d08c975cad4141ee9b400d9aaf0a2271: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260806 09:15:13.815655 18347 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [term 1 LEARNER]: Refusing update from remote peer d08c975cad4141ee9b400d9aaf0a2271: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260806 09:15:13.816425 18530 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260806 09:15:13.816844 18532 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260806 09:15:13.820366 18532 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0e79a3072efc49659fe63e43e9ec9439 (127.10.255.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: false } } }
I20260806 09:15:13.821148 18156 raft_consensus.cc:2932] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0e79a3072efc49659fe63e43e9ec9439 (127.10.255.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: false } } }
I20260806 09:15:13.822697 18347 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 0e79a3072efc49659fe63e43e9ec9439 (127.10.255.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: false } } }
I20260806 09:15:13.825709 18530 sys_catalog.cc:455] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "d08c975cad4141ee9b400d9aaf0a2271" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: false } } }
I20260806 09:15:13.826053 18530 sys_catalog.cc:458] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:13.826268 18530 sys_catalog.cc:455] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d08c975cad4141ee9b400d9aaf0a2271" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: false } } }
I20260806 09:15:13.826493 18530 sys_catalog.cc:458] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:13.832202 18539 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d08c975cad4141ee9b400d9aaf0a2271" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: false } } }
I20260806 09:15:13.832716 18539 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:15:13.833115 18531 sys_catalog.cc:455] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d08c975cad4141ee9b400d9aaf0a2271" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: false } } }
I20260806 09:15:13.833701 18531 sys_catalog.cc:458] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271 [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:13.833412 18538 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d08c975cad4141ee9b400d9aaf0a2271" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: false } } }
I20260806 09:15:13.833823 18538 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [sys.catalog]: This master's current role is: FOLLOWER
W20260806 09:15:14.073593 18529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:14.073992 18529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:14.074173 18529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:14.082378 18529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:14.082578 18529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:14.082765 18529 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:15:14.093756 18529 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.66.keytab
--principal=oryx/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:43671
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=44005
--tserver_master_addrs=127.10.255.126:37659,127.10.255.125:34367,127.10.255.124:42095
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:14.095383 18529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:14.097012 18529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:14.114423 18546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:14.114404 18548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:14.114784 18545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:14.116307 18529 server_base.cc:1034] running on GCE node
I20260806 09:15:14.117172 18529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:14.118427 18529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:14.120018 18529 hybrid_clock.cc:648] HybridClock initialized: now 1786007714119936 us; error 67 us; skew 500 ppm
I20260806 09:15:14.120453 18529 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:14 dist-test-slave-mvvj krb5kdc[17493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007714, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:14.128746 18529 init.cc:377] Logged in from keytab as oryx/127.10.255.66@KRBTEST.COM (short username oryx)
I20260806 09:15:14.130877 18529 webserver.cc:460] Webserver started at http://127.10.255.66:44005/ using document root <none> and password file <none>
I20260806 09:15:14.131699 18529 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:14.131937 18529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:14.139220 18529 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.002s
I20260806 09:15:14.142609 18555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:14.144327 18529 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 09:15:14.144598 18529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "9aae9d56b455429982b1ef53f4a2851e"
format_stamp: "Formatted at 2026-08-06 09:15:10 on dist-test-slave-mvvj"
server_key: "7b0f9b8cf1bfe79b84ea8b2fd2f3f10f"
server_key_iv: "93308376180854ffcf0ff83a62ebeb5f"
server_key_version: "encryptionkey@0"
I20260806 09:15:14.145789 18529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:14.171772 18529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:14.177834 18529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:14.178213 18529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:14.179472 18529 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:15:14.181269 18529 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:14.181422 18529 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:14.181573 18529 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:14.181664 18529 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:14.220424 18529 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:43671
I20260806 09:15:14.220522 18668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:43671 every 8 connection(s)
I20260806 09:15:14.222102 18529 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:15:14.225435 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 18529
I20260806 09:15:14.225827 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 17871
Aug 06 09:15:14 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007714, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.125@KRBTEST.COM
Aug 06 09:15:14 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007714, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM
Aug 06 09:15:14 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007714, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.124@KRBTEST.COM
Aug 06 09:15:14 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.255.67@KRBTEST.COM
I20260806 09:15:14.281621 18673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:14.226007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:34023 (local address 127.10.255.126:37659)
0806 09:15:14.232850 (+ 6843us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:14.232860 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:14.250324 (+ 17464us) server_negotiation.cc:407] Connection header received
0806 09:15:14.250994 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:14.251004 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:14.251148 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:14.251262 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:14.257093 (+ 5831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:14.258289 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:14.263601 (+ 5312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:14.264363 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:14.264535 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:14.272443 (+ 7908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:14.272461 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:14.272467 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:14.272561 (+ 94us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:14.277211 (+ 4650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:14.278213 (+ 1002us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:14.278220 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:14.278229 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:14.278418 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:14.278944 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:14.278949 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:14.278952 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:14.279435 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:14.279645 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:14.280591 (+ 946us) server_negotiation.cc:299] Negotiation successful
0806 09:15:14.281087 (+ 496us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6642,"thread_start_us":6454,"threads_started":1}
I20260806 09:15:14.282850 18677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:14.234935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.10.255.66:34023)
0806 09:15:14.250161 (+ 15226us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:14.250198 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:14.250680 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:14.252083 (+ 1403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:14.252161 (+ 78us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:14.253876 (+ 1715us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:14.255243 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:14.255286 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:14.258637 (+ 3351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:14.258646 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:14.263391 (+ 4745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:14.263415 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:14.264625 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:14.264633 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:14.265051 (+ 418us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:14.266227 (+ 1176us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:14.266265 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:14.272168 (+ 5903us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:14.277364 (+ 5196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:14.277372 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:14.277377 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:14.277968 (+ 591us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:14.278547 (+ 579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:14.278552 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:14.278555 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:14.278803 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:14.279616 (+ 813us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:14.279626 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:14.280140 (+ 514us) client_negotiation.cc:769] Sending connection context
0806 09:15:14.280460 (+ 320us) client_negotiation.cc:240] Negotiation successful
0806 09:15:14.281198 (+ 738us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15003,"mutex_wait_us":62,"spinlock_wait_cycles":35072,"thread_start_us":10013,"threads_started":1}
I20260806 09:15:14.284832 18670 heartbeater.cc:347] Connected to a master server at 127.10.255.126:37659
I20260806 09:15:14.285271 18670 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:14.286222 18674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:14.226034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:35931 (local address 127.10.255.125:34367)
0806 09:15:14.235788 (+ 9754us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:14.235798 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:14.245620 (+ 9822us) server_negotiation.cc:407] Connection header received
0806 09:15:14.249433 (+ 3813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:14.249440 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:14.249601 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:14.249728 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:14.257059 (+ 7331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:14.258292 (+ 1233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:14.262537 (+ 4245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:14.263053 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:14.263207 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:14.270384 (+ 7177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:14.270391 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:14.270396 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:14.270442 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:14.274721 (+ 4279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:14.280469 (+ 5748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:14.280475 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:14.280479 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:14.280737 (+ 258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:14.282715 (+ 1978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:14.282724 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:14.282730 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:14.284227 (+ 1497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:14.284421 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:14.285768 (+ 1347us) server_negotiation.cc:299] Negotiation successful
0806 09:15:14.285970 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9580,"thread_start_us":15749,"threads_started":1}
I20260806 09:15:14.286249 18680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:14.246848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:56755 (local address 127.10.255.124:42095)
0806 09:15:14.261210 (+ 14362us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:14.261217 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:14.262130 (+ 913us) server_negotiation.cc:407] Connection header received
0806 09:15:14.262204 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:14.262209 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:14.262294 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:14.262400 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:14.264853 (+ 2453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:14.265917 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:14.268190 (+ 2273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:14.268705 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:14.268840 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:14.276637 (+ 7797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:14.276646 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:14.276651 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:14.276701 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:14.281387 (+ 4686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:14.282715 (+ 1328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:14.282724 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:14.282728 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:14.282874 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:14.283385 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:14.283390 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:14.283393 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:14.283853 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:14.284021 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:14.285565 (+ 1544us) server_negotiation.cc:299] Negotiation successful
0806 09:15:14.285817 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14191,"thread_start_us":15153,"threads_started":1}
I20260806 09:15:14.286790 18679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:14.246714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42095 (local address 127.10.255.66:56755)
0806 09:15:14.261723 (+ 15009us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:14.261748 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:14.261905 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:14.263453 (+ 1548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:14.263460 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:14.264158 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:14.264535 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:14.264549 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:14.266147 (+ 1598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:14.266152 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:14.268018 (+ 1866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:14.268034 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:14.268912 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:14.268920 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:14.269147 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:14.271286 (+ 2139us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:14.271313 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:14.276327 (+ 5014us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:14.281574 (+ 5247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:14.281581 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:14.281585 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:14.282194 (+ 609us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:14.283036 (+ 842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:14.283041 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:14.283045 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:14.283239 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:14.284092 (+ 853us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:14.284098 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:14.284291 (+ 193us) client_negotiation.cc:769] Sending connection context
0806 09:15:14.284447 (+ 156us) client_negotiation.cc:240] Negotiation successful
0806 09:15:14.284805 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14856,"thread_start_us":14716,"threads_started":1}
I20260806 09:15:14.287994 18670 heartbeater.cc:511] Master 127.10.255.126:37659 requested a full tablet report, sending...
I20260806 09:15:14.288173 18678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:14.233931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:34367 (local address 127.10.255.66:35931)
0806 09:15:14.245388 (+ 11457us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:14.245433 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:14.248964 (+ 3531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:14.255644 (+ 6680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:14.255653 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:14.256385 (+ 732us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:14.256814 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:14.256832 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:14.259976 (+ 3144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:14.259986 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:14.262387 (+ 2401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:14.262401 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:14.263330 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:14.263338 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:14.265057 (+ 1719us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:14.266101 (+ 1044us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:14.266151 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:14.270076 (+ 3925us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:14.274897 (+ 4821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:14.274909 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:14.274931 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:14.275963 (+ 1032us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:14.282325 (+ 6362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:14.282335 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:14.282339 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:14.282531 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:14.284911 (+ 2380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:14.284918 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:14.285126 (+ 208us) client_negotiation.cc:769] Sending connection context
0806 09:15:14.285274 (+ 148us) client_negotiation.cc:240] Negotiation successful
0806 09:15:14.287667 (+ 2393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11088,"mutex_wait_us":117,"thread_start_us":15579,"threads_started":1}
I20260806 09:15:14.289170 18671 heartbeater.cc:347] Connected to a master server at 127.10.255.125:34367
I20260806 09:15:14.289342 18671 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:14.289359 18669 heartbeater.cc:347] Connected to a master server at 127.10.255.124:42095
I20260806 09:15:14.289556 18669 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:14.289901 17537 ts_manager.cc:194] Re-registered known tserver with Master: 9aae9d56b455429982b1ef53f4a2851e (127.10.255.66:43671)
I20260806 09:15:14.289961 18671 heartbeater.cc:511] Master 127.10.255.125:34367 requested a full tablet report, sending...
I20260806 09:15:14.290035 18669 heartbeater.cc:511] Master 127.10.255.124:42095 requested a full tablet report, sending...
I20260806 09:15:14.291007 17537 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.255.66@KRBTEST.COM'} at 127.10.255.66:34023
I20260806 09:15:14.291353 18146 ts_manager.cc:194] Registered new tserver with Master: 9aae9d56b455429982b1ef53f4a2851e (127.10.255.66:43671)
I20260806 09:15:14.291555 18336 ts_manager.cc:194] Registered new tserver with Master: 9aae9d56b455429982b1ef53f4a2851e (127.10.255.66:43671)
I20260806 09:15:14.293327 18676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:14.227114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54794 (local address 127.10.255.67:39139)
0806 09:15:14.264143 (+ 37029us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:14.264151 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:14.264177 (+ 26us) server_negotiation.cc:407] Connection header received
0806 09:15:14.264233 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:14.264239 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:14.264512 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:14.267238 (+ 2726us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:14.267555 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:14.269370 (+ 1815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:14.271053 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:14.274037 (+ 2984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:14.274927 (+ 890us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:14.282317 (+ 7390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:14.282340 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:14.282358 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:14.282419 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:14.286615 (+ 4196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:14.287548 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:14.287558 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:14.287561 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:14.287991 (+ 430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:14.288669 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:14.288674 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:14.288678 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:14.289200 (+ 522us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:14.290650 (+ 1450us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:14.292287 (+ 1637us) server_negotiation.cc:299] Negotiation successful
0806 09:15:14.292994 (+ 707us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36837,"thread_start_us":36648,"threads_started":1}
I20260806 09:15:14.294679 17995 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:14.390076 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 17871
I20260806 09:15:14.411126 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:39139
--local_ip_for_outbound_sockets=127.10.255.67
--tserver_master_addrs=127.10.255.126:37659
--webserver_port=40291
--webserver_interface=127.10.255.67
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.67.keytab
--principal=oryx/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.255.126:37659,127.10.255.125:34367
--tserver_master_addrs=127.10.255.126:37659,127.10.255.125:34367,127.10.255.124:42095 with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:15:14.553429 18518 heartbeater.cc:503] Master 127.10.255.126:37659 was elected leader, sending a full tablet report...
W20260806 09:15:14.815486 18682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:14.815963 18682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:14.816156 18682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:14.826530 18682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:14.826725 18682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:14.826964 18682 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:15:14.840430 18682 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.67.keytab
--principal=oryx/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:39139
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=40291
--tserver_master_addrs=127.10.255.126:37659,127.10.255.125:34367,127.10.255.124:42095
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:14.842621 18682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:14.844518 18682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:14.860255 18689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:14.860226 18691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:14.860671 18688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:14.861250 18682 server_base.cc:1034] running on GCE node
I20260806 09:15:14.861989 18682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:14.863348 18682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:14.864683 18682 hybrid_clock.cc:648] HybridClock initialized: now 1786007714864642 us; error 38 us; skew 500 ppm
I20260806 09:15:14.865108 18682 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:14 dist-test-slave-mvvj krb5kdc[17493](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007714, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:14.869001 18682 init.cc:377] Logged in from keytab as oryx/127.10.255.67@KRBTEST.COM (short username oryx)
I20260806 09:15:14.870870 18682 webserver.cc:460] Webserver started at http://127.10.255.67:40291/ using document root <none> and password file <none>
I20260806 09:15:14.871910 18682 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:14.872084 18682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:14.879124 18682 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260806 09:15:14.882632 18698 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:14.884650 18682 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:15:14.884902 18682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "49c087aa22794e949203a2da505e57d7"
format_stamp: "Formatted at 2026-08-06 09:15:10 on dist-test-slave-mvvj"
server_key: "35d6351f2544e5944cff7641e9e08483"
server_key_iv: "28dd0c89c680eb5d29b1ffcf2c85fcd7"
server_key_version: "encryptionkey@0"
I20260806 09:15:14.886178 18682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:14.916955 18682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:14.922997 18682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:14.923405 18682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:14.925030 18682 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:15:14.926913 18682 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:14.927062 18682 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:14.927219 18682 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:14.927309 18682 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:14.975577 18682 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:39139
I20260806 09:15:14.975663 18811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:39139 every 8 connection(s)
I20260806 09:15:14.977319 18682 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:15:14.981793 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 18682
Aug 06 09:15:15 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007714, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.124@KRBTEST.COM
Aug 06 09:15:15 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007714, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.125@KRBTEST.COM
Aug 06 09:15:15 dist-test-slave-mvvj krb5kdc[17493](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007714, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM
I20260806 09:15:15.058187 18817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:14.980952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:52837 (local address 127.10.255.125:34367)
0806 09:15:15.015375 (+ 34423us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:15.015383 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:15.015406 (+ 23us) server_negotiation.cc:407] Connection header received
0806 09:15:15.015467 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:15.015473 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:15.015572 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:15.015719 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:15.027994 (+ 12275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.029458 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.033543 (+ 4085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.034512 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.034724 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:15.042481 (+ 7757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:15.042494 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:15.042502 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:15.042566 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:15.052370 (+ 9804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:15.054889 (+ 2519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:15.054894 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:15.054898 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:15.055098 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:15.055699 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:15.055705 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:15.055708 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:15.056185 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:15.056346 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:15.057503 (+ 1157us) server_negotiation.cc:299] Negotiation successful
0806 09:15:15.057781 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34275,"thread_start_us":34166,"threads_started":1}
I20260806 09:15:15.059901 18820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:14.981684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:34367 (local address 127.10.255.67:52837)
0806 09:15:14.989968 (+ 8284us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:14.990074 (+ 106us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:15.007966 (+ 17892us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:15.015858 (+ 7892us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:15.015865 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:15.019511 (+ 3646us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:15.020108 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:15.020135 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.029672 (+ 9537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.029682 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:15.032650 (+ 2968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:15.032688 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.035024 (+ 2336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.035045 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:15.035526 (+ 481us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:15.036557 (+ 1031us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:15.037038 (+ 481us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:15.042004 (+ 4966us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:15.053717 (+ 11713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:15.053724 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:15.053730 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:15.054741 (+ 1011us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:15.055240 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:15.055246 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:15.055250 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:15.055569 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:15.056405 (+ 836us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:15.056417 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:15.056990 (+ 573us) client_negotiation.cc:769] Sending connection context
0806 09:15:15.057373 (+ 383us) client_negotiation.cc:240] Negotiation successful
0806 09:15:15.057990 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7744,"mutex_wait_us":163,"thread_start_us":27430,"threads_started":1}
I20260806 09:15:15.062984 18818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:14.990766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.10.255.67:40927)
0806 09:15:15.008355 (+ 17589us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:15.008384 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:15.008548 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:15.010534 (+ 1986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:15.010700 (+ 166us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:15.012372 (+ 1672us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:15.013689 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:15.013729 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.024364 (+ 10635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.024372 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:15.026978 (+ 2606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:15.027002 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.035180 (+ 8178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.035187 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:15.035437 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:15.037102 (+ 1665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:15.037137 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:15.046057 (+ 8920us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:15.053606 (+ 7549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:15.053626 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:15.053653 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:15.055866 (+ 2213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:15.059708 (+ 3842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:15.059713 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:15.059717 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:15.059993 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:15.061733 (+ 1740us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:15.061739 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:15.061953 (+ 214us) client_negotiation.cc:769] Sending connection context
0806 09:15:15.062114 (+ 161us) client_negotiation.cc:240] Negotiation successful
0806 09:15:15.062486 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16869,"mutex_wait_us":8,"spinlock_wait_cycles":67968,"thread_start_us":11540,"threads_started":1}
I20260806 09:15:15.063377 18814 heartbeater.cc:347] Connected to a master server at 127.10.255.125:34367
I20260806 09:15:15.063529 18822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:14.990867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:40927 (local address 127.10.255.126:37659)
0806 09:15:15.001919 (+ 11052us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:15.001931 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:15.008717 (+ 6786us) server_negotiation.cc:407] Connection header received
0806 09:15:15.008822 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:15.008830 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:15.008944 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:15.009074 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:15.016006 (+ 6932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.018346 (+ 2340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.032381 (+ 14035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.033152 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.033287 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:15.046815 (+ 13528us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:15.046831 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:15.046841 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:15.046941 (+ 100us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:15.052983 (+ 6042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:15.056037 (+ 3054us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:15.056043 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:15.056047 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:15.056234 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:15.060144 (+ 3910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:15.060153 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:15.060159 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:15.060769 (+ 610us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:15.061005 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:15.062785 (+ 1780us) server_negotiation.cc:299] Negotiation successful
0806 09:15:15.063106 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10822,"thread_start_us":11086,"threads_started":1}
I20260806 09:15:15.063761 18814 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:15.064445 18813 heartbeater.cc:347] Connected to a master server at 127.10.255.126:37659
I20260806 09:15:15.064615 18813 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:15.064976 18814 heartbeater.cc:511] Master 127.10.255.125:34367 requested a full tablet report, sending...
I20260806 09:15:15.065136 18813 heartbeater.cc:511] Master 127.10.255.126:37659 requested a full tablet report, sending...
I20260806 09:15:15.067351 18146 ts_manager.cc:194] Registered new tserver with Master: 49c087aa22794e949203a2da505e57d7 (127.10.255.67:39139)
I20260806 09:15:15.069295 17537 ts_manager.cc:194] Re-registered known tserver with Master: 49c087aa22794e949203a2da505e57d7 (127.10.255.67:39139)
I20260806 09:15:15.070808 17537 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.255.67@KRBTEST.COM'} at 127.10.255.67:40927
I20260806 09:15:15.077042 18821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:14.984255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42095 (local address 127.10.255.67:33395)
0806 09:15:15.002799 (+ 18544us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:15.002832 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:15.006236 (+ 3404us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:15.014877 (+ 8641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:15.014886 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:15.015452 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:15.015790 (+ 338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:15.015807 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.025775 (+ 9968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.025782 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:15.027380 (+ 1598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:15.027403 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.029357 (+ 1954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.029366 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:15.030501 (+ 1135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:15.032735 (+ 2234us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:15.032777 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:15.060282 (+ 27505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:15.072469 (+ 12187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:15.072475 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:15.072479 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:15.073095 (+ 616us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:15.073989 (+ 894us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:15.073995 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:15.073998 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:15.074286 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:15.075245 (+ 959us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:15.075253 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:15.075590 (+ 337us) client_negotiation.cc:769] Sending connection context
0806 09:15:15.075791 (+ 201us) client_negotiation.cc:240] Negotiation successful
0806 09:15:15.076370 (+ 579us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18342,"thread_start_us":4982,"threads_started":1}
I20260806 09:15:15.078329 18816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:14.980899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:33395 (local address 127.10.255.124:42095)
0806 09:15:15.014430 (+ 33531us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:15.014437 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:15.014460 (+ 23us) server_negotiation.cc:407] Connection header received
0806 09:15:15.014542 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:15.014549 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:15.014663 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:15.014800 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:15.016056 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.025521 (+ 9465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.027963 (+ 2442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.028925 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.036867 (+ 7942us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:15.060814 (+ 23947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:15.060824 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:15.060832 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:15.060879 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:15.072223 (+ 11344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:15.073474 (+ 1251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:15.073481 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:15.073485 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:15.073730 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:15.074555 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:15.074561 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:15.074566 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:15.075020 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:15.075290 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:15.077536 (+ 2246us) server_negotiation.cc:299] Negotiation successful
0806 09:15:15.077766 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33381,"thread_start_us":33244,"threads_started":1}
I20260806 09:15:15.079811 18812 heartbeater.cc:347] Connected to a master server at 127.10.255.124:42095
I20260806 09:15:15.080153 18812 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:15.080914 18812 heartbeater.cc:511] Master 127.10.255.124:42095 requested a full tablet report, sending...
I20260806 09:15:15.082434 18336 ts_manager.cc:194] Registered new tserver with Master: 49c087aa22794e949203a2da505e57d7 (127.10.255.67:39139)
I20260806 09:15:15.085436 18827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:15.016757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44328 (local address 127.10.255.125:34367)
0806 09:15:15.039142 (+ 22385us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:15.039151 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:15.050525 (+ 11374us) server_negotiation.cc:407] Connection header received
0806 09:15:15.052939 (+ 2414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:15.052945 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:15.053063 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:15.054149 (+ 1086us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:15.059648 (+ 5499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.064047 (+ 4399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.065942 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.067143 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.067296 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:15.072687 (+ 5391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:15.072696 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:15.072704 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:15.072756 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:15.077403 (+ 4647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:15.082003 (+ 4600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:15.082009 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:15.082012 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:15.082356 (+ 344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:15.083029 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:15.083034 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:15.083037 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:15.083607 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:15.084038 (+ 431us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:15.084508 (+ 470us) server_negotiation.cc:299] Negotiation successful
0806 09:15:15.084773 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22193,"thread_start_us":22827,"threads_started":1}
I20260806 09:15:15.090641 18826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:15.016568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49378 (local address 127.10.255.126:37659)
0806 09:15:15.038481 (+ 21913us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:15.038491 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:15.040582 (+ 2091us) server_negotiation.cc:407] Connection header received
0806 09:15:15.040715 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:15.040721 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:15.040817 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:15.040934 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:15.054594 (+ 13660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.056328 (+ 1734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.068612 (+ 12284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.069700 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.069806 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:15.079634 (+ 9828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:15.079644 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:15.079650 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:15.079882 (+ 232us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:15.086337 (+ 6455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:15.087461 (+ 1124us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:15.087469 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:15.087476 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:15.087735 (+ 259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:15.088318 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:15.088325 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:15.088329 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:15.088913 (+ 584us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:15.089324 (+ 411us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:15.089811 (+ 487us) server_negotiation.cc:299] Negotiation successful
0806 09:15:15.090157 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21692,"thread_start_us":21939,"threads_started":1}
I20260806 09:15:15.093762 18830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:15.041225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54314 (local address 127.10.255.124:42095)
0806 09:15:15.059680 (+ 18455us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:15.059688 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:15.059709 (+ 21us) server_negotiation.cc:407] Connection header received
0806 09:15:15.059781 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:15.059788 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:15.059919 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:15.067342 (+ 7423us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:15.067880 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.072893 (+ 5013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.075551 (+ 2658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.076417 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.076579 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:15.083510 (+ 6931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:15.083523 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:15.083532 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:15.083588 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:15.088972 (+ 5384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:15.090252 (+ 1280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:15.090257 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:15.090259 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:15.090633 (+ 374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:15.091230 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:15.091236 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:15.091240 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:15.091602 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:15.092047 (+ 445us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:15.092430 (+ 383us) server_negotiation.cc:299] Negotiation successful
0806 09:15:15.092820 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18262,"thread_start_us":18112,"threads_started":1}
I20260806 09:15:15.096921 17537 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49378:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:15:15.108141 17537 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:15:15.168118 18843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:15.145654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:39139 (local address 127.0.0.1:54798)
0806 09:15:15.147142 (+ 1488us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:15.147166 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:15.148128 (+ 962us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:15.154539 (+ 6411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:15.154544 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:15.154575 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:15.155000 (+ 425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:15.155011 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.157441 (+ 2430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.157449 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:15.159204 (+ 1755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:15.159221 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.167062 (+ 7841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.167070 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:15.167282 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:15.167326 (+ 44us) client_negotiation.cc:769] Sending connection context
0806 09:15:15.167454 (+ 128us) client_negotiation.cc:240] Negotiation successful
0806 09:15:15.167618 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1335,"thread_start_us":1116,"threads_started":1}
I20260806 09:15:15.168203 18846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:15.146295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54798 (local address 127.10.255.67:39139)
0806 09:15:15.153572 (+ 7277us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:15.153587 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:15.153647 (+ 60us) server_negotiation.cc:407] Connection header received
0806 09:15:15.153803 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:15.153816 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:15.154207 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:15.154559 (+ 352us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:15.155265 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.157232 (+ 1967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.159459 (+ 2227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.161435 (+ 1976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.161603 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:15.161873 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:15.167557 (+ 5684us) server_negotiation.cc:299] Negotiation successful
0806 09:15:15.167747 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6981,"thread_start_us":6692,"threads_started":1}
I20260806 09:15:15.172375 18845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:15.146274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:43671 (local address 127.0.0.1:40014)
0806 09:15:15.159102 (+ 12828us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:15.159134 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:15.159325 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:15.162346 (+ 3021us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:15.162351 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:15.162381 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:15.162761 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:15.162775 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.165345 (+ 2570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.165356 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:15.168366 (+ 3010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:15.168384 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.171219 (+ 2835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.171227 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:15.171441 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:15.171482 (+ 41us) client_negotiation.cc:769] Sending connection context
0806 09:15:15.171600 (+ 118us) client_negotiation.cc:240] Negotiation successful
0806 09:15:15.171758 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12563,"thread_start_us":13177,"threads_started":1}
I20260806 09:15:15.172539 18847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:15.147146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40014 (local address 127.10.255.66:43671)
0806 09:15:15.161459 (+ 14313us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:15.161483 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:15.161526 (+ 43us) server_negotiation.cc:407] Connection header received
0806 09:15:15.161666 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:15.161678 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:15.162086 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:15.162357 (+ 271us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:15.162942 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.165141 (+ 2199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.168834 (+ 3693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.170941 (+ 2107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.171147 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:15.171423 (+ 276us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:15.171691 (+ 268us) server_negotiation.cc:299] Negotiation successful
0806 09:15:15.171972 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14045,"thread_start_us":15399,"threads_started":1}
I20260806 09:15:15.172712 18747 tablet_service.cc:1467] Processing CreateTablet for tablet 86ec324312b7488892e576c0ac8ee7da (DEFAULT_TABLE table=test-table [id=4906cd51bd6f426caacb8f48bc5b577b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:15:15.174801 18747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86ec324312b7488892e576c0ac8ee7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:15.177139 18604 tablet_service.cc:1467] Processing CreateTablet for tablet 86ec324312b7488892e576c0ac8ee7da (DEFAULT_TABLE table=test-table [id=4906cd51bd6f426caacb8f48bc5b577b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:15:15.178570 18604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86ec324312b7488892e576c0ac8ee7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:15.183430 18849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:15.160298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51558 (local address 127.10.255.65:41895)
0806 09:15:15.173836 (+ 13538us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:15.173847 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:15.173882 (+ 35us) server_negotiation.cc:407] Connection header received
0806 09:15:15.174008 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:15.174016 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:15.174305 (+ 289us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:15.174536 (+ 231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:15.175186 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.177664 (+ 2478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.180222 (+ 2558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.182039 (+ 1817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.182212 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:15.182463 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:15.182871 (+ 408us) server_negotiation.cc:299] Negotiation successful
0806 09:15:15.183086 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13268,"thread_start_us":13104,"threads_started":1}
I20260806 09:15:15.183430 18848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:15.160025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:41895 (local address 127.0.0.1:51558)
0806 09:15:15.165799 (+ 5774us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:15.165816 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:15.165979 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:15.174530 (+ 8551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:15.174535 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:15.174570 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:15.174983 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:15.174997 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.177833 (+ 2836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.177839 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:15.179967 (+ 2128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:15.179986 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.182304 (+ 2318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.182312 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:15.182526 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:15.182688 (+ 162us) client_negotiation.cc:769] Sending connection context
0806 09:15:15.182798 (+ 110us) client_negotiation.cc:240] Negotiation successful
0806 09:15:15.182948 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5633,"thread_start_us":5436,"threads_started":1}
I20260806 09:15:15.188832 18452 tablet_service.cc:1467] Processing CreateTablet for tablet 86ec324312b7488892e576c0ac8ee7da (DEFAULT_TABLE table=test-table [id=4906cd51bd6f426caacb8f48bc5b577b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:15:15.190492 18452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 86ec324312b7488892e576c0ac8ee7da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:15.191458 18850 tablet_bootstrap.cc:492] T 86ec324312b7488892e576c0ac8ee7da P 49c087aa22794e949203a2da505e57d7: Bootstrap starting.
I20260806 09:15:15.195405 18851 tablet_bootstrap.cc:492] T 86ec324312b7488892e576c0ac8ee7da P 9aae9d56b455429982b1ef53f4a2851e: Bootstrap starting.
I20260806 09:15:15.197500 18850 tablet_bootstrap.cc:654] T 86ec324312b7488892e576c0ac8ee7da P 49c087aa22794e949203a2da505e57d7: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:15.199921 18850 log.cc:824] T 86ec324312b7488892e576c0ac8ee7da P 49c087aa22794e949203a2da505e57d7: Log is configured to *not* fsync() on all Append() calls
I20260806 09:15:15.200609 18851 tablet_bootstrap.cc:654] T 86ec324312b7488892e576c0ac8ee7da P 9aae9d56b455429982b1ef53f4a2851e: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:15.202136 18851 log.cc:824] T 86ec324312b7488892e576c0ac8ee7da P 9aae9d56b455429982b1ef53f4a2851e: Log is configured to *not* fsync() on all Append() calls
I20260806 09:15:15.204382 18850 tablet_bootstrap.cc:492] T 86ec324312b7488892e576c0ac8ee7da P 49c087aa22794e949203a2da505e57d7: No bootstrap required, opened a new log
I20260806 09:15:15.204828 18850 ts_tablet_manager.cc:1397] T 86ec324312b7488892e576c0ac8ee7da P 49c087aa22794e949203a2da505e57d7: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.004s
I20260806 09:15:15.206919 18851 tablet_bootstrap.cc:492] T 86ec324312b7488892e576c0ac8ee7da P 9aae9d56b455429982b1ef53f4a2851e: No bootstrap required, opened a new log
I20260806 09:15:15.207336 18851 ts_tablet_manager.cc:1397] T 86ec324312b7488892e576c0ac8ee7da P 9aae9d56b455429982b1ef53f4a2851e: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.004s
I20260806 09:15:15.209080 18854 tablet_bootstrap.cc:492] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460: Bootstrap starting.
I20260806 09:15:15.213021 18854 tablet_bootstrap.cc:654] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:15.214321 18854 log.cc:824] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460: Log is configured to *not* fsync() on all Append() calls
I20260806 09:15:15.217856 18854 tablet_bootstrap.cc:492] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460: No bootstrap required, opened a new log
I20260806 09:15:15.218205 18854 ts_tablet_manager.cc:1397] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260806 09:15:15.220803 18851 raft_consensus.cc:348] T 86ec324312b7488892e576c0ac8ee7da P 9aae9d56b455429982b1ef53f4a2851e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c087aa22794e949203a2da505e57d7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39139 } } peers { permanent_uuid: "9aae9d56b455429982b1ef53f4a2851e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43671 } } peers { permanent_uuid: "f81d092a894e4c32af04f0737606f460" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41895 } }
I20260806 09:15:15.220808 18850 raft_consensus.cc:348] T 86ec324312b7488892e576c0ac8ee7da P 49c087aa22794e949203a2da505e57d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c087aa22794e949203a2da505e57d7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39139 } } peers { permanent_uuid: "9aae9d56b455429982b1ef53f4a2851e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43671 } } peers { permanent_uuid: "f81d092a894e4c32af04f0737606f460" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41895 } }
I20260806 09:15:15.221323 18850 raft_consensus.cc:374] T 86ec324312b7488892e576c0ac8ee7da P 49c087aa22794e949203a2da505e57d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:15.221433 18851 raft_consensus.cc:374] T 86ec324312b7488892e576c0ac8ee7da P 9aae9d56b455429982b1ef53f4a2851e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:15.221448 18850 raft_consensus.cc:729] T 86ec324312b7488892e576c0ac8ee7da P 49c087aa22794e949203a2da505e57d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49c087aa22794e949203a2da505e57d7, State: Initialized, Role: FOLLOWER
I20260806 09:15:15.221596 18851 raft_consensus.cc:729] T 86ec324312b7488892e576c0ac8ee7da P 9aae9d56b455429982b1ef53f4a2851e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aae9d56b455429982b1ef53f4a2851e, State: Initialized, Role: FOLLOWER
I20260806 09:15:15.222390 18850 consensus_queue.cc:260] T 86ec324312b7488892e576c0ac8ee7da P 49c087aa22794e949203a2da505e57d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c087aa22794e949203a2da505e57d7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39139 } } peers { permanent_uuid: "9aae9d56b455429982b1ef53f4a2851e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43671 } } peers { permanent_uuid: "f81d092a894e4c32af04f0737606f460" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41895 } }
I20260806 09:15:15.222396 18851 consensus_queue.cc:260] T 86ec324312b7488892e576c0ac8ee7da P 9aae9d56b455429982b1ef53f4a2851e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c087aa22794e949203a2da505e57d7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39139 } } peers { permanent_uuid: "9aae9d56b455429982b1ef53f4a2851e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43671 } } peers { permanent_uuid: "f81d092a894e4c32af04f0737606f460" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41895 } }
I20260806 09:15:15.231042 18854 raft_consensus.cc:348] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c087aa22794e949203a2da505e57d7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39139 } } peers { permanent_uuid: "9aae9d56b455429982b1ef53f4a2851e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43671 } } peers { permanent_uuid: "f81d092a894e4c32af04f0737606f460" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41895 } }
I20260806 09:15:15.231606 18854 raft_consensus.cc:374] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:15.231738 18854 raft_consensus.cc:729] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81d092a894e4c32af04f0737606f460, State: Initialized, Role: FOLLOWER
I20260806 09:15:15.232695 18854 consensus_queue.cc:260] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c087aa22794e949203a2da505e57d7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39139 } } peers { permanent_uuid: "9aae9d56b455429982b1ef53f4a2851e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43671 } } peers { permanent_uuid: "f81d092a894e4c32af04f0737606f460" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41895 } }
I20260806 09:15:15.233820 18851 ts_tablet_manager.cc:1428] T 86ec324312b7488892e576c0ac8ee7da P 9aae9d56b455429982b1ef53f4a2851e: Time spent starting tablet: real 0.026s user 0.017s sys 0.009s
I20260806 09:15:15.240448 18670 heartbeater.cc:503] Master 127.10.255.126:37659 was elected leader, sending a full tablet report...
I20260806 09:15:15.241621 18850 ts_tablet_manager.cc:1428] T 86ec324312b7488892e576c0ac8ee7da P 49c087aa22794e949203a2da505e57d7: Time spent starting tablet: real 0.037s user 0.013s sys 0.019s
I20260806 09:15:15.241642 18854 ts_tablet_manager.cc:1428] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460: Time spent starting tablet: real 0.023s user 0.019s sys 0.005s
I20260806 09:15:15.242002 18813 heartbeater.cc:503] Master 127.10.255.126:37659 was elected leader, sending a full tablet report...
W20260806 09:15:15.242339 18520 tablet.cc:2369] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 09:15:15.245882 18672 tablet.cc:2369] T 86ec324312b7488892e576c0ac8ee7da P 9aae9d56b455429982b1ef53f4a2851e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:15:15.290889 18858 raft_consensus.cc:482] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:15:15.291293 18858 raft_consensus.cc:504] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c087aa22794e949203a2da505e57d7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39139 } } peers { permanent_uuid: "9aae9d56b455429982b1ef53f4a2851e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43671 } } peers { permanent_uuid: "f81d092a894e4c32af04f0737606f460" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41895 } }
I20260806 09:15:15.293558 18858 leader_election.cc:288] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49c087aa22794e949203a2da505e57d7 (127.10.255.67:39139), 9aae9d56b455429982b1ef53f4a2851e (127.10.255.66:43671)
I20260806 09:15:15.302340 18846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:15.293875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:40921 (local address 127.10.255.67:39139)
0806 09:15:15.294141 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:15.294148 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:15.295731 (+ 1583us) server_negotiation.cc:407] Connection header received
0806 09:15:15.296069 (+ 338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:15.296073 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:15.296142 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:15.296257 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:15.296923 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.297745 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.300168 (+ 2423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.301120 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.301357 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:15.301450 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:15.301865 (+ 415us) server_negotiation.cc:299] Negotiation successful
0806 09:15:15.302030 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260806 09:15:15.302336 18847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:15.294165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:49017 (local address 127.10.255.66:43671)
0806 09:15:15.294421 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:15.294430 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:15.295882 (+ 1452us) server_negotiation.cc:407] Connection header received
0806 09:15:15.296084 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:15.296088 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:15.296153 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:15.296257 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:15.296861 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.297652 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.300233 (+ 2581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.301092 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.301297 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:15.301384 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:15.301875 (+ 491us) server_negotiation.cc:299] Negotiation successful
0806 09:15:15.302028 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 09:15:15.302587 18860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:15.294255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:43671 (local address 127.10.255.65:49017)
0806 09:15:15.295720 (+ 1465us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:15.295736 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:15.295912 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:15.296276 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:15.296280 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:15.296305 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:15.296670 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:15.296683 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.297800 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.297805 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:15.300034 (+ 2229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:15.300051 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.301347 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.301354 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:15.301524 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:15.301553 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 09:15:15.301846 (+ 293us) client_negotiation.cc:240] Negotiation successful
0806 09:15:15.302028 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1325,"mutex_wait_us":29,"thread_start_us":1127,"threads_started":1}
I20260806 09:15:15.302963 18859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:15.293948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:39139 (local address 127.10.255.65:40921)
0806 09:15:15.295593 (+ 1645us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:15.295611 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:15.295874 (+ 263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:15.296277 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:15.296282 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:15.296368 (+ 86us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:15.296764 (+ 396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:15.296774 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.297906 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.297913 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:15.299968 (+ 2055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:15.299985 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.301413 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.301420 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:15.301675 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:15.301703 (+ 28us) client_negotiation.cc:769] Sending connection context
0806 09:15:15.301829 (+ 126us) client_negotiation.cc:240] Negotiation successful
0806 09:15:15.302015 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1469,"mutex_wait_us":3,"spinlock_wait_cycles":53504,"thread_start_us":1224,"threads_started":1}
I20260806 09:15:15.303906 18624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86ec324312b7488892e576c0ac8ee7da" candidate_uuid: "f81d092a894e4c32af04f0737606f460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aae9d56b455429982b1ef53f4a2851e" is_pre_election: true
I20260806 09:15:15.304108 18767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86ec324312b7488892e576c0ac8ee7da" candidate_uuid: "f81d092a894e4c32af04f0737606f460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49c087aa22794e949203a2da505e57d7" is_pre_election: true
I20260806 09:15:15.304617 18624 raft_consensus.cc:2454] T 86ec324312b7488892e576c0ac8ee7da P 9aae9d56b455429982b1ef53f4a2851e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81d092a894e4c32af04f0737606f460 in term 0.
I20260806 09:15:15.304714 18767 raft_consensus.cc:2454] T 86ec324312b7488892e576c0ac8ee7da P 49c087aa22794e949203a2da505e57d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f81d092a894e4c32af04f0737606f460 in term 0.
I20260806 09:15:15.305548 18405 leader_election.cc:302] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9aae9d56b455429982b1ef53f4a2851e, f81d092a894e4c32af04f0737606f460; no voters:
I20260806 09:15:15.305992 18858 raft_consensus.cc:2781] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:15:15.306181 18858 raft_consensus.cc:482] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:15:15.306313 18858 raft_consensus.cc:3037] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:15.309643 18858 raft_consensus.cc:504] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c087aa22794e949203a2da505e57d7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39139 } } peers { permanent_uuid: "9aae9d56b455429982b1ef53f4a2851e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43671 } } peers { permanent_uuid: "f81d092a894e4c32af04f0737606f460" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41895 } }
I20260806 09:15:15.310823 18858 leader_election.cc:288] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460 [CANDIDATE]: Term 1 election: Requested vote from peers 49c087aa22794e949203a2da505e57d7 (127.10.255.67:39139), 9aae9d56b455429982b1ef53f4a2851e (127.10.255.66:43671)
I20260806 09:15:15.311879 18767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86ec324312b7488892e576c0ac8ee7da" candidate_uuid: "f81d092a894e4c32af04f0737606f460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49c087aa22794e949203a2da505e57d7"
I20260806 09:15:15.312201 18767 raft_consensus.cc:3037] T 86ec324312b7488892e576c0ac8ee7da P 49c087aa22794e949203a2da505e57d7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:15.312207 18624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "86ec324312b7488892e576c0ac8ee7da" candidate_uuid: "f81d092a894e4c32af04f0737606f460" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aae9d56b455429982b1ef53f4a2851e"
I20260806 09:15:15.312641 18624 raft_consensus.cc:3037] T 86ec324312b7488892e576c0ac8ee7da P 9aae9d56b455429982b1ef53f4a2851e [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:15.316051 18624 raft_consensus.cc:2454] T 86ec324312b7488892e576c0ac8ee7da P 9aae9d56b455429982b1ef53f4a2851e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81d092a894e4c32af04f0737606f460 in term 1.
I20260806 09:15:15.316282 18767 raft_consensus.cc:2454] T 86ec324312b7488892e576c0ac8ee7da P 49c087aa22794e949203a2da505e57d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f81d092a894e4c32af04f0737606f460 in term 1.
I20260806 09:15:15.317034 18406 leader_election.cc:302] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49c087aa22794e949203a2da505e57d7, f81d092a894e4c32af04f0737606f460; no voters:
I20260806 09:15:15.317567 18858 raft_consensus.cc:2781] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:15:15.318164 18858 raft_consensus.cc:686] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460 [term 1 LEADER]: Becoming Leader. State: Replica: f81d092a894e4c32af04f0737606f460, State: Running, Role: LEADER
I20260806 09:15:15.318820 18858 consensus_queue.cc:237] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c087aa22794e949203a2da505e57d7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39139 } } peers { permanent_uuid: "9aae9d56b455429982b1ef53f4a2851e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43671 } } peers { permanent_uuid: "f81d092a894e4c32af04f0737606f460" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41895 } }
I20260806 09:15:15.326623 17537 catalog_manager.cc:5495] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460 reported cstate change: term changed from 0 to 1, leader changed from <none> to f81d092a894e4c32af04f0737606f460 (127.10.255.65). New cstate: current_term: 1 leader_uuid: "f81d092a894e4c32af04f0737606f460" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49c087aa22794e949203a2da505e57d7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aae9d56b455429982b1ef53f4a2851e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81d092a894e4c32af04f0737606f460" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41895 } health_report { overall_health: HEALTHY } } }
I20260806 09:15:15.360764 18849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:15.353681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51570 (local address 127.10.255.65:41895)
0806 09:15:15.353931 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:15.353938 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:15.354049 (+ 111us) server_negotiation.cc:407] Connection header received
0806 09:15:15.354363 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:15.354368 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:15.354454 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:15.354693 (+ 239us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:15:15.355330 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.356213 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.357947 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.358468 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.358643 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:15.359328 (+ 685us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:15:15.359990 (+ 662us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:15:15.360183 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:15.360310 (+ 127us) server_negotiation.cc:299] Negotiation successful
0806 09:15:15.360418 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 09:15:15.371747 18624 raft_consensus.cc:1261] T 86ec324312b7488892e576c0ac8ee7da P 9aae9d56b455429982b1ef53f4a2851e [term 1 FOLLOWER]: Refusing update from remote peer f81d092a894e4c32af04f0737606f460: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:15:15.371562 18767 raft_consensus.cc:1261] T 86ec324312b7488892e576c0ac8ee7da P 49c087aa22794e949203a2da505e57d7 [term 1 FOLLOWER]: Refusing update from remote peer f81d092a894e4c32af04f0737606f460: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:15:15.373656 18861 consensus_queue.cc:1035] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aae9d56b455429982b1ef53f4a2851e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260806 09:15:15.375062 18858 consensus_queue.cc:1035] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49c087aa22794e949203a2da505e57d7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260806 09:15:15.395939 18864 mvcc.cc:205] Tried to move back new op lower bound from 7315487602149683200 to 7315487601951268864. Current Snapshot: MvccSnapshot[applied={T|T < 7315487602149683200}]
I20260806 09:15:15.428143 17537 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:15:15.428506 17537 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:15:15.437884 17537 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d08c975cad4141ee9b400d9aaf0a2271: Sending DeleteTablet for 3 replicas of tablet 86ec324312b7488892e576c0ac8ee7da
I20260806 09:15:15.439476 18747 tablet_service.cc:1514] Processing DeleteTablet for tablet 86ec324312b7488892e576c0ac8ee7da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:15:15 UTC) from {username='oryx', principal='oryx/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:54798
I20260806 09:15:15.440008 18604 tablet_service.cc:1514] Processing DeleteTablet for tablet 86ec324312b7488892e576c0ac8ee7da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:15:15 UTC) from {username='oryx', principal='oryx/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:40014
I20260806 09:15:15.440302 18452 tablet_service.cc:1514] Processing DeleteTablet for tablet 86ec324312b7488892e576c0ac8ee7da with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:15:15 UTC) from {username='oryx', principal='oryx/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:51558
I20260806 09:15:15.442328 18874 tablet_replica.cc:330] T 86ec324312b7488892e576c0ac8ee7da P 49c087aa22794e949203a2da505e57d7: stopping tablet replica
I20260806 09:15:15.442956 18874 raft_consensus.cc:2229] T 86ec324312b7488892e576c0ac8ee7da P 49c087aa22794e949203a2da505e57d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:15:15.443753 18874 raft_consensus.cc:2258] T 86ec324312b7488892e576c0ac8ee7da P 49c087aa22794e949203a2da505e57d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:15:15.446723 18874 ts_tablet_manager.cc:1905] T 86ec324312b7488892e576c0ac8ee7da P 49c087aa22794e949203a2da505e57d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:15:15.461325 18874 ts_tablet_manager.cc:1918] T 86ec324312b7488892e576c0ac8ee7da P 49c087aa22794e949203a2da505e57d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:15:15.461560 18874 log.cc:1196] T 86ec324312b7488892e576c0ac8ee7da P 49c087aa22794e949203a2da505e57d7: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/86ec324312b7488892e576c0ac8ee7da
I20260806 09:15:15.462126 18874 ts_tablet_manager.cc:1939] T 86ec324312b7488892e576c0ac8ee7da P 49c087aa22794e949203a2da505e57d7: Deleting consensus metadata
I20260806 09:15:15.465278 17524 catalog_manager.cc:4841] TS 49c087aa22794e949203a2da505e57d7 (127.10.255.67:39139): tablet 86ec324312b7488892e576c0ac8ee7da (table test-table [id=4906cd51bd6f426caacb8f48bc5b577b]) successfully deleted
I20260806 09:15:15.480677 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 17506
I20260806 09:15:15.482728 17569 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:15.483008 18876 tablet_replica.cc:330] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460: stopping tablet replica
I20260806 09:15:15.483729 18876 raft_consensus.cc:2229] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460 [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:15:15.486092 18875 tablet_replica.cc:330] T 86ec324312b7488892e576c0ac8ee7da P 9aae9d56b455429982b1ef53f4a2851e: stopping tablet replica
I20260806 09:15:15.486558 18876 raft_consensus.cc:2258] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:15:15.486819 18875 raft_consensus.cc:2229] T 86ec324312b7488892e576c0ac8ee7da P 9aae9d56b455429982b1ef53f4a2851e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:15:15.487491 18875 raft_consensus.cc:2258] T 86ec324312b7488892e576c0ac8ee7da P 9aae9d56b455429982b1ef53f4a2851e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:15:15.489470 18876 ts_tablet_manager.cc:1905] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:15:15.495764 18875 ts_tablet_manager.cc:1905] T 86ec324312b7488892e576c0ac8ee7da P 9aae9d56b455429982b1ef53f4a2851e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:15:15.498973 18876 ts_tablet_manager.cc:1918] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:15:15.499217 18876 log.cc:1196] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/wal/wals/86ec324312b7488892e576c0ac8ee7da
I20260806 09:15:15.499945 18876 ts_tablet_manager.cc:1939] T 86ec324312b7488892e576c0ac8ee7da P f81d092a894e4c32af04f0737606f460: Deleting consensus metadata
I20260806 09:15:15.503608 18875 ts_tablet_manager.cc:1918] T 86ec324312b7488892e576c0ac8ee7da P 9aae9d56b455429982b1ef53f4a2851e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:15:15.503820 18875 log.cc:1196] T 86ec324312b7488892e576c0ac8ee7da P 9aae9d56b455429982b1ef53f4a2851e: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/86ec324312b7488892e576c0ac8ee7da
I20260806 09:15:15.504585 18875 ts_tablet_manager.cc:1939] T 86ec324312b7488892e576c0ac8ee7da P 9aae9d56b455429982b1ef53f4a2851e: Deleting consensus metadata
I20260806 09:15:15.504788 18827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:15.444473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44336 (local address 127.10.255.125:34367)
0806 09:15:15.444795 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:15.444807 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:15.475289 (+ 30482us) server_negotiation.cc:407] Connection header received
0806 09:15:15.476594 (+ 1305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:15.476606 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:15.476739 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:15.476845 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:15.484543 (+ 7698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.486070 (+ 1527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.490374 (+ 4304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.491209 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.491337 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:15.495857 (+ 4520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:15.495866 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:15.495872 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:15.495927 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:15.500498 (+ 4571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:15.501713 (+ 1215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:15.501719 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:15.501723 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:15.501936 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:15.502546 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:15.502556 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:15.502560 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:15.502982 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:15.503290 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:15.504056 (+ 766us) server_negotiation.cc:299] Negotiation successful
0806 09:15:15.504376 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 09:15:15.528663 18830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:15.474869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54322 (local address 127.10.255.124:42095)
0806 09:15:15.475085 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:15.475092 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:15.508183 (+ 33091us) server_negotiation.cc:407] Connection header received
0806 09:15:15.508532 (+ 349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:15.508539 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:15.508638 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:15.508723 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:15.511174 (+ 2451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.512454 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.514682 (+ 2228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.515428 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.515580 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:15.519603 (+ 4023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:15.519613 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:15.519619 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:15.519682 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:15.524440 (+ 4758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:15.525982 (+ 1542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:15.525990 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:15.525994 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:15.526225 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:15.526750 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:15.526757 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:15.526761 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:15.527215 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:15.527521 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:15.527934 (+ 413us) server_negotiation.cc:299] Negotiation successful
0806 09:15:15.528226 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 09:15:15.632238 17523 catalog_manager.cc:4841] TS 9aae9d56b455429982b1ef53f4a2851e (127.10.255.66:43671): tablet 86ec324312b7488892e576c0ac8ee7da (table test-table [id=4906cd51bd6f426caacb8f48bc5b577b]) successfully deleted
I20260806 09:15:15.633394 17523 catalog_manager.cc:4841] TS f81d092a894e4c32af04f0737606f460 (127.10.255.65:41895): tablet 86ec324312b7488892e576c0ac8ee7da (table test-table [id=4906cd51bd6f426caacb8f48bc5b577b]) successfully deleted
I20260806 09:15:15.634284 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 17506
I20260806 09:15:15.698751 18827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:15.673099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44344 (local address 127.10.255.125:34367)
0806 09:15:15.673307 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:15.673316 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:15.674631 (+ 1315us) server_negotiation.cc:407] Connection header received
0806 09:15:15.675008 (+ 377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:15.675019 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:15.675151 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:15.675256 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:15.679465 (+ 4209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.681338 (+ 1873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.685081 (+ 3743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.686752 (+ 1671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.686929 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:15.689843 (+ 2914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:15.689850 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:15.689855 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:15.689919 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:15.694195 (+ 4276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:15.695614 (+ 1419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:15.695619 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:15.695621 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:15.695808 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:15.696511 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:15.696515 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:15.696517 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:15.696884 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:15.697138 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:15.698044 (+ 906us) server_negotiation.cc:299] Negotiation successful
0806 09:15:15.698292 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 09:15:15.699052 18830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:15.674507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54328 (local address 127.10.255.124:42095)
0806 09:15:15.674884 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:15.674889 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:15.675576 (+ 687us) server_negotiation.cc:407] Connection header received
0806 09:15:15.675870 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:15.675877 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:15.675979 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:15.676058 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:15.678775 (+ 2717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.680400 (+ 1625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.684082 (+ 3682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:15.684898 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:15.685024 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:15.689918 (+ 4894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:15.689926 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:15.689931 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:15.689990 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:15.694166 (+ 4176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:15.696225 (+ 2059us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:15.696232 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:15.696236 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:15.696384 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:15.696853 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:15.696859 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:15.696862 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:15.697248 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:15.697485 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:15.698245 (+ 760us) server_negotiation.cc:299] Negotiation successful
0806 09:15:15.698631 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 09:15:16.411899 18886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:16.410893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.10.255.65:56703)
0806 09:15:16.411465 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:16.411599 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":298,"threads_started":1}
W20260806 09:15:16.412652 18518 heartbeater.cc:644] Failed to heartbeat to 127.10.255.126:37659 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
I20260806 09:15:16.415036 18887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:16.414021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.10.255.67:53477)
0806 09:15:16.414649 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:16.414806 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":370,"threads_started":1}
W20260806 09:15:16.415524 18813 heartbeater.cc:644] Failed to heartbeat to 127.10.255.126:37659 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
I20260806 09:15:16.426436 18888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:16.424191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.10.255.66:40009)
0806 09:15:16.426055 (+ 1864us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:16.426198 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1744,"thread_start_us":1724,"threads_started":1}
W20260806 09:15:16.427212 18670 heartbeater.cc:644] Failed to heartbeat to 127.10.255.126:37659 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
I20260806 09:15:16.939100 18889 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d08c975cad4141ee9b400d9aaf0a2271)
I20260806 09:15:16.939414 18889 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: false } }
I20260806 09:15:16.940109 18890 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d08c975cad4141ee9b400d9aaf0a2271)
I20260806 09:15:16.940398 18890 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: false } }
I20260806 09:15:16.941201 18889 leader_election.cc:288] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d08c975cad4141ee9b400d9aaf0a2271 (127.10.255.126:37659), ec89e5a865984246932e8121ee719094 (127.10.255.125:34367)
I20260806 09:15:16.942471 18891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:16.941315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.0.0.1:36158)
0806 09:15:16.941914 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:16.942186 (+ 272us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":279,"threads_started":1}
I20260806 09:15:16.942778 18890 leader_election.cc:288] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d08c975cad4141ee9b400d9aaf0a2271 (127.10.255.126:37659), 0e79a3072efc49659fe63e43e9ec9439 (127.10.255.124:42095)
W20260806 09:15:16.942883 18320 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
I20260806 09:15:16.943205 18893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:16.941901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.0.0.1:36168)
0806 09:15:16.942556 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:16.942751 (+ 195us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":363,"threads_started":1}
W20260806 09:15:16.944126 18130 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
I20260806 09:15:16.945017 18891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:16.944589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.0.0.1:36182)
0806 09:15:16.944754 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:16.944846 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260806 09:15:16.945262 18320 leader_election.cc:334] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d08c975cad4141ee9b400d9aaf0a2271 (127.10.255.126:37659): Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
I20260806 09:15:16.948483 18898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:16.947305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.0.0.1:36190)
0806 09:15:16.948103 (+ 798us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:16.948264 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":676,"thread_start_us":524,"threads_started":1}
W20260806 09:15:16.948776 18130 leader_election.cc:334] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d08c975cad4141ee9b400d9aaf0a2271 (127.10.255.126:37659): Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
I20260806 09:15:16.953248 18894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:16.942572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53250 (local address 127.10.255.125:34367)
0806 09:15:16.943739 (+ 1167us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:16.943745 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:16.943766 (+ 21us) server_negotiation.cc:407] Connection header received
0806 09:15:16.943882 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:16.943888 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:16.943993 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:16.945634 (+ 1641us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:16.945955 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:16.947304 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:16.950612 (+ 3308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:16.952046 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:16.952228 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:16.952329 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:16.952816 (+ 487us) server_negotiation.cc:299] Negotiation successful
0806 09:15:16.952946 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1045,"thread_start_us":880,"threads_started":1}
I20260806 09:15:16.953475 18892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:16.941452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:34367 (local address 127.0.0.1:53250)
0806 09:15:16.942211 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:16.942236 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:16.942381 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:16.944849 (+ 2468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:16.944855 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:16.944897 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:16.945345 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:16.945368 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:16.947561 (+ 2193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:16.947568 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:16.950428 (+ 2860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:16.950441 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:16.952311 (+ 1870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:16.952318 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:16.952537 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:16.952595 (+ 58us) client_negotiation.cc:769] Sending connection context
0806 09:15:16.952719 (+ 124us) client_negotiation.cc:240] Negotiation successful
0806 09:15:16.952983 (+ 264us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"mutex_wait_us":327,"thread_start_us":475,"threads_started":1}
I20260806 09:15:16.954447 18156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0e79a3072efc49659fe63e43e9ec9439" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "ec89e5a865984246932e8121ee719094" is_pre_election: true
I20260806 09:15:16.954923 18156 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e79a3072efc49659fe63e43e9ec9439 in term 1.
I20260806 09:15:16.955046 18893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:16.943798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42095 (local address 127.0.0.1:40846)
0806 09:15:16.944212 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:16.944239 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:16.944372 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:16.946527 (+ 2155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:16.946533 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:16.946592 (+ 59us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:16.946954 (+ 362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:16.946969 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:16.950111 (+ 3142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:16.950117 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:16.952398 (+ 2281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:16.952410 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:16.954224 (+ 1814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:16.954236 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:16.954450 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:16.954484 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 09:15:16.954544 (+ 60us) client_negotiation.cc:240] Negotiation successful
0806 09:15:16.954715 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"mutex_wait_us":22}
I20260806 09:15:16.955610 18896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:16.944282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40846 (local address 127.10.255.124:42095)
0806 09:15:16.946162 (+ 1880us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:16.946169 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:16.946191 (+ 22us) server_negotiation.cc:407] Connection header received
0806 09:15:16.946253 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:16.946257 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:16.946346 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:16.947037 (+ 691us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:16.948154 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:16.949905 (+ 1751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:16.952530 (+ 2625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:16.953946 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:16.954943 (+ 997us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:16.955026 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:16.955085 (+ 59us) server_negotiation.cc:299] Negotiation successful
0806 09:15:16.955233 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":1734,"thread_start_us":1565,"threads_started":1}
I20260806 09:15:16.955667 18323 leader_election.cc:302] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e79a3072efc49659fe63e43e9ec9439, ec89e5a865984246932e8121ee719094; no voters: d08c975cad4141ee9b400d9aaf0a2271
I20260806 09:15:16.956442 18889 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260806 09:15:16.956593 18889 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d08c975cad4141ee9b400d9aaf0a2271)
I20260806 09:15:16.956715 18889 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [term 1 FOLLOWER]: Advancing to term 2
I20260806 09:15:16.957880 18347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ec89e5a865984246932e8121ee719094" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "0e79a3072efc49659fe63e43e9ec9439" is_pre_election: true
I20260806 09:15:16.962955 18889 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: false } }
I20260806 09:15:16.963588 18347 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ec89e5a865984246932e8121ee719094 in current term 2: Already voted for candidate 0e79a3072efc49659fe63e43e9ec9439 in this term.
I20260806 09:15:16.965030 18130 leader_election.cc:302] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ec89e5a865984246932e8121ee719094; no voters: 0e79a3072efc49659fe63e43e9ec9439, d08c975cad4141ee9b400d9aaf0a2271
I20260806 09:15:16.965596 18890 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [term 1 FOLLOWER]: Advancing to term 2
I20260806 09:15:16.965636 18892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:16.965104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.0.0.1:36204)
0806 09:15:16.965315 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:16.965432 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260806 09:15:16.965631 18889 leader_election.cc:288] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [CANDIDATE]: Term 2 election: Requested vote from peers d08c975cad4141ee9b400d9aaf0a2271 (127.10.255.126:37659), ec89e5a865984246932e8121ee719094 (127.10.255.125:34367)
I20260806 09:15:16.967206 18156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0e79a3072efc49659fe63e43e9ec9439" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "ec89e5a865984246932e8121ee719094"
I20260806 09:15:16.967873 18892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:16.966596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.0.0.1:36220)
0806 09:15:16.966845 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:16.967625 (+ 780us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
W20260806 09:15:16.968079 18320 leader_election.cc:334] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d08c975cad4141ee9b400d9aaf0a2271 (127.10.255.126:37659): Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
I20260806 09:15:16.969043 18890 raft_consensus.cc:2726] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 09:15:16.973022 18156 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e79a3072efc49659fe63e43e9ec9439 in term 2.
I20260806 09:15:16.974316 18323 leader_election.cc:302] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0e79a3072efc49659fe63e43e9ec9439, ec89e5a865984246932e8121ee719094; no voters: d08c975cad4141ee9b400d9aaf0a2271
I20260806 09:15:16.974812 18889 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 09:15:16.975425 18889 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [term 2 LEADER]: Becoming Leader. State: Replica: 0e79a3072efc49659fe63e43e9ec9439, State: Running, Role: LEADER
I20260806 09:15:16.976004 18889 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: false } }
I20260806 09:15:16.978384 18899 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e79a3072efc49659fe63e43e9ec9439. Latest consensus state: current_term: 2 leader_uuid: "0e79a3072efc49659fe63e43e9ec9439" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: false } } }
I20260806 09:15:16.978840 18899 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:16.979669 18901 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:15:16.984711 18901 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:15:16.985922 18901 catalog_manager.cc:1259] Loaded cluster ID: f63b1981128744e8a739fd60116c2f6c
I20260806 09:15:16.986023 18901 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:15:16.987293 18901 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:15:16.988301 18901 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439: Loaded TSK: 0
I20260806 09:15:16.989364 18901 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:15:17.013410 18335 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54328:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:15:17.023273 18335 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:15:17.030903 18892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.030297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.0.0.1:36236)
0806 09:15:17.030586 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:17.030738 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260806 09:15:17.031435 18156 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [term 2 FOLLOWER]: Refusing update from remote peer 0e79a3072efc49659fe63e43e9ec9439: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260806 09:15:17.032501 18892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.031899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.0.0.1:36252)
0806 09:15:17.032191 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:17.032323 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260806 09:15:17.032477 18899 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260806 09:15:17.033282 18320 consensus_peers.cc:487] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 -> Peer d08c975cad4141ee9b400d9aaf0a2271 (127.10.255.126:37659): Couldn't send request to peer d08c975cad4141ee9b400d9aaf0a2271. Status: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 09:15:17.037024 18890 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e79a3072efc49659fe63e43e9ec9439. Latest consensus state: current_term: 2 leader_uuid: "0e79a3072efc49659fe63e43e9ec9439" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: false } } }
I20260806 09:15:17.037458 18890 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:15:17.039775 18889 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "0e79a3072efc49659fe63e43e9ec9439" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: false } } }
I20260806 09:15:17.041783 18889 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439 [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:17.042060 18890 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "0e79a3072efc49659fe63e43e9ec9439" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "d08c975cad4141ee9b400d9aaf0a2271" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37659 } } peers { permanent_uuid: "ec89e5a865984246932e8121ee719094" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 34367 } attrs { promote: false } } peers { permanent_uuid: "0e79a3072efc49659fe63e43e9ec9439" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42095 } attrs { promote: false } } }
I20260806 09:15:17.042469 18890 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec89e5a865984246932e8121ee719094 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:15:17.065971 18891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.053479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:41895 (local address 127.0.0.1:53730)
0806 09:15:17.053874 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:17.053899 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:17.054026 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:17.055139 (+ 1113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:17.055148 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:17.055191 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:17.055704 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:17.055721 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.058216 (+ 2495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.058232 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:17.061558 (+ 3326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:17.061589 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.064514 (+ 2925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.064528 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:17.064854 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:17.064908 (+ 54us) client_negotiation.cc:769] Sending connection context
0806 09:15:17.065004 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 09:15:17.065241 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275}
I20260806 09:15:17.067698 18907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.053915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53730 (local address 127.10.255.65:41895)
0806 09:15:17.054603 (+ 688us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:17.054615 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:17.054642 (+ 27us) server_negotiation.cc:407] Connection header received
0806 09:15:17.054778 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:17.054788 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:17.054914 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:17.055958 (+ 1044us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:17.056240 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.057943 (+ 1703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.061948 (+ 4005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.064034 (+ 2086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.066816 (+ 2782us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:17.067021 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:17.067092 (+ 71us) server_negotiation.cc:299] Negotiation successful
0806 09:15:17.067261 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":501,"thread_start_us":1209,"threads_started":1}
I20260806 09:15:17.068598 18452 tablet_service.cc:1467] Processing CreateTablet for tablet 9f6a02758994403593e20710c62fa48a (DEFAULT_TABLE table=test-table [id=a95ab2f47af9430bb6ce3c32c37e75f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:15:17.069214 18452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f6a02758994403593e20710c62fa48a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:17.076120 18891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.054078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:39139 (local address 127.0.0.1:49496)
0806 09:15:17.066290 (+ 12212us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:17.066313 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:17.066513 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:17.068724 (+ 2211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:17.068730 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:17.068791 (+ 61us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:17.068998 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:17.069015 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.070981 (+ 1966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.070988 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:17.073321 (+ 2333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:17.073345 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.075152 (+ 1807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.075162 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:17.075400 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:17.075447 (+ 47us) client_negotiation.cc:769] Sending connection context
0806 09:15:17.075529 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 09:15:17.075717 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12104,"threads_started":1}
I20260806 09:15:17.077190 18910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.054382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49496 (local address 127.10.255.67:39139)
0806 09:15:17.065072 (+ 10690us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:17.065079 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:17.068310 (+ 3231us) server_negotiation.cc:407] Connection header received
0806 09:15:17.068423 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:17.068429 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:17.068534 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:17.069181 (+ 647us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:17.069415 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.070726 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.073630 (+ 2904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.074923 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.076046 (+ 1123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:17.076397 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:17.076486 (+ 89us) server_negotiation.cc:299] Negotiation successful
0806 09:15:17.076731 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10529,"thread_start_us":10402,"threads_started":1}
I20260806 09:15:17.079852 18747 tablet_service.cc:1467] Processing CreateTablet for tablet 9f6a02758994403593e20710c62fa48a (DEFAULT_TABLE table=test-table [id=a95ab2f47af9430bb6ce3c32c37e75f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:15:17.080480 18747 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f6a02758994403593e20710c62fa48a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:17.080924 18911 tablet_bootstrap.cc:492] T 9f6a02758994403593e20710c62fa48a P f81d092a894e4c32af04f0737606f460: Bootstrap starting.
I20260806 09:15:17.083248 18911 tablet_bootstrap.cc:654] T 9f6a02758994403593e20710c62fa48a P f81d092a894e4c32af04f0737606f460: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:17.084635 18892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.053048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:43671 (local address 127.0.0.1:42494)
0806 09:15:17.053260 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:17.053279 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:17.053388 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:17.067859 (+ 14471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:17.067869 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:17.067918 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:17.068218 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:17.068234 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.078545 (+ 10311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.078558 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:17.081183 (+ 2625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:17.081217 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.083765 (+ 2548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.083772 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:17.084020 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:17.084049 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 09:15:17.084173 (+ 124us) client_negotiation.cc:240] Negotiation successful
0806 09:15:17.084337 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96}
I20260806 09:15:17.084678 18908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.053967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42494 (local address 127.10.255.66:43671)
0806 09:15:17.067247 (+ 13280us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:17.067254 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:17.067275 (+ 21us) server_negotiation.cc:407] Connection header received
0806 09:15:17.067354 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:17.067359 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:17.067465 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:17.067766 (+ 301us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:17.077518 (+ 9752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.078325 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.082599 (+ 4274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.083556 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.083733 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:17.083877 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:17.084207 (+ 330us) server_negotiation.cc:299] Negotiation successful
0806 09:15:17.084362 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13124,"thread_start_us":13575,"threads_started":1}
I20260806 09:15:17.086277 18604 tablet_service.cc:1467] Processing CreateTablet for tablet 9f6a02758994403593e20710c62fa48a (DEFAULT_TABLE table=test-table [id=a95ab2f47af9430bb6ce3c32c37e75f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:15:17.086716 18911 tablet_bootstrap.cc:492] T 9f6a02758994403593e20710c62fa48a P f81d092a894e4c32af04f0737606f460: No bootstrap required, opened a new log
I20260806 09:15:17.086894 18911 ts_tablet_manager.cc:1397] T 9f6a02758994403593e20710c62fa48a P f81d092a894e4c32af04f0737606f460: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260806 09:15:17.087224 18604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f6a02758994403593e20710c62fa48a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:17.087806 18911 raft_consensus.cc:348] T 9f6a02758994403593e20710c62fa48a P f81d092a894e4c32af04f0737606f460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aae9d56b455429982b1ef53f4a2851e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43671 } } peers { permanent_uuid: "f81d092a894e4c32af04f0737606f460" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41895 } } peers { permanent_uuid: "49c087aa22794e949203a2da505e57d7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39139 } }
I20260806 09:15:17.088135 18911 raft_consensus.cc:374] T 9f6a02758994403593e20710c62fa48a P f81d092a894e4c32af04f0737606f460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:17.088240 18911 raft_consensus.cc:729] T 9f6a02758994403593e20710c62fa48a P f81d092a894e4c32af04f0737606f460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f81d092a894e4c32af04f0737606f460, State: Initialized, Role: FOLLOWER
I20260806 09:15:17.088523 18911 consensus_queue.cc:260] T 9f6a02758994403593e20710c62fa48a P f81d092a894e4c32af04f0737606f460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aae9d56b455429982b1ef53f4a2851e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43671 } } peers { permanent_uuid: "f81d092a894e4c32af04f0737606f460" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41895 } } peers { permanent_uuid: "49c087aa22794e949203a2da505e57d7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39139 } }
I20260806 09:15:17.089522 18913 tablet_bootstrap.cc:492] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7: Bootstrap starting.
I20260806 09:15:17.092366 18913 tablet_bootstrap.cc:654] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:17.099316 18911 ts_tablet_manager.cc:1428] T 9f6a02758994403593e20710c62fa48a P f81d092a894e4c32af04f0737606f460: Time spent starting tablet: real 0.012s user 0.000s sys 0.006s
I20260806 09:15:17.102625 18915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.093247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.10.255.65:48309)
0806 09:15:17.100673 (+ 7426us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:17.102006 (+ 1333us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":7185,"thread_start_us":6940,"threads_started":1}
I20260806 09:15:17.103549 18917 tablet_bootstrap.cc:492] T 9f6a02758994403593e20710c62fa48a P 9aae9d56b455429982b1ef53f4a2851e: Bootstrap starting.
I20260806 09:15:17.106387 18917 tablet_bootstrap.cc:654] T 9f6a02758994403593e20710c62fa48a P 9aae9d56b455429982b1ef53f4a2851e: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:17.107116 18913 tablet_bootstrap.cc:492] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7: No bootstrap required, opened a new log
I20260806 09:15:17.108035 18913 ts_tablet_manager.cc:1397] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.009s
I20260806 09:15:17.108578 18517 heartbeater.cc:503] Master 127.10.255.124:42095 was elected leader, sending a full tablet report...
I20260806 09:15:17.109336 18913 raft_consensus.cc:348] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aae9d56b455429982b1ef53f4a2851e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43671 } } peers { permanent_uuid: "f81d092a894e4c32af04f0737606f460" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41895 } } peers { permanent_uuid: "49c087aa22794e949203a2da505e57d7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39139 } }
I20260806 09:15:17.109640 18913 raft_consensus.cc:374] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:17.109761 18913 raft_consensus.cc:729] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49c087aa22794e949203a2da505e57d7, State: Initialized, Role: FOLLOWER
I20260806 09:15:17.110291 18915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.109556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.10.255.65:56295)
0806 09:15:17.109973 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:17.110097 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267}
I20260806 09:15:17.110275 18913 consensus_queue.cc:260] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aae9d56b455429982b1ef53f4a2851e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43671 } } peers { permanent_uuid: "f81d092a894e4c32af04f0737606f460" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41895 } } peers { permanent_uuid: "49c087aa22794e949203a2da505e57d7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39139 } }
I20260806 09:15:17.112788 18917 tablet_bootstrap.cc:492] T 9f6a02758994403593e20710c62fa48a P 9aae9d56b455429982b1ef53f4a2851e: No bootstrap required, opened a new log
I20260806 09:15:17.113075 18917 ts_tablet_manager.cc:1397] T 9f6a02758994403593e20710c62fa48a P 9aae9d56b455429982b1ef53f4a2851e: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.001s
I20260806 09:15:17.114217 18917 raft_consensus.cc:348] T 9f6a02758994403593e20710c62fa48a P 9aae9d56b455429982b1ef53f4a2851e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aae9d56b455429982b1ef53f4a2851e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43671 } } peers { permanent_uuid: "f81d092a894e4c32af04f0737606f460" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41895 } } peers { permanent_uuid: "49c087aa22794e949203a2da505e57d7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39139 } }
I20260806 09:15:17.114581 18917 raft_consensus.cc:374] T 9f6a02758994403593e20710c62fa48a P 9aae9d56b455429982b1ef53f4a2851e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:17.114727 18917 raft_consensus.cc:729] T 9f6a02758994403593e20710c62fa48a P 9aae9d56b455429982b1ef53f4a2851e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aae9d56b455429982b1ef53f4a2851e, State: Initialized, Role: FOLLOWER
I20260806 09:15:17.115267 18917 consensus_queue.cc:260] T 9f6a02758994403593e20710c62fa48a P 9aae9d56b455429982b1ef53f4a2851e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aae9d56b455429982b1ef53f4a2851e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43671 } } peers { permanent_uuid: "f81d092a894e4c32af04f0737606f460" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41895 } } peers { permanent_uuid: "49c087aa22794e949203a2da505e57d7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39139 } }
I20260806 09:15:17.116158 18920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.114683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.10.255.67:54819)
0806 09:15:17.115387 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:17.115680 (+ 293us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":440,"threads_started":1}
I20260806 09:15:17.117599 18913 ts_tablet_manager.cc:1428] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7: Time spent starting tablet: real 0.009s user 0.002s sys 0.004s
I20260806 09:15:17.118907 18917 ts_tablet_manager.cc:1428] T 9f6a02758994403593e20710c62fa48a P 9aae9d56b455429982b1ef53f4a2851e: Time spent starting tablet: real 0.006s user 0.000s sys 0.005s
I20260806 09:15:17.118899 18812 heartbeater.cc:503] Master 127.10.255.124:42095 was elected leader, sending a full tablet report...
I20260806 09:15:17.122242 18920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.118521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.10.255.67:56725)
0806 09:15:17.121648 (+ 3127us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:17.121804 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2804}
I20260806 09:15:17.124119 18922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.119209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.10.255.66:51377)
0806 09:15:17.123483 (+ 4274us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:17.123762 (+ 279us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4054,"thread_start_us":3877,"threads_started":1}
I20260806 09:15:17.127542 18922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.126224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.10.255.66:58047)
0806 09:15:17.126695 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:17.127174 (+ 479us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
W20260806 09:15:17.233112 18815 tablet.cc:2369] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:15:17.307226 18919 raft_consensus.cc:482] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:15:17.307547 18919 raft_consensus.cc:504] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aae9d56b455429982b1ef53f4a2851e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43671 } } peers { permanent_uuid: "f81d092a894e4c32af04f0737606f460" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41895 } } peers { permanent_uuid: "49c087aa22794e949203a2da505e57d7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39139 } }
I20260806 09:15:17.309741 18919 leader_election.cc:288] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9aae9d56b455429982b1ef53f4a2851e (127.10.255.66:43671), f81d092a894e4c32af04f0737606f460 (127.10.255.65:41895)
I20260806 09:15:17.320107 18907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.310676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:50499 (local address 127.10.255.65:41895)
0806 09:15:17.310966 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:17.310975 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:17.311627 (+ 652us) server_negotiation.cc:407] Connection header received
0806 09:15:17.311751 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:17.311755 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:17.311818 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:17.311914 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:17.312483 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.313477 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.316658 (+ 3181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.318428 (+ 1770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.318697 (+ 269us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:17.318787 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:17.319560 (+ 773us) server_negotiation.cc:299] Negotiation successful
0806 09:15:17.319803 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 09:15:17.320111 18908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.310480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:37487 (local address 127.10.255.66:43671)
0806 09:15:17.310742 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:17.310749 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:17.310777 (+ 28us) server_negotiation.cc:407] Connection header received
0806 09:15:17.311194 (+ 417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:17.311208 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:17.311280 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:17.311367 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:17.312113 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.313176 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.316658 (+ 3482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.318427 (+ 1769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.318698 (+ 271us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:17.318787 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:17.319561 (+ 774us) server_negotiation.cc:299] Negotiation successful
0806 09:15:17.319766 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260806 09:15:17.320415 18920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.310064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:43671 (local address 127.10.255.67:37487)
0806 09:15:17.310347 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:17.310372 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:17.310877 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:17.311467 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:17.311476 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:17.311514 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:17.311899 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:17.311918 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.313364 (+ 1446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.313370 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:17.316212 (+ 2842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:17.316242 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.318875 (+ 2633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.318885 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:17.319207 (+ 322us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:17.319284 (+ 77us) client_negotiation.cc:769] Sending connection context
0806 09:15:17.319435 (+ 151us) client_negotiation.cc:240] Negotiation successful
0806 09:15:17.319689 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":306}
I20260806 09:15:17.320492 18923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.310511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:41895 (local address 127.10.255.67:50499)
0806 09:15:17.311426 (+ 915us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:17.311448 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:17.311609 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:17.311965 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:17.311973 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:17.312009 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:17.312305 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:17.312315 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.313616 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.313622 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:17.316211 (+ 2589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:17.316242 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.318875 (+ 2633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.318885 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:17.319209 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:17.319283 (+ 74us) client_negotiation.cc:769] Sending connection context
0806 09:15:17.319435 (+ 152us) client_negotiation.cc:240] Negotiation successful
0806 09:15:17.319689 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":727,"mutex_wait_us":198,"thread_start_us":466,"threads_started":1}
I20260806 09:15:17.321894 18624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f6a02758994403593e20710c62fa48a" candidate_uuid: "49c087aa22794e949203a2da505e57d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aae9d56b455429982b1ef53f4a2851e" is_pre_election: true
I20260806 09:15:17.322190 18624 raft_consensus.cc:2454] T 9f6a02758994403593e20710c62fa48a P 9aae9d56b455429982b1ef53f4a2851e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49c087aa22794e949203a2da505e57d7 in term 0.
I20260806 09:15:17.322280 18472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f6a02758994403593e20710c62fa48a" candidate_uuid: "49c087aa22794e949203a2da505e57d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81d092a894e4c32af04f0737606f460" is_pre_election: true
I20260806 09:15:17.323175 18472 raft_consensus.cc:2454] T 9f6a02758994403593e20710c62fa48a P f81d092a894e4c32af04f0737606f460 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 49c087aa22794e949203a2da505e57d7 in term 0.
I20260806 09:15:17.323161 18700 leader_election.cc:302] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49c087aa22794e949203a2da505e57d7, 9aae9d56b455429982b1ef53f4a2851e; no voters:
I20260806 09:15:17.323729 18919 raft_consensus.cc:2781] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:15:17.323980 18919 raft_consensus.cc:482] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:15:17.324137 18919 raft_consensus.cc:3037] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:17.326948 18919 raft_consensus.cc:504] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aae9d56b455429982b1ef53f4a2851e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43671 } } peers { permanent_uuid: "f81d092a894e4c32af04f0737606f460" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41895 } } peers { permanent_uuid: "49c087aa22794e949203a2da505e57d7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39139 } }
I20260806 09:15:17.327764 18919 leader_election.cc:288] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7 [CANDIDATE]: Term 1 election: Requested vote from peers 9aae9d56b455429982b1ef53f4a2851e (127.10.255.66:43671), f81d092a894e4c32af04f0737606f460 (127.10.255.65:41895)
I20260806 09:15:17.328991 18624 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f6a02758994403593e20710c62fa48a" candidate_uuid: "49c087aa22794e949203a2da505e57d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aae9d56b455429982b1ef53f4a2851e"
I20260806 09:15:17.329157 18472 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f6a02758994403593e20710c62fa48a" candidate_uuid: "49c087aa22794e949203a2da505e57d7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f81d092a894e4c32af04f0737606f460"
I20260806 09:15:17.329334 18624 raft_consensus.cc:3037] T 9f6a02758994403593e20710c62fa48a P 9aae9d56b455429982b1ef53f4a2851e [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:17.329523 18472 raft_consensus.cc:3037] T 9f6a02758994403593e20710c62fa48a P f81d092a894e4c32af04f0737606f460 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:17.332100 18624 raft_consensus.cc:2454] T 9f6a02758994403593e20710c62fa48a P 9aae9d56b455429982b1ef53f4a2851e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49c087aa22794e949203a2da505e57d7 in term 1.
I20260806 09:15:17.332369 18472 raft_consensus.cc:2454] T 9f6a02758994403593e20710c62fa48a P f81d092a894e4c32af04f0737606f460 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 49c087aa22794e949203a2da505e57d7 in term 1.
I20260806 09:15:17.332780 18700 leader_election.cc:302] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49c087aa22794e949203a2da505e57d7, 9aae9d56b455429982b1ef53f4a2851e; no voters:
I20260806 09:15:17.333159 18919 raft_consensus.cc:2781] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:15:17.333731 18919 raft_consensus.cc:686] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7 [term 1 LEADER]: Becoming Leader. State: Replica: 49c087aa22794e949203a2da505e57d7, State: Running, Role: LEADER
I20260806 09:15:17.334242 18919 consensus_queue.cc:237] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aae9d56b455429982b1ef53f4a2851e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43671 } } peers { permanent_uuid: "f81d092a894e4c32af04f0737606f460" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41895 } } peers { permanent_uuid: "49c087aa22794e949203a2da505e57d7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39139 } }
I20260806 09:15:17.335472 18920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.334943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.10.255.67:45879)
0806 09:15:17.335174 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:17.335304 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260806 09:15:17.338825 18335 catalog_manager.cc:5495] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 49c087aa22794e949203a2da505e57d7 (127.10.255.67). New cstate: current_term: 1 leader_uuid: "49c087aa22794e949203a2da505e57d7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9aae9d56b455429982b1ef53f4a2851e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f81d092a894e4c32af04f0737606f460" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "49c087aa22794e949203a2da505e57d7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39139 } health_report { overall_health: HEALTHY } } }
I20260806 09:15:17.376257 18910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.368366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49510 (local address 127.10.255.67:39139)
0806 09:15:17.368780 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:17.368790 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:17.368813 (+ 23us) server_negotiation.cc:407] Connection header received
0806 09:15:17.369259 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:17.369265 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:17.369661 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:17.369888 (+ 227us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:15:17.370750 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.371652 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.373538 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.374021 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.374135 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:17.374742 (+ 607us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:15:17.375477 (+ 735us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:15:17.375624 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:17.375915 (+ 291us) server_negotiation.cc:299] Negotiation successful
0806 09:15:17.376018 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 09:15:17.381584 18624 raft_consensus.cc:1261] T 9f6a02758994403593e20710c62fa48a P 9aae9d56b455429982b1ef53f4a2851e [term 1 FOLLOWER]: Refusing update from remote peer 49c087aa22794e949203a2da505e57d7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:15:17.381980 18472 raft_consensus.cc:1261] T 9f6a02758994403593e20710c62fa48a P f81d092a894e4c32af04f0737606f460 [term 1 FOLLOWER]: Refusing update from remote peer 49c087aa22794e949203a2da505e57d7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:15:17.382570 18924 consensus_queue.cc:1035] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aae9d56b455429982b1ef53f4a2851e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:15:17.383030 18919 consensus_queue.cc:1035] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f81d092a894e4c32af04f0737606f460" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:15:17.384645 18669 heartbeater.cc:503] Master 127.10.255.124:42095 was elected leader, sending a full tablet report...
I20260806 09:15:17.386842 18922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.386228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.10.255.66:47629)
0806 09:15:17.386567 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:17.386670 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221}
I20260806 09:15:17.386821 18915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.386224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.10.255.65:46893)
0806 09:15:17.386499 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:17.386623 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149}
I20260806 09:15:17.393088 18928 mvcc.cc:205] Tried to move back new op lower bound from 7315487610386317312 to 7315487610206068736. Current Snapshot: MvccSnapshot[applied={T|T < 7315487610386317312}]
I20260806 09:15:17.394917 18929 mvcc.cc:205] Tried to move back new op lower bound from 7315487610386317312 to 7315487610206068736. Current Snapshot: MvccSnapshot[applied={T|T < 7315487610386317312}]
I20260806 09:15:17.396417 18922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.395879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.10.255.66:42603)
0806 09:15:17.396136 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:17.396240 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131}
I20260806 09:15:17.396456 18915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.395819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.10.255.65:48715)
0806 09:15:17.396153 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:17.396257 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182}
I20260806 09:15:17.396931 18920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.395868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.10.255.67:36725)
0806 09:15:17.396630 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:17.396734 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":613}
I20260806 09:15:17.414364 18336 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54328:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:15:17.414767 18336 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54328:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:15:17.422418 18336 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0e79a3072efc49659fe63e43e9ec9439: Sending DeleteTablet for 3 replicas of tablet 9f6a02758994403593e20710c62fa48a
I20260806 09:15:17.423913 18747 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f6a02758994403593e20710c62fa48a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:15:17 UTC) from {username='oryx', principal='oryx/127.10.255.124@KRBTEST.COM'} at 127.0.0.1:49496
I20260806 09:15:17.424256 18604 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f6a02758994403593e20710c62fa48a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:15:17 UTC) from {username='oryx', principal='oryx/127.10.255.124@KRBTEST.COM'} at 127.0.0.1:42494
I20260806 09:15:17.424453 18452 tablet_service.cc:1514] Processing DeleteTablet for tablet 9f6a02758994403593e20710c62fa48a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:15:17 UTC) from {username='oryx', principal='oryx/127.10.255.124@KRBTEST.COM'} at 127.0.0.1:53730
I20260806 09:15:17.427590 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 18308
I20260806 09:15:17.433660 18939 tablet_replica.cc:330] T 9f6a02758994403593e20710c62fa48a P 9aae9d56b455429982b1ef53f4a2851e: stopping tablet replica
I20260806 09:15:17.434348 18939 raft_consensus.cc:2229] T 9f6a02758994403593e20710c62fa48a P 9aae9d56b455429982b1ef53f4a2851e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:15:17.434978 18939 raft_consensus.cc:2258] T 9f6a02758994403593e20710c62fa48a P 9aae9d56b455429982b1ef53f4a2851e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:15:17.437355 18939 ts_tablet_manager.cc:1905] T 9f6a02758994403593e20710c62fa48a P 9aae9d56b455429982b1ef53f4a2851e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:15:17.437819 18940 tablet_replica.cc:330] T 9f6a02758994403593e20710c62fa48a P f81d092a894e4c32af04f0737606f460: stopping tablet replica
I20260806 09:15:17.438059 18940 raft_consensus.cc:2229] T 9f6a02758994403593e20710c62fa48a P f81d092a894e4c32af04f0737606f460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:15:17.438437 18940 raft_consensus.cc:2258] T 9f6a02758994403593e20710c62fa48a P f81d092a894e4c32af04f0737606f460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:15:17.439963 18940 ts_tablet_manager.cc:1905] T 9f6a02758994403593e20710c62fa48a P f81d092a894e4c32af04f0737606f460: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:15:17.444500 18938 tablet_replica.cc:330] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7: stopping tablet replica
I20260806 09:15:17.444842 18938 raft_consensus.cc:2229] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7 [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:15:17.445791 18938 raft_consensus.cc:2258] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:15:17.448319 18940 ts_tablet_manager.cc:1918] T 9f6a02758994403593e20710c62fa48a P f81d092a894e4c32af04f0737606f460: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:15:17.448596 18940 log.cc:1196] T 9f6a02758994403593e20710c62fa48a P f81d092a894e4c32af04f0737606f460: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-0/wal/wals/9f6a02758994403593e20710c62fa48a
I20260806 09:15:17.448594 18938 ts_tablet_manager.cc:1905] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:15:17.449187 18940 ts_tablet_manager.cc:1939] T 9f6a02758994403593e20710c62fa48a P f81d092a894e4c32af04f0737606f460: Deleting consensus metadata
I20260806 09:15:17.450791 18321 catalog_manager.cc:4841] TS f81d092a894e4c32af04f0737606f460 (127.10.255.65:41895): tablet 9f6a02758994403593e20710c62fa48a (table test-table [id=a95ab2f47af9430bb6ce3c32c37e75f5]) successfully deleted
I20260806 09:15:17.465238 18939 ts_tablet_manager.cc:1918] T 9f6a02758994403593e20710c62fa48a P 9aae9d56b455429982b1ef53f4a2851e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:15:17.465440 18939 log.cc:1196] T 9f6a02758994403593e20710c62fa48a P 9aae9d56b455429982b1ef53f4a2851e: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/9f6a02758994403593e20710c62fa48a
I20260806 09:15:17.466013 18939 ts_tablet_manager.cc:1939] T 9f6a02758994403593e20710c62fa48a P 9aae9d56b455429982b1ef53f4a2851e: Deleting consensus metadata
I20260806 09:15:17.467625 18321 catalog_manager.cc:4841] TS 9aae9d56b455429982b1ef53f4a2851e (127.10.255.66:43671): tablet 9f6a02758994403593e20710c62fa48a (table test-table [id=a95ab2f47af9430bb6ce3c32c37e75f5]) successfully deleted
I20260806 09:15:17.469053 18938 ts_tablet_manager.cc:1918] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:15:17.469262 18938 log.cc:1196] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/9f6a02758994403593e20710c62fa48a
I20260806 09:15:17.469949 18938 ts_tablet_manager.cc:1939] T 9f6a02758994403593e20710c62fa48a P 49c087aa22794e949203a2da505e57d7: Deleting consensus metadata
I20260806 09:15:17.471550 18322 catalog_manager.cc:4841] TS 49c087aa22794e949203a2da505e57d7 (127.10.255.67:39139): tablet 9f6a02758994403593e20710c62fa48a (table test-table [id=a95ab2f47af9430bb6ce3c32c37e75f5]) successfully deleted
I20260806 09:15:17.474224 18907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.431124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53746 (local address 127.10.255.65:41895)
0806 09:15:17.431497 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:17.431508 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:17.447084 (+ 15576us) server_negotiation.cc:407] Connection header received
0806 09:15:17.447550 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:17.447557 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:17.447663 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:17.447755 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:17.452033 (+ 4278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.453316 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.455604 (+ 2288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.456640 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.456806 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:17.463528 (+ 6722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:17.463555 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:17.463579 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:17.463642 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:17.469317 (+ 5675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:17.470793 (+ 1476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:17.470804 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:17.470808 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:17.471029 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:17.471611 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:17.471617 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:17.471620 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:17.472306 (+ 686us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:17.472557 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:17.473262 (+ 705us) server_negotiation.cc:299] Negotiation successful
0806 09:15:17.473563 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260806 09:15:17.475113 18512 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:17.616178 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 18308
I20260806 09:15:17.639519 18943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.638530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.0.0.1:36258)
0806 09:15:17.639090 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:17.639223 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":283,"threads_started":1}
I20260806 09:15:17.641283 18943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.640811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.0.0.1:36272)
0806 09:15:17.640998 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:17.641119 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260806 09:15:17.644765 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 18529
I20260806 09:15:17.662431 18908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.645726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42502 (local address 127.10.255.66:43671)
0806 09:15:17.645926 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:17.645932 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:17.645954 (+ 22us) server_negotiation.cc:407] Connection header received
0806 09:15:17.646134 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:17.646141 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:17.646230 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:17.646369 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:17.647821 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.649036 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.650935 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.651631 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.651785 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:17.654745 (+ 2960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:17.654776 (+ 31us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:17.654798 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:17.654853 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:17.659116 (+ 4263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:17.660006 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:17.660018 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:17.660025 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:17.660217 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:17.660624 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:17.660630 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:17.660634 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:17.661178 (+ 544us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:17.661514 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:17.661776 (+ 262us) server_negotiation.cc:299] Negotiation successful
0806 09:15:17.662035 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 09:15:17.663295 18664 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:17.767560 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 18529
I20260806 09:15:17.788991 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 18682
I20260806 09:15:17.809002 18910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:17.789997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49526 (local address 127.10.255.67:39139)
0806 09:15:17.790197 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:17.790201 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:17.790316 (+ 115us) server_negotiation.cc:407] Connection header received
0806 09:15:17.790648 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:17.790653 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:17.790724 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:17.790828 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:17.793018 (+ 2190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.793946 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.796002 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:17.796554 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:17.796676 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:17.800721 (+ 4045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:17.800741 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:17.800759 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:17.800807 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:17.804992 (+ 4185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:17.806149 (+ 1157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:17.806162 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:17.806164 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:17.806358 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:17.806872 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:17.806876 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:17.806878 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:17.807334 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:17.807643 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:17.808332 (+ 689us) server_negotiation.cc:299] Negotiation successful
0806 09:15:17.808600 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 09:15:17.809899 18807 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:17.952244 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 18682
I20260806 09:15:17.984788 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 18006
I20260806 09:15:17.986090 18176 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:18.115458 18943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:18.114646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.0.0.1:36280)
0806 09:15:18.115145 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:18.115262 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338}
I20260806 09:15:18.116482 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 18006
I20260806 09:15:18.116883 18943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:18.116333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37659 (local address 127.0.0.1:36290)
0806 09:15:18.116554 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:18.116703 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:37659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260806 09:15:18.141242 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 18112
I20260806 09:15:18.142536 18367 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:18.276597 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 18112
2026-08-06T09:15:18Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (11228 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:15:18 dist-test-slave-mvvj krb5kdc[18951](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:15:18 dist-test-slave-mvvj krb5kdc[18951](info): set up 2 sockets
Aug 06 09:15:18 dist-test-slave-mvvj krb5kdc[18951](info): commencing operation
krb5kdc: starting...
W20260806 09:15:19.435698 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.002s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:15:19 dist-test-slave-mvvj krb5kdc[18951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007719, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:15:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:15:19Z Disabled control of system clock
WARNING: no policy specified for oryx/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.126.keytab.
Entry for principal oryx/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.126.keytab.
I20260806 09:15:19.705737 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:42397
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.126.keytab
--principal=oryx/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:42397
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:15:20.085819 18964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:20.086349 18964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:20.086457 18964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:20.094789 18964 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:15:20.094934 18964 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 09:15:20.094978 18964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:20.095038 18964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:20.095082 18964 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:15:20.095147 18964 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:15:20.107096 18964 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:42397
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.126.keytab
--principal=oryx/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:42397
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:20.108613 18964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:20.110033 18964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:20.125798 18969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:20.125798 18970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:20.126394 18972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:20.126557 18964 server_base.cc:1034] running on GCE node
I20260806 09:15:20.127712 18964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:20.129643 18964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:20.130955 18964 hybrid_clock.cc:648] HybridClock initialized: now 1786007720130862 us; error 70 us; skew 500 ppm
I20260806 09:15:20.131531 18964 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:20 dist-test-slave-mvvj krb5kdc[18951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007720, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:20.143059 18964 init.cc:377] Logged in from keytab as oryx/127.10.255.126@KRBTEST.COM (short username oryx)
I20260806 09:15:20.145581 18964 webserver.cc:460] Webserver started at http://127.10.255.126:36357/ using document root <none> and password file <none>
I20260806 09:15:20.146479 18964 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:20.146589 18964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:20.146960 18964 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:20.150475 18964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "299a35aab9024488a78720fd6e7d9ba2"
format_stamp: "Formatted at 2026-08-06 09:15:20 on dist-test-slave-mvvj"
server_key: "eda041b99a569e3c99f5975b6c165f9a"
server_key_iv: "cb599ff9a2921d937f4f55325a3f5e37"
server_key_version: "encryptionkey@0"
I20260806 09:15:20.151432 18964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "299a35aab9024488a78720fd6e7d9ba2"
format_stamp: "Formatted at 2026-08-06 09:15:20 on dist-test-slave-mvvj"
server_key: "eda041b99a569e3c99f5975b6c165f9a"
server_key_iv: "cb599ff9a2921d937f4f55325a3f5e37"
server_key_version: "encryptionkey@0"
I20260806 09:15:20.157608 18964 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260806 09:15:20.161993 18979 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:20.163921 18964 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 09:15:20.164170 18964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "299a35aab9024488a78720fd6e7d9ba2"
format_stamp: "Formatted at 2026-08-06 09:15:20 on dist-test-slave-mvvj"
server_key: "eda041b99a569e3c99f5975b6c165f9a"
server_key_iv: "cb599ff9a2921d937f4f55325a3f5e37"
server_key_version: "encryptionkey@0"
I20260806 09:15:20.164445 18964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:20.182523 18964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:20.188520 18964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:20.188865 18964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:20.214313 18964 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:42397
I20260806 09:15:20.214355 19041 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:42397 every 8 connection(s)
I20260806 09:15:20.216100 18964 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:15:20.221168 19042 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:20.224433 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 18964
I20260806 09:15:20.224694 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:15:20.225411 11261 external_mini_cluster.cc:1428] Setting key c78a6b93b07cb416b3dfbd71463c75b0
I20260806 09:15:20.235584 19042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2: Bootstrap starting.
I20260806 09:15:20.240450 19042 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2: Neither blocks nor log segments found. Creating new log.
Aug 06 09:15:20 dist-test-slave-mvvj krb5kdc[18951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007719, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM
I20260806 09:15:20.241703 19042 log.cc:824] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2: Log is configured to *not* fsync() on all Append() calls
I20260806 09:15:20.245486 19042 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2: No bootstrap required, opened a new log
I20260806 09:15:20.251820 19045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:20.227709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35652 (local address 127.10.255.126:42397)
0806 09:15:20.228695 (+ 986us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:20.228710 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:20.228759 (+ 49us) server_negotiation.cc:407] Connection header received
0806 09:15:20.230902 (+ 2143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:20.230936 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:20.231468 (+ 532us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:20.231983 (+ 515us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:20.233767 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:20.235345 (+ 1578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:20.236978 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:20.237915 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:20.238166 (+ 251us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:20.243010 (+ 4844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:20.243021 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:20.243045 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:20.243106 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:20.246932 (+ 3826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:20.247910 (+ 978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:20.247918 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:20.247925 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:20.248150 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:20.248630 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:20.248635 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:20.248637 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:20.249270 (+ 633us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:20.249605 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:20.250206 (+ 601us) server_negotiation.cc:299] Negotiation successful
0806 09:15:20.250673 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":743,"thread_start_us":431,"threads_started":1}
I20260806 09:15:20.254784 19042 raft_consensus.cc:348] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299a35aab9024488a78720fd6e7d9ba2" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42397 } }
I20260806 09:15:20.255340 19042 raft_consensus.cc:374] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:20.255482 19042 raft_consensus.cc:729] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 299a35aab9024488a78720fd6e7d9ba2, State: Initialized, Role: FOLLOWER
I20260806 09:15:20.256232 19042 consensus_queue.cc:260] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299a35aab9024488a78720fd6e7d9ba2" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42397 } }
I20260806 09:15:20.256489 19042 raft_consensus.cc:388] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:15:20.256670 19042 raft_consensus.cc:482] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:15:20.256863 19042 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:20.259536 19042 raft_consensus.cc:504] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299a35aab9024488a78720fd6e7d9ba2" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42397 } }
I20260806 09:15:20.260186 19042 leader_election.cc:302] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 299a35aab9024488a78720fd6e7d9ba2; no voters:
I20260806 09:15:20.260921 19042 leader_election.cc:288] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:15:20.261089 19047 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:15:20.261976 19047 raft_consensus.cc:686] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2 [term 1 LEADER]: Becoming Leader. State: Replica: 299a35aab9024488a78720fd6e7d9ba2, State: Running, Role: LEADER
I20260806 09:15:20.262603 19047 consensus_queue.cc:237] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299a35aab9024488a78720fd6e7d9ba2" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42397 } }
I20260806 09:15:20.263417 19042 sys_catalog.cc:564] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:15:20.266052 19048 sys_catalog.cc:455] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "299a35aab9024488a78720fd6e7d9ba2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299a35aab9024488a78720fd6e7d9ba2" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42397 } } }
I20260806 09:15:20.266798 19048 sys_catalog.cc:458] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2 [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:20.266069 19049 sys_catalog.cc:455] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 299a35aab9024488a78720fd6e7d9ba2. Latest consensus state: current_term: 1 leader_uuid: "299a35aab9024488a78720fd6e7d9ba2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299a35aab9024488a78720fd6e7d9ba2" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42397 } } }
I20260806 09:15:20.267273 19049 sys_catalog.cc:458] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2 [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:20.272758 19055 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:15:20.278579 19055 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:15:20.290002 19055 catalog_manager.cc:1347] Generated new cluster ID: 16c3f0de7dc3472782266a80329d505f
I20260806 09:15:20.290165 19055 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:15:20.323093 19055 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:15:20.324837 19055 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:15:20.332376 19055 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2: Generated new TSK 0
I20260806 09:15:20.333396 19055 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.10.255.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.255.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.255.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.65.keytab.
Entry for principal oryx/127.10.255.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.65.keytab.
I20260806 09:15:20.405825 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42397
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.65.keytab
--principal=oryx/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:15:20.793303 19069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:20.793663 19069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:20.793843 19069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:20.801676 19069 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:20.801819 19069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:20.801980 19069 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 09:15:20.802078 19069 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:15:20.812815 19069 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.65.keytab
--principal=oryx/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.255.126:42397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:20.814316 19069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:20.815937 19069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:20.833861 19074 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:20.833969 19075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:20.833900 19077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:20.834749 19069 server_base.cc:1034] running on GCE node
I20260806 09:15:20.835649 19069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:20.836824 19069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:20.838191 19069 hybrid_clock.cc:648] HybridClock initialized: now 1786007720838111 us; error 52 us; skew 500 ppm
I20260806 09:15:20.838706 19069 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:20 dist-test-slave-mvvj krb5kdc[18951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007720, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:20.843930 19069 init.cc:377] Logged in from keytab as oryx/127.10.255.65@KRBTEST.COM (short username oryx)
I20260806 09:15:20.845971 19069 webserver.cc:460] Webserver started at http://127.10.255.65:39351/ using document root <none> and password file <none>
I20260806 09:15:20.846859 19069 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:20.847018 19069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:20.847411 19069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:20.850857 19069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "be0049159fa14dd2a7df37d951b40151"
format_stamp: "Formatted at 2026-08-06 09:15:20 on dist-test-slave-mvvj"
server_key: "0c487bda75d14803de175d43670f67d5"
server_key_iv: "99a9e2b15d42f8cca79524a51994eea0"
server_key_version: "encryptionkey@0"
I20260806 09:15:20.851807 19069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "be0049159fa14dd2a7df37d951b40151"
format_stamp: "Formatted at 2026-08-06 09:15:20 on dist-test-slave-mvvj"
server_key: "0c487bda75d14803de175d43670f67d5"
server_key_iv: "99a9e2b15d42f8cca79524a51994eea0"
server_key_version: "encryptionkey@0"
I20260806 09:15:20.858462 19069 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260806 09:15:20.863062 19084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:20.865131 19069 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.002s
I20260806 09:15:20.865381 19069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "be0049159fa14dd2a7df37d951b40151"
format_stamp: "Formatted at 2026-08-06 09:15:20 on dist-test-slave-mvvj"
server_key: "0c487bda75d14803de175d43670f67d5"
server_key_iv: "99a9e2b15d42f8cca79524a51994eea0"
server_key_version: "encryptionkey@0"
I20260806 09:15:20.865742 19069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:20.907073 19069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:20.912843 19069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:20.913198 19069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:20.916575 19069 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:20.916729 19069 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:20.916877 19069 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:20.916956 19069 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 09:15:20 dist-test-slave-mvvj krb5kdc[18951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007720, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM
I20260806 09:15:20.950171 19094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:20.918385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42397 (local address 127.10.255.65:59301)
0806 09:15:20.919369 (+ 984us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:20.919419 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:20.921831 (+ 2412us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:20.922939 (+ 1108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:20.922957 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:20.924219 (+ 1262us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:20.925474 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:20.925527 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:20.927095 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:20.927100 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:20.929214 (+ 2114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:20.929241 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:20.930679 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:20.930691 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:20.931063 (+ 372us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:20.932494 (+ 1431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:20.932539 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:20.937389 (+ 4850us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:20.942977 (+ 5588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:20.942990 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:20.943019 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:20.944006 (+ 987us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:20.944592 (+ 586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:20.944600 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:20.944607 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:20.945061 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:20.945852 (+ 791us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:20.945866 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:20.946636 (+ 770us) client_negotiation.cc:769] Sending connection context
0806 09:15:20.947149 (+ 513us) client_negotiation.cc:240] Negotiation successful
0806 09:15:20.948113 (+ 964us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":677,"thread_start_us":419,"threads_started":1}
I20260806 09:15:20.950479 19093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:20.917551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:59301 (local address 127.10.255.126:42397)
0806 09:15:20.918104 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:20.918109 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:20.919628 (+ 1519us) server_negotiation.cc:407] Connection header received
0806 09:15:20.922174 (+ 2546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:20.922180 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:20.922300 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:20.922426 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:20.925818 (+ 3392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:20.926898 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:20.929438 (+ 2540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:20.930290 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:20.930491 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:20.937837 (+ 7346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:20.937847 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:20.937851 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:20.937905 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:20.942707 (+ 4802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:20.944180 (+ 1473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:20.944187 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:20.944191 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:20.944416 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:20.945269 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:20.945276 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:20.945286 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:20.945672 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:20.945864 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:20.949478 (+ 3614us) server_negotiation.cc:299] Negotiation successful
0806 09:15:20.949880 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":310,"threads_started":1}
I20260806 09:15:20.971146 19069 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:37063
I20260806 09:15:20.971202 19206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:37063 every 8 connection(s)
I20260806 09:15:20.973183 19069 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:15:20.976912 19207 heartbeater.cc:347] Connected to a master server at 127.10.255.126:42397
I20260806 09:15:20.977246 19207 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:20.977737 19093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:20.958023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:46199 (local address 127.10.255.126:42397)
0806 09:15:20.958288 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:20.958297 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:20.959056 (+ 759us) server_negotiation.cc:407] Connection header received
0806 09:15:20.959197 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:20.959205 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:20.959310 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:20.959481 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:20.961500 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:20.962782 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:20.964900 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:20.965731 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:20.965916 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:20.969201 (+ 3285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:20.969208 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:20.969211 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:20.969249 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:20.973173 (+ 3924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:20.974871 (+ 1698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:20.974926 (+ 55us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:20.974929 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:20.975130 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:20.975697 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:20.975702 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:20.975704 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:20.976158 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:20.976326 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:20.977038 (+ 712us) server_negotiation.cc:299] Negotiation successful
0806 09:15:20.977361 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260806 09:15:20.978370 19207 heartbeater.cc:511] Master 127.10.255.126:42397 requested a full tablet report, sending...
I20260806 09:15:20.978816 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 19069
I20260806 09:15:20.978927 19181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:20.958041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42397 (local address 127.10.255.65:46199)
0806 09:15:20.958884 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:20.958907 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:20.959063 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:20.959551 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:20.959557 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:20.960565 (+ 1008us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:20.961162 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:20.961187 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:20.962967 (+ 1780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:20.962975 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:20.964671 (+ 1696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:20.964701 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:20.966299 (+ 1598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:20.966308 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:20.966619 (+ 311us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:20.967588 (+ 969us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:20.967623 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:20.968926 (+ 1303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:20.973757 (+ 4831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:20.973762 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:20.973765 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:20.974664 (+ 899us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:20.975374 (+ 710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:20.975380 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:20.975384 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:20.975546 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:20.976395 (+ 849us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:20.976400 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:20.976672 (+ 272us) client_negotiation.cc:769] Sending connection context
0806 09:15:20.976860 (+ 188us) client_negotiation.cc:240] Negotiation successful
0806 09:15:20.977548 (+ 688us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":435,"threads_started":1}
I20260806 09:15:20.979063 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:15:20.980628 11261 external_mini_cluster.cc:1428] Setting key 266251f05ffb6229f43d77694d254dff
I20260806 09:15:20.983004 18995 ts_manager.cc:194] Registered new tserver with Master: be0049159fa14dd2a7df37d951b40151 (127.10.255.65:37063)
I20260806 09:15:20.985968 18995 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.255.65@KRBTEST.COM'} at 127.10.255.65:59301
WARNING: no policy specified for oryx/127.10.255.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.255.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.255.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.66.keytab.
Entry for principal oryx/127.10.255.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.66.keytab.
I20260806 09:15:21.049139 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42397
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.66.keytab
--principal=oryx/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:15:21.444500 19211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:21.444908 19211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:21.445113 19211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:21.454339 19211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:21.454546 19211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:21.454710 19211 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 09:15:21.454864 19211 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:15:21.470935 19211 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.66.keytab
--principal=oryx/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.255.126:42397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:21.472589 19211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:21.474531 19211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:21.492228 19217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:21.492285 19219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:21.492192 19216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:21.493546 19211 server_base.cc:1034] running on GCE node
I20260806 09:15:21.494338 19211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:21.495558 19211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:21.496872 19211 hybrid_clock.cc:648] HybridClock initialized: now 1786007721496771 us; error 76 us; skew 500 ppm
I20260806 09:15:21.497279 19211 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:21 dist-test-slave-mvvj krb5kdc[18951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007721, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:21.501798 19211 init.cc:377] Logged in from keytab as oryx/127.10.255.66@KRBTEST.COM (short username oryx)
I20260806 09:15:21.504673 19211 webserver.cc:460] Webserver started at http://127.10.255.66:35143/ using document root <none> and password file <none>
I20260806 09:15:21.505800 19211 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:21.505997 19211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:21.506398 19211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:21.510648 19211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "f16758241ddd471497d21bbf2cf9124c"
format_stamp: "Formatted at 2026-08-06 09:15:21 on dist-test-slave-mvvj"
server_key: "b541312fd3ed85faf8f81d0c038e25a2"
server_key_iv: "a93f9933c84298c4847e1e199f8225d9"
server_key_version: "encryptionkey@0"
I20260806 09:15:21.511723 19211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "f16758241ddd471497d21bbf2cf9124c"
format_stamp: "Formatted at 2026-08-06 09:15:21 on dist-test-slave-mvvj"
server_key: "b541312fd3ed85faf8f81d0c038e25a2"
server_key_iv: "a93f9933c84298c4847e1e199f8225d9"
server_key_version: "encryptionkey@0"
I20260806 09:15:21.519371 19211 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260806 09:15:21.524621 19226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:21.526402 19211 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260806 09:15:21.526669 19211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "f16758241ddd471497d21bbf2cf9124c"
format_stamp: "Formatted at 2026-08-06 09:15:21 on dist-test-slave-mvvj"
server_key: "b541312fd3ed85faf8f81d0c038e25a2"
server_key_iv: "a93f9933c84298c4847e1e199f8225d9"
server_key_version: "encryptionkey@0"
I20260806 09:15:21.526953 19211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:21.572688 19211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:21.579375 19211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:21.579789 19211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:21.583027 19211 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:21.583164 19211 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:21.583338 19211 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:21.583446 19211 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 09:15:21 dist-test-slave-mvvj krb5kdc[18951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007721, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM
I20260806 09:15:21.619143 19235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:21.584404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:52417 (local address 127.10.255.126:42397)
0806 09:15:21.584944 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:21.584949 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:21.586644 (+ 1695us) server_negotiation.cc:407] Connection header received
0806 09:15:21.590003 (+ 3359us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:21.590014 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:21.590150 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:21.590293 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:21.593518 (+ 3225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:21.594870 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:21.598687 (+ 3817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:21.599138 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:21.599258 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:21.606741 (+ 7483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:21.606755 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:21.606764 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:21.606834 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:21.611998 (+ 5164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:21.613733 (+ 1735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:21.613742 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:21.613749 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:21.614008 (+ 259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:21.614946 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:21.614953 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:21.614956 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:21.615358 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:21.615601 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:21.617677 (+ 2076us) server_negotiation.cc:299] Negotiation successful
0806 09:15:21.618387 (+ 710us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":320,"threads_started":1}
I20260806 09:15:21.622743 19236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:21.585208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42397 (local address 127.10.255.66:52417)
0806 09:15:21.586375 (+ 1167us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:21.586426 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:21.589287 (+ 2861us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:21.590739 (+ 1452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:21.590749 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:21.591895 (+ 1146us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:21.593138 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:21.593187 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:21.595183 (+ 1996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:21.595193 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:21.598430 (+ 3237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:21.598472 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:21.599382 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:21.599388 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:21.599956 (+ 568us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:21.601306 (+ 1350us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:21.601356 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:21.606245 (+ 4889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:21.612338 (+ 6093us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:21.612357 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:21.612402 (+ 45us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:21.613462 (+ 1060us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:21.614203 (+ 741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:21.614213 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:21.614219 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:21.614664 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:21.615541 (+ 877us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:21.615556 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:21.616898 (+ 1342us) client_negotiation.cc:769] Sending connection context
0806 09:15:21.617436 (+ 538us) client_negotiation.cc:240] Negotiation successful
0806 09:15:21.618887 (+ 1451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":828,"thread_start_us":550,"threads_started":1}
I20260806 09:15:21.644228 19211 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:44785
I20260806 09:15:21.644343 19347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:44785 every 8 connection(s)
I20260806 09:15:21.646262 19211 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:15:21.648972 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 19211
I20260806 09:15:21.649195 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:15:21.649712 11261 external_mini_cluster.cc:1428] Setting key 9f6b1b05f9c7afd0d2d2372629a40f88
I20260806 09:15:21.650701 19348 heartbeater.cc:347] Connected to a master server at 127.10.255.126:42397
I20260806 09:15:21.651516 19348 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:21.652616 19348 heartbeater.cc:511] Master 127.10.255.126:42397 requested a full tablet report, sending...
I20260806 09:15:21.654525 18995 ts_manager.cc:194] Registered new tserver with Master: f16758241ddd471497d21bbf2cf9124c (127.10.255.66:44785)
I20260806 09:15:21.655898 18995 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.255.66@KRBTEST.COM'} at 127.10.255.66:52417
I20260806 09:15:21.662873 19339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:21.637232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42397 (local address 127.10.255.66:37475)
0806 09:15:21.638116 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:21.638137 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:21.638333 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:21.638864 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:21.638871 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:21.639466 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:21.640601 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:21.640626 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:21.642578 (+ 1952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:21.642590 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:21.644109 (+ 1519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:21.644139 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:21.645317 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:21.645324 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:21.645472 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:21.646333 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:21.646485 (+ 152us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:21.647907 (+ 1422us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:21.652926 (+ 5019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:21.652932 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:21.652937 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:21.653628 (+ 691us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:21.660476 (+ 6848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:21.660486 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:21.660494 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:21.660718 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:21.661588 (+ 870us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:21.661593 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:21.661804 (+ 211us) client_negotiation.cc:769] Sending connection context
0806 09:15:21.661965 (+ 161us) client_negotiation.cc:240] Negotiation successful
0806 09:15:21.662306 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":716,"thread_start_us":546,"threads_started":1}
I20260806 09:15:21.663031 19235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:21.637214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:37475 (local address 127.10.255.126:42397)
0806 09:15:21.637491 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:21.637499 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:21.638269 (+ 770us) server_negotiation.cc:407] Connection header received
0806 09:15:21.638515 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:21.638527 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:21.638661 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:21.638824 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:21.640896 (+ 2072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:21.642342 (+ 1446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:21.644368 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:21.645084 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:21.645251 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:21.648283 (+ 3032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:21.648296 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:21.648304 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:21.648360 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:21.652693 (+ 4333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:21.660062 (+ 7369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:21.660069 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:21.660071 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:21.660325 (+ 254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:21.660890 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:21.660895 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:21.660898 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:21.661398 (+ 500us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:21.661632 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:21.662239 (+ 607us) server_negotiation.cc:299] Negotiation successful
0806 09:15:21.662612 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
WARNING: no policy specified for oryx/127.10.255.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.255.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.255.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.67.keytab.
Entry for principal oryx/127.10.255.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.67.keytab.
I20260806 09:15:21.721282 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42397
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.67.keytab
--principal=oryx/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:15:21.990201 19207 heartbeater.cc:503] Master 127.10.255.126:42397 was elected leader, sending a full tablet report...
W20260806 09:15:22.130815 19352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:22.131225 19352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:22.131421 19352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:22.139583 19352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:22.139801 19352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:22.140020 19352 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 09:15:22.140180 19352 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:15:22.153148 19352 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.67.keytab
--principal=oryx/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.255.126:42397
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:22.154726 19352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:22.156386 19352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:22.173269 19357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:22.173295 19358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:22.173363 19360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:22.174768 19352 server_base.cc:1034] running on GCE node
I20260806 09:15:22.175559 19352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:22.177037 19352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:22.178391 19352 hybrid_clock.cc:648] HybridClock initialized: now 1786007722178285 us; error 42 us; skew 500 ppm
I20260806 09:15:22.178856 19352 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:22 dist-test-slave-mvvj krb5kdc[18951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007722, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:22.182917 19352 init.cc:377] Logged in from keytab as oryx/127.10.255.67@KRBTEST.COM (short username oryx)
I20260806 09:15:22.184731 19352 webserver.cc:460] Webserver started at http://127.10.255.67:36797/ using document root <none> and password file <none>
I20260806 09:15:22.185562 19352 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:22.185714 19352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:22.186080 19352 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:22.189989 19352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "1c6e114c999d46ec9330a8a6afdc5bd5"
format_stamp: "Formatted at 2026-08-06 09:15:22 on dist-test-slave-mvvj"
server_key: "359c63724ba4aa3f87d7dbb98927f371"
server_key_iv: "e2068f0a91851087205a33c14e981a51"
server_key_version: "encryptionkey@0"
I20260806 09:15:22.191138 19352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "1c6e114c999d46ec9330a8a6afdc5bd5"
format_stamp: "Formatted at 2026-08-06 09:15:22 on dist-test-slave-mvvj"
server_key: "359c63724ba4aa3f87d7dbb98927f371"
server_key_iv: "e2068f0a91851087205a33c14e981a51"
server_key_version: "encryptionkey@0"
I20260806 09:15:22.197539 19352 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260806 09:15:22.202296 19367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:22.204265 19352 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260806 09:15:22.204550 19352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "1c6e114c999d46ec9330a8a6afdc5bd5"
format_stamp: "Formatted at 2026-08-06 09:15:22 on dist-test-slave-mvvj"
server_key: "359c63724ba4aa3f87d7dbb98927f371"
server_key_iv: "e2068f0a91851087205a33c14e981a51"
server_key_version: "encryptionkey@0"
I20260806 09:15:22.204877 19352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:22.234879 19352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:22.240080 19352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:22.240417 19352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:22.243714 19352 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:22.243865 19352 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:22.244016 19352 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:22.244107 19352 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 09:15:22 dist-test-slave-mvvj krb5kdc[18951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007722, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM
I20260806 09:15:22.272774 19376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:22.244746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:51205 (local address 127.10.255.126:42397)
0806 09:15:22.245300 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:22.245307 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:22.246826 (+ 1519us) server_negotiation.cc:407] Connection header received
0806 09:15:22.249940 (+ 3114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:22.249950 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:22.250083 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:22.250240 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:22.253357 (+ 3117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.254822 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.258599 (+ 3777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.259267 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.259440 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:22.265003 (+ 5563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:22.265009 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:22.265012 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:22.265075 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:22.268661 (+ 3586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:22.269953 (+ 1292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:22.269961 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:22.269964 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:22.270148 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:22.270667 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:22.270674 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:22.270677 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:22.271057 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:22.271226 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:22.272071 (+ 845us) server_negotiation.cc:299] Negotiation successful
0806 09:15:22.272342 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":270,"threads_started":1}
I20260806 09:15:22.273855 19377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:22.245498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42397 (local address 127.10.255.67:51205)
0806 09:15:22.246576 (+ 1078us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:22.246635 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:22.249529 (+ 2894us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:22.250590 (+ 1061us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:22.250601 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:22.251703 (+ 1102us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:22.253065 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:22.253110 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.255097 (+ 1987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.255107 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:22.258254 (+ 3147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:22.258285 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.259857 (+ 1572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.259871 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:22.260225 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:22.261265 (+ 1040us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:22.261328 (+ 63us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:22.264630 (+ 3302us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:22.268917 (+ 4287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:22.268930 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:22.268953 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:22.269691 (+ 738us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:22.270282 (+ 591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:22.270288 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:22.270295 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:22.270524 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:22.271204 (+ 680us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:22.271213 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:22.271631 (+ 418us) client_negotiation.cc:769] Sending connection context
0806 09:15:22.271969 (+ 338us) client_negotiation.cc:240] Negotiation successful
0806 09:15:22.272564 (+ 595us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":728,"thread_start_us":460,"threads_started":1}
I20260806 09:15:22.305362 19437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:22.282979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42397 (local address 127.10.255.67:55247)
0806 09:15:22.284035 (+ 1056us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:22.284060 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:22.284362 (+ 302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:22.285157 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:22.285165 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:22.286229 (+ 1064us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:22.286945 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:22.286966 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.288911 (+ 1945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.288920 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:22.291601 (+ 2681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:22.291635 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.293241 (+ 1606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.293255 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:22.293531 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:22.294465 (+ 934us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:22.294653 (+ 188us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:22.296322 (+ 1669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:22.301810 (+ 5488us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:22.301824 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:22.301835 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:22.302678 (+ 843us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:22.303206 (+ 528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:22.303211 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:22.303213 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:22.303352 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:22.304118 (+ 766us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:22.304123 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:22.304444 (+ 321us) client_negotiation.cc:769] Sending connection context
0806 09:15:22.304663 (+ 219us) client_negotiation.cc:240] Negotiation successful
0806 09:15:22.304983 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":840,"thread_start_us":627,"threads_started":1}
I20260806 09:15:22.305789 19376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:22.282943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:55247 (local address 127.10.255.126:42397)
0806 09:15:22.283202 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:22.283211 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:22.284193 (+ 982us) server_negotiation.cc:407] Connection header received
0806 09:15:22.284623 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:22.284633 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:22.284747 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:22.284897 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:22.287222 (+ 2325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.288670 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.291915 (+ 3245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.292757 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.292956 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:22.296709 (+ 3753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:22.296720 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:22.296726 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:22.296787 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:22.301554 (+ 4767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:22.302861 (+ 1307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:22.302868 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:22.302871 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:22.303043 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:22.303488 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:22.303495 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:22.303498 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:22.303965 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:22.304136 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:22.304850 (+ 714us) server_negotiation.cc:299] Negotiation successful
0806 09:15:22.305216 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260806 09:15:22.307299 19352 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:34895
I20260806 09:15:22.307377 19488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:34895 every 8 connection(s)
I20260806 09:15:22.308950 19352 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:15:22.311647 19490 heartbeater.cc:347] Connected to a master server at 127.10.255.126:42397
I20260806 09:15:22.311964 19490 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:22.312733 19490 heartbeater.cc:511] Master 127.10.255.126:42397 requested a full tablet report, sending...
I20260806 09:15:22.313877 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 19352
I20260806 09:15:22.314100 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:15:22.314469 18995 ts_manager.cc:194] Registered new tserver with Master: 1c6e114c999d46ec9330a8a6afdc5bd5 (127.10.255.67:34895)
I20260806 09:15:22.314683 11261 external_mini_cluster.cc:1428] Setting key 1fb64958618e8015adfdf193a30dd95b
I20260806 09:15:22.315551 18995 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.255.67@KRBTEST.COM'} at 127.10.255.67:51205
I20260806 09:15:22.318658 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 09:15:22 dist-test-slave-mvvj krb5kdc[18951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007722, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 09:15:22 dist-test-slave-mvvj krb5kdc[18951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:22 dist-test-slave-mvvj krb5kdc[18951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
W20260806 09:15:22.380062 19376 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:22.366161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35658 (local address 127.10.255.126:42397)
0806 09:15:22.366422 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:22.366430 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:22.366670 (+ 240us) server_negotiation.cc:407] Connection header received
0806 09:15:22.366875 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:22.366880 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:22.366951 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:22.367059 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:22.369154 (+ 2095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.370127 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.371788 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.372278 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.372400 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:22.379686 (+ 7286us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35658: BlockingRecv error: recv got EOF from 127.0.0.1:35658 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
Aug 06 09:15:22 dist-test-slave-mvvj krb5kdc[18951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007722, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM
I20260806 09:15:22.399734 19376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:22.384134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35662 (local address 127.10.255.126:42397)
0806 09:15:22.384427 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:22.384435 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:22.384813 (+ 378us) server_negotiation.cc:407] Connection header received
0806 09:15:22.385105 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:22.385110 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:22.385201 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:22.385328 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:22.386666 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.387430 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.388844 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.389303 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.389458 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:22.393940 (+ 4482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:22.393947 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:22.393950 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:22.393992 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:22.396754 (+ 2762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:22.397519 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:22.397523 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:22.397526 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:22.397657 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:22.398089 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:22.398093 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:22.398095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:22.398402 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:22.398709 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:22.399148 (+ 439us) server_negotiation.cc:299] Negotiation successful
0806 09:15:22.399413 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260806 09:15:22.404309 18994 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35662:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:15:22.411993 18994 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:15:22.439968 19508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:22.426584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:34895 (local address 127.0.0.1:56784)
0806 09:15:22.427487 (+ 903us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:22.427554 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:22.427800 (+ 246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:22.429045 (+ 1245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:22.429056 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:22.429104 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:22.430182 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:22.430201 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.433071 (+ 2870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.433077 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:22.435796 (+ 2719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:22.435819 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.438692 (+ 2873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.438704 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:22.438951 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:22.439013 (+ 62us) client_negotiation.cc:769] Sending connection context
0806 09:15:22.439184 (+ 171us) client_negotiation.cc:240] Negotiation successful
0806 09:15:22.439426 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":384,"threads_started":1}
I20260806 09:15:22.441278 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:22.426987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56784 (local address 127.10.255.67:34895)
0806 09:15:22.428255 (+ 1268us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:22.428265 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:22.428300 (+ 35us) server_negotiation.cc:407] Connection header received
0806 09:15:22.428407 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:22.428415 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:22.428712 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:22.428918 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:22.430523 (+ 1605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.432780 (+ 2257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.436106 (+ 3326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.438002 (+ 1896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.438173 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:22.438515 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:22.440667 (+ 2152us) server_negotiation.cc:299] Negotiation successful
0806 09:15:22.440894 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1022,"thread_start_us":762,"threads_started":1}
I20260806 09:15:22.443805 19511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:22.428437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:44785 (local address 127.0.0.1:40254)
0806 09:15:22.429045 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:22.429066 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:22.429209 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:22.431691 (+ 2482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:22.431697 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:22.431728 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:22.432357 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:22.432373 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.436294 (+ 3921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.436300 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:22.438733 (+ 2433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:22.438749 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.442807 (+ 4058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.442816 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:22.443021 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:22.443133 (+ 112us) client_negotiation.cc:769] Sending connection context
0806 09:15:22.443232 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 09:15:22.443393 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"mutex_wait_us":53,"thread_start_us":313,"threads_started":1}
I20260806 09:15:22.444161 19510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:22.428223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40254 (local address 127.10.255.66:44785)
0806 09:15:22.428899 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:22.428909 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:22.429352 (+ 443us) server_negotiation.cc:407] Connection header received
0806 09:15:22.429470 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:22.429479 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:22.429720 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:22.429938 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:22.432772 (+ 2834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.436100 (+ 3328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.440696 (+ 4596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.442526 (+ 1830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.442721 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:22.442990 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:22.443361 (+ 371us) server_negotiation.cc:299] Negotiation successful
0806 09:15:22.443562 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":339,"threads_started":1}
I20260806 09:15:22.446832 19418 tablet_service.cc:1467] Processing CreateTablet for tablet 81cd576c98f2445db6cce3cb011a5433 (DEFAULT_TABLE table=test-table [id=0765ee560c1f4e40913977c34ee85c40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:15:22.448518 19418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81cd576c98f2445db6cce3cb011a5433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:22.449298 19277 tablet_service.cc:1467] Processing CreateTablet for tablet 81cd576c98f2445db6cce3cb011a5433 (DEFAULT_TABLE table=test-table [id=0765ee560c1f4e40913977c34ee85c40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:15:22.450778 19508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:22.429120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:37063 (local address 127.0.0.1:40298)
0806 09:15:22.440299 (+ 11179us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:22.440322 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:22.440436 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:22.442867 (+ 2431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:22.442873 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:22.442905 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:22.443167 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:22.443178 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.445722 (+ 2544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.445729 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:22.447583 (+ 1854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:22.447605 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.449796 (+ 2191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.449804 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:22.450076 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:22.450119 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 09:15:22.450232 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 09:15:22.450440 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11061,"mutex_wait_us":6,"thread_start_us":13171,"threads_started":1}
I20260806 09:15:22.450852 19513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:22.429603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40298 (local address 127.10.255.65:37063)
0806 09:15:22.442076 (+ 12473us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:22.442086 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:22.442120 (+ 34us) server_negotiation.cc:407] Connection header received
0806 09:15:22.442240 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:22.442250 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:22.442593 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:22.443420 (+ 827us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:22.443660 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.445518 (+ 1858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.447783 (+ 2265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.449552 (+ 1769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.449738 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:22.449979 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:22.450321 (+ 342us) server_negotiation.cc:299] Negotiation successful
0806 09:15:22.450518 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12260,"thread_start_us":12143,"threads_started":1}
I20260806 09:15:22.451045 19277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81cd576c98f2445db6cce3cb011a5433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:22.454627 19136 tablet_service.cc:1467] Processing CreateTablet for tablet 81cd576c98f2445db6cce3cb011a5433 (DEFAULT_TABLE table=test-table [id=0765ee560c1f4e40913977c34ee85c40]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:15:22.456159 19136 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 81cd576c98f2445db6cce3cb011a5433. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:22.466446 19514 tablet_bootstrap.cc:492] T 81cd576c98f2445db6cce3cb011a5433 P f16758241ddd471497d21bbf2cf9124c: Bootstrap starting.
I20260806 09:15:22.468905 19515 tablet_bootstrap.cc:492] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5: Bootstrap starting.
I20260806 09:15:22.471624 19514 tablet_bootstrap.cc:654] T 81cd576c98f2445db6cce3cb011a5433 P f16758241ddd471497d21bbf2cf9124c: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:22.472892 19515 tablet_bootstrap.cc:654] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:22.473100 19514 log.cc:824] T 81cd576c98f2445db6cce3cb011a5433 P f16758241ddd471497d21bbf2cf9124c: Log is configured to *not* fsync() on all Append() calls
I20260806 09:15:22.474151 19516 tablet_bootstrap.cc:492] T 81cd576c98f2445db6cce3cb011a5433 P be0049159fa14dd2a7df37d951b40151: Bootstrap starting.
I20260806 09:15:22.474371 19515 log.cc:824] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5: Log is configured to *not* fsync() on all Append() calls
I20260806 09:15:22.478765 19515 tablet_bootstrap.cc:492] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5: No bootstrap required, opened a new log
I20260806 09:15:22.478812 19516 tablet_bootstrap.cc:654] T 81cd576c98f2445db6cce3cb011a5433 P be0049159fa14dd2a7df37d951b40151: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:22.478955 19514 tablet_bootstrap.cc:492] T 81cd576c98f2445db6cce3cb011a5433 P f16758241ddd471497d21bbf2cf9124c: No bootstrap required, opened a new log
I20260806 09:15:22.479164 19515 ts_tablet_manager.cc:1397] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260806 09:15:22.479271 19514 ts_tablet_manager.cc:1397] T 81cd576c98f2445db6cce3cb011a5433 P f16758241ddd471497d21bbf2cf9124c: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20260806 09:15:22.481174 19516 log.cc:824] T 81cd576c98f2445db6cce3cb011a5433 P be0049159fa14dd2a7df37d951b40151: Log is configured to *not* fsync() on all Append() calls
I20260806 09:15:22.485224 19516 tablet_bootstrap.cc:492] T 81cd576c98f2445db6cce3cb011a5433 P be0049159fa14dd2a7df37d951b40151: No bootstrap required, opened a new log
I20260806 09:15:22.485574 19516 ts_tablet_manager.cc:1397] T 81cd576c98f2445db6cce3cb011a5433 P be0049159fa14dd2a7df37d951b40151: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.004s
I20260806 09:15:22.489401 19515 raft_consensus.cc:348] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } }
I20260806 09:15:22.489909 19515 raft_consensus.cc:374] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:22.490025 19515 raft_consensus.cc:729] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c6e114c999d46ec9330a8a6afdc5bd5, State: Initialized, Role: FOLLOWER
I20260806 09:15:22.490655 19514 raft_consensus.cc:348] T 81cd576c98f2445db6cce3cb011a5433 P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } }
I20260806 09:15:22.491158 19514 raft_consensus.cc:374] T 81cd576c98f2445db6cce3cb011a5433 P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:22.491413 19514 raft_consensus.cc:729] T 81cd576c98f2445db6cce3cb011a5433 P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f16758241ddd471497d21bbf2cf9124c, State: Initialized, Role: FOLLOWER
I20260806 09:15:22.491431 19515 consensus_queue.cc:260] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } }
I20260806 09:15:22.492143 19514 consensus_queue.cc:260] T 81cd576c98f2445db6cce3cb011a5433 P f16758241ddd471497d21bbf2cf9124c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } }
I20260806 09:15:22.494298 19514 ts_tablet_manager.cc:1428] T 81cd576c98f2445db6cce3cb011a5433 P f16758241ddd471497d21bbf2cf9124c: Time spent starting tablet: real 0.015s user 0.012s sys 0.004s
I20260806 09:15:22.495167 19348 heartbeater.cc:503] Master 127.10.255.126:42397 was elected leader, sending a full tablet report...
I20260806 09:15:22.495651 19490 heartbeater.cc:503] Master 127.10.255.126:42397 was elected leader, sending a full tablet report...
I20260806 09:15:22.496381 19515 ts_tablet_manager.cc:1428] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5: Time spent starting tablet: real 0.017s user 0.017s sys 0.001s
I20260806 09:15:22.498886 19516 raft_consensus.cc:348] T 81cd576c98f2445db6cce3cb011a5433 P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } }
I20260806 09:15:22.499636 19516 raft_consensus.cc:374] T 81cd576c98f2445db6cce3cb011a5433 P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:22.499794 19516 raft_consensus.cc:729] T 81cd576c98f2445db6cce3cb011a5433 P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be0049159fa14dd2a7df37d951b40151, State: Initialized, Role: FOLLOWER
I20260806 09:15:22.500620 19516 consensus_queue.cc:260] T 81cd576c98f2445db6cce3cb011a5433 P be0049159fa14dd2a7df37d951b40151 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } }
I20260806 09:15:22.503166 19516 ts_tablet_manager.cc:1428] T 81cd576c98f2445db6cce3cb011a5433 P be0049159fa14dd2a7df37d951b40151: Time spent starting tablet: real 0.017s user 0.010s sys 0.007s
W20260806 09:15:22.561342 19491 tablet.cc:2369] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 09:15:22.650274 19349 tablet.cc:2369] T 81cd576c98f2445db6cce3cb011a5433 P f16758241ddd471497d21bbf2cf9124c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:15:22.673740 19520 raft_consensus.cc:482] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:15:22.674142 19520 raft_consensus.cc:504] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } }
I20260806 09:15:22.676199 19520 leader_election.cc:288] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f16758241ddd471497d21bbf2cf9124c (127.10.255.66:44785), be0049159fa14dd2a7df37d951b40151 (127.10.255.65:37063)
I20260806 09:15:22.684649 19510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:22.676818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:38753 (local address 127.10.255.66:44785)
0806 09:15:22.677210 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:22.677217 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:22.677402 (+ 185us) server_negotiation.cc:407] Connection header received
0806 09:15:22.677645 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:22.677654 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:22.677754 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:22.677867 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:22.678552 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.679795 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.682192 (+ 2397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.683556 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.683691 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:22.683748 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:22.684270 (+ 522us) server_negotiation.cc:299] Negotiation successful
0806 09:15:22.684417 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185}
I20260806 09:15:22.684671 19377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:22.677064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:44785 (local address 127.10.255.67:38753)
0806 09:15:22.677275 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:22.677295 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:22.677438 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:22.677942 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:22.677952 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:22.678004 (+ 52us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:22.678298 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:22.678315 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.680103 (+ 1788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.680109 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:22.681982 (+ 1873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:22.681996 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.683734 (+ 1738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.683741 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:22.684064 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:22.684102 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 09:15:22.684213 (+ 111us) client_negotiation.cc:240] Negotiation successful
0806 09:15:22.684379 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260806 09:15:22.685781 19513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:22.677960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:58939 (local address 127.10.255.65:37063)
0806 09:15:22.678193 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:22.678202 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:22.678731 (+ 529us) server_negotiation.cc:407] Connection header received
0806 09:15:22.678883 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:22.678887 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:22.678949 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:22.679033 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:22.679751 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.681065 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.683488 (+ 2423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.684843 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.685036 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:22.685122 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:22.685479 (+ 357us) server_negotiation.cc:299] Negotiation successful
0806 09:15:22.685602 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 09:15:22.685959 19523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:22.677613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:37063 (local address 127.10.255.67:58939)
0806 09:15:22.678570 (+ 957us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:22.678599 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:22.678751 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:22.679096 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:22.679102 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:22.679132 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:22.679538 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:22.679550 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.681280 (+ 1730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.681285 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:22.683270 (+ 1985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:22.683288 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.685102 (+ 1814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.685109 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:22.685269 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:22.685294 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 09:15:22.685427 (+ 133us) client_negotiation.cc:240] Negotiation successful
0806 09:15:22.685598 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":772,"thread_start_us":584,"threads_started":1}
I20260806 09:15:22.686002 19297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81cd576c98f2445db6cce3cb011a5433" candidate_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f16758241ddd471497d21bbf2cf9124c" is_pre_election: true
I20260806 09:15:22.686614 19297 raft_consensus.cc:2454] T 81cd576c98f2445db6cce3cb011a5433 P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c6e114c999d46ec9330a8a6afdc5bd5 in term 0.
I20260806 09:15:22.687204 19156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81cd576c98f2445db6cce3cb011a5433" candidate_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be0049159fa14dd2a7df37d951b40151" is_pre_election: true
I20260806 09:15:22.687479 19369 leader_election.cc:302] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c6e114c999d46ec9330a8a6afdc5bd5, f16758241ddd471497d21bbf2cf9124c; no voters:
I20260806 09:15:22.687744 19156 raft_consensus.cc:2454] T 81cd576c98f2445db6cce3cb011a5433 P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c6e114c999d46ec9330a8a6afdc5bd5 in term 0.
I20260806 09:15:22.687955 19520 raft_consensus.cc:2781] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:15:22.688134 19520 raft_consensus.cc:482] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:15:22.688246 19520 raft_consensus.cc:3037] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:22.690615 19520 raft_consensus.cc:504] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } }
I20260806 09:15:22.691429 19520 leader_election.cc:288] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5 [CANDIDATE]: Term 1 election: Requested vote from peers f16758241ddd471497d21bbf2cf9124c (127.10.255.66:44785), be0049159fa14dd2a7df37d951b40151 (127.10.255.65:37063)
I20260806 09:15:22.692293 19297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81cd576c98f2445db6cce3cb011a5433" candidate_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f16758241ddd471497d21bbf2cf9124c"
I20260806 09:15:22.692473 19156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "81cd576c98f2445db6cce3cb011a5433" candidate_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be0049159fa14dd2a7df37d951b40151"
I20260806 09:15:22.692569 19297 raft_consensus.cc:3037] T 81cd576c98f2445db6cce3cb011a5433 P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:22.692768 19156 raft_consensus.cc:3037] T 81cd576c98f2445db6cce3cb011a5433 P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:22.695187 19297 raft_consensus.cc:2454] T 81cd576c98f2445db6cce3cb011a5433 P f16758241ddd471497d21bbf2cf9124c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c6e114c999d46ec9330a8a6afdc5bd5 in term 1.
I20260806 09:15:22.695653 19156 raft_consensus.cc:2454] T 81cd576c98f2445db6cce3cb011a5433 P be0049159fa14dd2a7df37d951b40151 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c6e114c999d46ec9330a8a6afdc5bd5 in term 1.
I20260806 09:15:22.695919 19369 leader_election.cc:302] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c6e114c999d46ec9330a8a6afdc5bd5, f16758241ddd471497d21bbf2cf9124c; no voters:
I20260806 09:15:22.696346 19520 raft_consensus.cc:2781] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:15:22.696906 19520 raft_consensus.cc:686] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 1 LEADER]: Becoming Leader. State: Replica: 1c6e114c999d46ec9330a8a6afdc5bd5, State: Running, Role: LEADER
I20260806 09:15:22.697561 19520 consensus_queue.cc:237] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } }
I20260806 09:15:22.703310 18994 catalog_manager.cc:5495] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c6e114c999d46ec9330a8a6afdc5bd5 (127.10.255.67). New cstate: current_term: 1 leader_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } health_report { overall_health: UNKNOWN } } }
W20260806 09:15:22.728303 19208 tablet.cc:2369] T 81cd576c98f2445db6cce3cb011a5433 P be0049159fa14dd2a7df37d951b40151: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:15:22.744661 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:22.737772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56792 (local address 127.10.255.67:34895)
0806 09:15:22.737982 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:22.737987 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:22.738009 (+ 22us) server_negotiation.cc:407] Connection header received
0806 09:15:22.738279 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:22.738285 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:22.738407 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:22.738589 (+ 182us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:15:22.739167 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.740039 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.741618 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.742091 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.742214 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:22.742934 (+ 720us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:15:22.743577 (+ 643us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:15:22.743715 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:22.744286 (+ 571us) server_negotiation.cc:299] Negotiation successful
0806 09:15:22.744391 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 09:15:22.756219 19156 raft_consensus.cc:1261] T 81cd576c98f2445db6cce3cb011a5433 P be0049159fa14dd2a7df37d951b40151 [term 1 FOLLOWER]: Refusing update from remote peer 1c6e114c999d46ec9330a8a6afdc5bd5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:15:22.756723 19297 raft_consensus.cc:1261] T 81cd576c98f2445db6cce3cb011a5433 P f16758241ddd471497d21bbf2cf9124c [term 1 FOLLOWER]: Refusing update from remote peer 1c6e114c999d46ec9330a8a6afdc5bd5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:15:22.757542 19524 consensus_queue.cc:1035] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:15:22.758030 19520 consensus_queue.cc:1035] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:15:22.771998 19527 mvcc.cc:205] Tried to move back new op lower bound from 7315487632393666560 to 7315487632174432256. Current Snapshot: MvccSnapshot[applied={T|T < 7315487632393666560}]
I20260806 09:15:22.789767 18994 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:15:22.790079 18994 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:15:22.794332 18994 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2: Sending DeleteTablet for 3 replicas of tablet 81cd576c98f2445db6cce3cb011a5433
I20260806 09:15:22.796128 19277 tablet_service.cc:1514] Processing DeleteTablet for tablet 81cd576c98f2445db6cce3cb011a5433 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:15:22 UTC) from {username='oryx', principal='oryx/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:40254
I20260806 09:15:22.796145 19136 tablet_service.cc:1514] Processing DeleteTablet for tablet 81cd576c98f2445db6cce3cb011a5433 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:15:22 UTC) from {username='oryx', principal='oryx/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:40298
I20260806 09:15:22.796124 19418 tablet_service.cc:1514] Processing DeleteTablet for tablet 81cd576c98f2445db6cce3cb011a5433 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:15:22 UTC) from {username='oryx', principal='oryx/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:56784
I20260806 09:15:22.800585 18994 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35662:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:15:22.801769 18994 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:15:22.806753 19538 tablet_replica.cc:330] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5: stopping tablet replica
I20260806 09:15:22.807557 19538 raft_consensus.cc:2229] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:15:22.811578 19538 raft_consensus.cc:2258] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:15:22.812397 19536 tablet_replica.cc:330] T 81cd576c98f2445db6cce3cb011a5433 P f16758241ddd471497d21bbf2cf9124c: stopping tablet replica
I20260806 09:15:22.813875 19536 raft_consensus.cc:2229] T 81cd576c98f2445db6cce3cb011a5433 P f16758241ddd471497d21bbf2cf9124c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:15:22.816885 19536 raft_consensus.cc:2258] T 81cd576c98f2445db6cce3cb011a5433 P f16758241ddd471497d21bbf2cf9124c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:15:22.817901 19135 tablet_service.cc:1467] Processing CreateTablet for tablet a8885b4bc71440b1ab88dc4eb8c523e6 (DEFAULT_TABLE table=test-table [id=50e43fbd5f754a9a96712d3ce8d23121]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:15:22.818671 19135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8885b4bc71440b1ab88dc4eb8c523e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:22.818583 19418 tablet_service.cc:1467] Processing CreateTablet for tablet a8885b4bc71440b1ab88dc4eb8c523e6 (DEFAULT_TABLE table=test-table [id=50e43fbd5f754a9a96712d3ce8d23121]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:15:22.819160 19418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8885b4bc71440b1ab88dc4eb8c523e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:22.819010 19276 tablet_service.cc:1467] Processing CreateTablet for tablet a8885b4bc71440b1ab88dc4eb8c523e6 (DEFAULT_TABLE table=test-table [id=50e43fbd5f754a9a96712d3ce8d23121]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:15:22.827425 19276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8885b4bc71440b1ab88dc4eb8c523e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:22.827646 19537 tablet_replica.cc:330] T 81cd576c98f2445db6cce3cb011a5433 P be0049159fa14dd2a7df37d951b40151: stopping tablet replica
I20260806 09:15:22.828253 19537 raft_consensus.cc:2229] T 81cd576c98f2445db6cce3cb011a5433 P be0049159fa14dd2a7df37d951b40151 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:15:22.828552 19516 tablet_bootstrap.cc:492] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151: Bootstrap starting.
I20260806 09:15:22.828958 19537 raft_consensus.cc:2258] T 81cd576c98f2445db6cce3cb011a5433 P be0049159fa14dd2a7df37d951b40151 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:15:22.830427 19536 ts_tablet_manager.cc:1905] T 81cd576c98f2445db6cce3cb011a5433 P f16758241ddd471497d21bbf2cf9124c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:15:22.830488 19516 tablet_bootstrap.cc:654] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:22.835533 19514 tablet_bootstrap.cc:492] T a8885b4bc71440b1ab88dc4eb8c523e6 P f16758241ddd471497d21bbf2cf9124c: Bootstrap starting.
I20260806 09:15:22.836695 19538 ts_tablet_manager.cc:1905] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:15:22.838513 19514 tablet_bootstrap.cc:654] T a8885b4bc71440b1ab88dc4eb8c523e6 P f16758241ddd471497d21bbf2cf9124c: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:22.840103 19536 ts_tablet_manager.cc:1918] T 81cd576c98f2445db6cce3cb011a5433 P f16758241ddd471497d21bbf2cf9124c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:15:22.840363 19536 log.cc:1196] T 81cd576c98f2445db6cce3cb011a5433 P f16758241ddd471497d21bbf2cf9124c: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/81cd576c98f2445db6cce3cb011a5433
I20260806 09:15:22.841027 19536 ts_tablet_manager.cc:1939] T 81cd576c98f2445db6cce3cb011a5433 P f16758241ddd471497d21bbf2cf9124c: Deleting consensus metadata
I20260806 09:15:22.843408 19514 tablet_bootstrap.cc:492] T a8885b4bc71440b1ab88dc4eb8c523e6 P f16758241ddd471497d21bbf2cf9124c: No bootstrap required, opened a new log
I20260806 09:15:22.843408 19516 tablet_bootstrap.cc:492] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151: No bootstrap required, opened a new log
I20260806 09:15:22.843604 19514 ts_tablet_manager.cc:1397] T a8885b4bc71440b1ab88dc4eb8c523e6 P f16758241ddd471497d21bbf2cf9124c: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.004s
I20260806 09:15:22.843605 19516 ts_tablet_manager.cc:1397] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.012s
I20260806 09:15:22.843590 18981 catalog_manager.cc:4841] TS f16758241ddd471497d21bbf2cf9124c (127.10.255.66:44785): tablet 81cd576c98f2445db6cce3cb011a5433 (table test-table [id=0765ee560c1f4e40913977c34ee85c40]) successfully deleted
I20260806 09:15:22.844578 19514 raft_consensus.cc:348] T a8885b4bc71440b1ab88dc4eb8c523e6 P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:22.844580 19516 raft_consensus.cc:348] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:22.844853 19514 raft_consensus.cc:374] T a8885b4bc71440b1ab88dc4eb8c523e6 P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:22.844861 19516 raft_consensus.cc:374] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:22.844960 19514 raft_consensus.cc:729] T a8885b4bc71440b1ab88dc4eb8c523e6 P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f16758241ddd471497d21bbf2cf9124c, State: Initialized, Role: FOLLOWER
I20260806 09:15:22.844962 19516 raft_consensus.cc:729] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be0049159fa14dd2a7df37d951b40151, State: Initialized, Role: FOLLOWER
I20260806 09:15:22.845399 19537 ts_tablet_manager.cc:1905] T 81cd576c98f2445db6cce3cb011a5433 P be0049159fa14dd2a7df37d951b40151: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:15:22.845306 19514 consensus_queue.cc:260] T a8885b4bc71440b1ab88dc4eb8c523e6 P f16758241ddd471497d21bbf2cf9124c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:22.845340 19516 consensus_queue.cc:260] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:22.846292 19516 ts_tablet_manager.cc:1428] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260806 09:15:22.848973 19515 tablet_bootstrap.cc:492] T a8885b4bc71440b1ab88dc4eb8c523e6 P 1c6e114c999d46ec9330a8a6afdc5bd5: Bootstrap starting.
I20260806 09:15:22.851054 19515 tablet_bootstrap.cc:654] T a8885b4bc71440b1ab88dc4eb8c523e6 P 1c6e114c999d46ec9330a8a6afdc5bd5: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:22.854224 19538 ts_tablet_manager.cc:1918] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:15:22.854576 19538 log.cc:1196] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/81cd576c98f2445db6cce3cb011a5433
I20260806 09:15:22.855172 19514 ts_tablet_manager.cc:1428] T a8885b4bc71440b1ab88dc4eb8c523e6 P f16758241ddd471497d21bbf2cf9124c: Time spent starting tablet: real 0.011s user 0.000s sys 0.002s
I20260806 09:15:22.858915 19538 ts_tablet_manager.cc:1939] T 81cd576c98f2445db6cce3cb011a5433 P 1c6e114c999d46ec9330a8a6afdc5bd5: Deleting consensus metadata
I20260806 09:15:22.861250 18981 catalog_manager.cc:4841] TS 1c6e114c999d46ec9330a8a6afdc5bd5 (127.10.255.67:34895): tablet 81cd576c98f2445db6cce3cb011a5433 (table test-table [id=0765ee560c1f4e40913977c34ee85c40]) successfully deleted
I20260806 09:15:22.861409 19537 ts_tablet_manager.cc:1918] T 81cd576c98f2445db6cce3cb011a5433 P be0049159fa14dd2a7df37d951b40151: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:15:22.861675 19537 log.cc:1196] T 81cd576c98f2445db6cce3cb011a5433 P be0049159fa14dd2a7df37d951b40151: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-0/wal/wals/81cd576c98f2445db6cce3cb011a5433
I20260806 09:15:22.862403 19537 ts_tablet_manager.cc:1939] T 81cd576c98f2445db6cce3cb011a5433 P be0049159fa14dd2a7df37d951b40151: Deleting consensus metadata
I20260806 09:15:22.864017 19515 tablet_bootstrap.cc:492] T a8885b4bc71440b1ab88dc4eb8c523e6 P 1c6e114c999d46ec9330a8a6afdc5bd5: No bootstrap required, opened a new log
I20260806 09:15:22.864238 19515 ts_tablet_manager.cc:1397] T a8885b4bc71440b1ab88dc4eb8c523e6 P 1c6e114c999d46ec9330a8a6afdc5bd5: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.007s
I20260806 09:15:22.864646 18981 catalog_manager.cc:4841] TS be0049159fa14dd2a7df37d951b40151 (127.10.255.65:37063): tablet 81cd576c98f2445db6cce3cb011a5433 (table test-table [id=0765ee560c1f4e40913977c34ee85c40]) successfully deleted
I20260806 09:15:22.865257 19515 raft_consensus.cc:348] T a8885b4bc71440b1ab88dc4eb8c523e6 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:22.865456 19515 raft_consensus.cc:374] T a8885b4bc71440b1ab88dc4eb8c523e6 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:22.865535 19515 raft_consensus.cc:729] T a8885b4bc71440b1ab88dc4eb8c523e6 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c6e114c999d46ec9330a8a6afdc5bd5, State: Initialized, Role: FOLLOWER
I20260806 09:15:22.865839 19515 consensus_queue.cc:260] T a8885b4bc71440b1ab88dc4eb8c523e6 P 1c6e114c999d46ec9330a8a6afdc5bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:22.866482 19515 ts_tablet_manager.cc:1428] T a8885b4bc71440b1ab88dc4eb8c523e6 P 1c6e114c999d46ec9330a8a6afdc5bd5: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260806 09:15:22.889125 19522 raft_consensus.cc:482] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:15:22.889394 19522 raft_consensus.cc:504] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:22.891779 19522 leader_election.cc:288] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f16758241ddd471497d21bbf2cf9124c (127.10.255.66:44785), 1c6e114c999d46ec9330a8a6afdc5bd5 (127.10.255.67:34895)
I20260806 09:15:22.900441 19510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:22.892447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:36219 (local address 127.10.255.66:44785)
0806 09:15:22.892935 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:22.892943 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:22.893164 (+ 221us) server_negotiation.cc:407] Connection header received
0806 09:15:22.893429 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:22.893454 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:22.893572 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:22.893663 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:22.894673 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.895723 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.898099 (+ 2376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.898954 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.899169 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:22.899253 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:22.899940 (+ 687us) server_negotiation.cc:299] Negotiation successful
0806 09:15:22.900133 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164}
I20260806 09:15:22.901643 19542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:22.892347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:44785 (local address 127.10.255.65:36219)
0806 09:15:22.893035 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:22.893055 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:22.893221 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:22.893952 (+ 731us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:22.893960 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:22.894006 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:22.894470 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:22.894482 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.895902 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.895911 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:22.897908 (+ 1997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:22.897922 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.899450 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.899458 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:22.899669 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:22.899710 (+ 41us) client_negotiation.cc:769] Sending connection context
0806 09:15:22.900892 (+ 1182us) client_negotiation.cc:240] Negotiation successful
0806 09:15:22.901086 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":379,"threads_started":1}
I20260806 09:15:22.902694 19297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8885b4bc71440b1ab88dc4eb8c523e6" candidate_uuid: "be0049159fa14dd2a7df37d951b40151" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f16758241ddd471497d21bbf2cf9124c" is_pre_election: true
I20260806 09:15:22.903070 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:22.893472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:44227 (local address 127.10.255.67:34895)
0806 09:15:22.893805 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:22.893813 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:22.894772 (+ 959us) server_negotiation.cc:407] Connection header received
0806 09:15:22.894979 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:22.894989 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:22.895103 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:22.895215 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:22.895982 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.897195 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.900309 (+ 3114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.901858 (+ 1549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.902072 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:22.902162 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:22.902586 (+ 424us) server_negotiation.cc:299] Negotiation successful
0806 09:15:22.902738 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260806 09:15:22.903059 19297 raft_consensus.cc:2454] T a8885b4bc71440b1ab88dc4eb8c523e6 P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be0049159fa14dd2a7df37d951b40151 in term 0.
I20260806 09:15:22.903301 19543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:22.893239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:34895 (local address 127.10.255.65:44227)
0806 09:15:22.894618 (+ 1379us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:22.894643 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:22.894814 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:22.895282 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:22.895288 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:22.895319 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:22.895761 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:22.895777 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.897377 (+ 1600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.897384 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:22.900047 (+ 2663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:22.900067 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.902166 (+ 2099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.902174 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:22.902366 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:22.902409 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 09:15:22.902552 (+ 143us) client_negotiation.cc:240] Negotiation successful
0806 09:15:22.902705 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1160,"thread_start_us":768,"threads_started":1}
I20260806 09:15:22.903698 19086 leader_election.cc:302] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be0049159fa14dd2a7df37d951b40151, f16758241ddd471497d21bbf2cf9124c; no voters:
I20260806 09:15:22.904225 19522 raft_consensus.cc:2781] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:15:22.904371 19522 raft_consensus.cc:482] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:15:22.904481 19522 raft_consensus.cc:3037] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:22.904850 19443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8885b4bc71440b1ab88dc4eb8c523e6" candidate_uuid: "be0049159fa14dd2a7df37d951b40151" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" is_pre_election: true
I20260806 09:15:22.905277 19443 raft_consensus.cc:2454] T a8885b4bc71440b1ab88dc4eb8c523e6 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be0049159fa14dd2a7df37d951b40151 in term 0.
I20260806 09:15:22.908320 19522 raft_consensus.cc:504] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:22.909220 19522 leader_election.cc:288] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151 [CANDIDATE]: Term 1 election: Requested vote from peers f16758241ddd471497d21bbf2cf9124c (127.10.255.66:44785), 1c6e114c999d46ec9330a8a6afdc5bd5 (127.10.255.67:34895)
I20260806 09:15:22.910164 19297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8885b4bc71440b1ab88dc4eb8c523e6" candidate_uuid: "be0049159fa14dd2a7df37d951b40151" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f16758241ddd471497d21bbf2cf9124c"
I20260806 09:15:22.910327 19443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8885b4bc71440b1ab88dc4eb8c523e6" candidate_uuid: "be0049159fa14dd2a7df37d951b40151" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5"
I20260806 09:15:22.910429 19297 raft_consensus.cc:3037] T a8885b4bc71440b1ab88dc4eb8c523e6 P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:22.910571 19443 raft_consensus.cc:3037] T a8885b4bc71440b1ab88dc4eb8c523e6 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:22.913815 19297 raft_consensus.cc:2454] T a8885b4bc71440b1ab88dc4eb8c523e6 P f16758241ddd471497d21bbf2cf9124c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be0049159fa14dd2a7df37d951b40151 in term 1.
I20260806 09:15:22.914000 19443 raft_consensus.cc:2454] T a8885b4bc71440b1ab88dc4eb8c523e6 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be0049159fa14dd2a7df37d951b40151 in term 1.
I20260806 09:15:22.914492 19086 leader_election.cc:302] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be0049159fa14dd2a7df37d951b40151, f16758241ddd471497d21bbf2cf9124c; no voters:
I20260806 09:15:22.915086 19522 raft_consensus.cc:2781] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:15:22.915715 19522 raft_consensus.cc:686] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151 [term 1 LEADER]: Becoming Leader. State: Replica: be0049159fa14dd2a7df37d951b40151, State: Running, Role: LEADER
I20260806 09:15:22.916266 19522 consensus_queue.cc:237] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:22.921581 18994 catalog_manager.cc:5495] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151 reported cstate change: term changed from 0 to 1, leader changed from <none> to be0049159fa14dd2a7df37d951b40151 (127.10.255.65). New cstate: current_term: 1 leader_uuid: "be0049159fa14dd2a7df37d951b40151" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } health_report { overall_health: UNKNOWN } } }
Aug 06 09:15:22 dist-test-slave-mvvj krb5kdc[18951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007720, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.126@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM
I20260806 09:15:23.002939 19552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:22.970837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42397 (local address 127.0.0.1:35672)
0806 09:15:22.987162 (+ 16325us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:22.987187 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:22.987384 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:22.987793 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:22.987798 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:22.988606 (+ 808us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:22.988832 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:22.988843 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.990001 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.990008 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:22.990987 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:22.990999 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.991810 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.991817 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:22.992014 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:22.992856 (+ 842us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:22.992891 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:22.995378 (+ 2487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:22.999152 (+ 3774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:22.999177 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:22.999187 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:23.000044 (+ 857us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:23.000672 (+ 628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:23.000678 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:23.000681 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:23.000898 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:23.001664 (+ 766us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:23.001676 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:23.001930 (+ 254us) client_negotiation.cc:769] Sending connection context
0806 09:15:23.002157 (+ 227us) client_negotiation.cc:240] Negotiation successful
0806 09:15:23.002509 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16200,"thread_start_us":16063,"threads_started":1}
I20260806 09:15:23.003782 19551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:22.970861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35672 (local address 127.10.255.126:42397)
0806 09:15:22.986530 (+ 15669us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:22.986539 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:22.987271 (+ 732us) server_negotiation.cc:407] Connection header received
0806 09:15:22.987538 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:22.987544 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:22.987624 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:22.987754 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:22.989028 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.989841 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.991159 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:22.991617 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:22.991759 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:22.995642 (+ 3883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:22.995649 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:22.995652 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:22.995685 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:22.998893 (+ 3208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:23.000227 (+ 1334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:23.000233 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:23.000237 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:23.000465 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:23.001052 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:23.001057 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:23.001061 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:23.001481 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:23.001664 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:23.002314 (+ 650us) server_negotiation.cc:299] Negotiation successful
0806 09:15:23.003524 (+ 1210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":611,"server-negotiator.queue_time_us":15433,"thread_start_us":15735,"threads_started":1}
I20260806 09:15:23.010308 18994 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:35672:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 09:15:23.011749 18994 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:15:23.022004 19276 tablet_service.cc:1467] Processing CreateTablet for tablet e6570d8202734dcabcb16713b7b93a4b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=29f8992300ba44148c5d40745cc0785a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 09:15:23.021996 19418 tablet_service.cc:1467] Processing CreateTablet for tablet e6570d8202734dcabcb16713b7b93a4b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=29f8992300ba44148c5d40745cc0785a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 09:15:23.022109 19135 tablet_service.cc:1467] Processing CreateTablet for tablet e6570d8202734dcabcb16713b7b93a4b (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=29f8992300ba44148c5d40745cc0785a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 09:15:23.022670 19276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6570d8202734dcabcb16713b7b93a4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:23.022696 19418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6570d8202734dcabcb16713b7b93a4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:23.022713 19135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6570d8202734dcabcb16713b7b93a4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:23.031478 19514 tablet_bootstrap.cc:492] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c: Bootstrap starting.
I20260806 09:15:23.032053 19515 tablet_bootstrap.cc:492] T e6570d8202734dcabcb16713b7b93a4b P 1c6e114c999d46ec9330a8a6afdc5bd5: Bootstrap starting.
I20260806 09:15:23.033499 19514 tablet_bootstrap.cc:654] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:23.034042 19515 tablet_bootstrap.cc:654] T e6570d8202734dcabcb16713b7b93a4b P 1c6e114c999d46ec9330a8a6afdc5bd5: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:23.036216 19516 tablet_bootstrap.cc:492] T e6570d8202734dcabcb16713b7b93a4b P be0049159fa14dd2a7df37d951b40151: Bootstrap starting.
I20260806 09:15:23.038416 19516 tablet_bootstrap.cc:654] T e6570d8202734dcabcb16713b7b93a4b P be0049159fa14dd2a7df37d951b40151: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:23.045243 19515 tablet_bootstrap.cc:492] T e6570d8202734dcabcb16713b7b93a4b P 1c6e114c999d46ec9330a8a6afdc5bd5: No bootstrap required, opened a new log
I20260806 09:15:23.045486 19515 ts_tablet_manager.cc:1397] T e6570d8202734dcabcb16713b7b93a4b P 1c6e114c999d46ec9330a8a6afdc5bd5: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.005s
I20260806 09:15:23.046736 19515 raft_consensus.cc:348] T e6570d8202734dcabcb16713b7b93a4b P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:23.047050 19515 raft_consensus.cc:374] T e6570d8202734dcabcb16713b7b93a4b P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:23.047143 19515 raft_consensus.cc:729] T e6570d8202734dcabcb16713b7b93a4b P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c6e114c999d46ec9330a8a6afdc5bd5, State: Initialized, Role: FOLLOWER
I20260806 09:15:23.047371 19514 tablet_bootstrap.cc:492] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c: No bootstrap required, opened a new log
I20260806 09:15:23.047626 19514 ts_tablet_manager.cc:1397] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.006s
I20260806 09:15:23.047510 19515 consensus_queue.cc:260] T e6570d8202734dcabcb16713b7b93a4b P 1c6e114c999d46ec9330a8a6afdc5bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:23.048074 19520 tablet_replica.cc:439] T e6570d8202734dcabcb16713b7b93a4b P 1c6e114c999d46ec9330a8a6afdc5bd5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } }
I20260806 09:15:23.048372 19520 tablet_replica.cc:442] T e6570d8202734dcabcb16713b7b93a4b P 1c6e114c999d46ec9330a8a6afdc5bd5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 09:15:23.049685 19515 ts_tablet_manager.cc:1428] T e6570d8202734dcabcb16713b7b93a4b P 1c6e114c999d46ec9330a8a6afdc5bd5: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260806 09:15:23.051375 19514 raft_consensus.cc:348] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:23.051734 19514 raft_consensus.cc:374] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:23.051856 19514 raft_consensus.cc:729] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f16758241ddd471497d21bbf2cf9124c, State: Initialized, Role: FOLLOWER
I20260806 09:15:23.052649 19516 tablet_bootstrap.cc:492] T e6570d8202734dcabcb16713b7b93a4b P be0049159fa14dd2a7df37d951b40151: No bootstrap required, opened a new log
I20260806 09:15:23.052857 19516 ts_tablet_manager.cc:1397] T e6570d8202734dcabcb16713b7b93a4b P be0049159fa14dd2a7df37d951b40151: Time spent bootstrapping tablet: real 0.017s user 0.005s sys 0.010s
I20260806 09:15:23.053269 19514 consensus_queue.cc:260] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:23.053678 19516 raft_consensus.cc:348] T e6570d8202734dcabcb16713b7b93a4b P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:23.053939 19516 raft_consensus.cc:374] T e6570d8202734dcabcb16713b7b93a4b P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:23.054018 19516 raft_consensus.cc:729] T e6570d8202734dcabcb16713b7b93a4b P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be0049159fa14dd2a7df37d951b40151, State: Initialized, Role: FOLLOWER
I20260806 09:15:23.054093 19514 ts_tablet_manager.cc:1428] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260806 09:15:23.053879 19521 tablet_replica.cc:439] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } }
I20260806 09:15:23.054332 19521 tablet_replica.cc:442] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 09:15:23.054296 19516 consensus_queue.cc:260] T e6570d8202734dcabcb16713b7b93a4b P be0049159fa14dd2a7df37d951b40151 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:23.054947 19516 ts_tablet_manager.cc:1428] T e6570d8202734dcabcb16713b7b93a4b P be0049159fa14dd2a7df37d951b40151: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260806 09:15:23.054802 19522 tablet_replica.cc:439] T e6570d8202734dcabcb16713b7b93a4b P be0049159fa14dd2a7df37d951b40151: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } }
I20260806 09:15:23.055124 19522 tablet_replica.cc:442] T e6570d8202734dcabcb16713b7b93a4b P be0049159fa14dd2a7df37d951b40151: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 09:15:23.228965 19521 raft_consensus.cc:482] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:15:23.229233 19521 raft_consensus.cc:504] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:23.231125 19521 leader_election.cc:288] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be0049159fa14dd2a7df37d951b40151 (127.10.255.65:37063), 1c6e114c999d46ec9330a8a6afdc5bd5 (127.10.255.67:34895)
I20260806 09:15:23.240828 19509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:23.233089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:37193 (local address 127.10.255.67:34895)
0806 09:15:23.233295 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:23.233303 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:23.233496 (+ 193us) server_negotiation.cc:407] Connection header received
0806 09:15:23.233822 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:23.233827 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:23.233917 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:23.234032 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:23.235004 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.236161 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.238624 (+ 2463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.239540 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.239763 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:23.239846 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:23.240306 (+ 460us) server_negotiation.cc:299] Negotiation successful
0806 09:15:23.240474 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 09:15:23.240935 19558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:23.232685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:34895 (local address 127.10.255.66:37193)
0806 09:15:23.233374 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:23.233398 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:23.233622 (+ 224us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:23.234237 (+ 615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:23.234242 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:23.234286 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:23.234768 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:23.234783 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.236325 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.236331 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:23.238451 (+ 2120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:23.238463 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.239781 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.239787 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:23.240055 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:23.240101 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 09:15:23.240258 (+ 157us) client_negotiation.cc:240] Negotiation successful
0806 09:15:23.240424 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"mutex_wait_us":1,"thread_start_us":619,"threads_started":1}
I20260806 09:15:23.241032 19556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:23.231459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:37063 (local address 127.10.255.66:54463)
0806 09:15:23.232311 (+ 852us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:23.232335 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:23.232509 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:23.234066 (+ 1557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:23.234070 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:23.234105 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:23.234508 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:23.234518 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.235740 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.235748 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:23.238251 (+ 2503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:23.238270 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.240149 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.240158 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:23.240329 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:23.240358 (+ 29us) client_negotiation.cc:769] Sending connection context
0806 09:15:23.240437 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 09:15:23.240600 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":705,"mutex_wait_us":76,"spinlock_wait_cycles":13184,"thread_start_us":805,"threads_started":1}
I20260806 09:15:23.241628 19557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:23.232003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:54463 (local address 127.10.255.65:37063)
0806 09:15:23.233752 (+ 1749us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:23.233758 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:23.233778 (+ 20us) server_negotiation.cc:407] Connection header received
0806 09:15:23.233846 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:23.233850 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:23.233909 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:23.234036 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:23.234703 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.235589 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.238484 (+ 2895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.239802 (+ 1318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.240096 (+ 294us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:23.240178 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:23.241178 (+ 1000us) server_negotiation.cc:299] Negotiation successful
0806 09:15:23.241362 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1607,"thread_start_us":1493,"threads_started":1}
I20260806 09:15:23.242311 19156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6570d8202734dcabcb16713b7b93a4b" candidate_uuid: "f16758241ddd471497d21bbf2cf9124c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be0049159fa14dd2a7df37d951b40151" is_pre_election: true
I20260806 09:15:23.242637 19156 raft_consensus.cc:2454] T e6570d8202734dcabcb16713b7b93a4b P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f16758241ddd471497d21bbf2cf9124c in term 0.
I20260806 09:15:23.242866 19443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6570d8202734dcabcb16713b7b93a4b" candidate_uuid: "f16758241ddd471497d21bbf2cf9124c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" is_pre_election: true
I20260806 09:15:23.243171 19443 raft_consensus.cc:2454] T e6570d8202734dcabcb16713b7b93a4b P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f16758241ddd471497d21bbf2cf9124c in term 0.
I20260806 09:15:23.243227 19228 leader_election.cc:302] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be0049159fa14dd2a7df37d951b40151, f16758241ddd471497d21bbf2cf9124c; no voters:
I20260806 09:15:23.243710 19521 raft_consensus.cc:2781] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:15:23.243891 19521 raft_consensus.cc:482] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:15:23.244047 19521 raft_consensus.cc:3037] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:23.246261 19521 raft_consensus.cc:504] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:23.246943 19521 leader_election.cc:288] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c [CANDIDATE]: Term 1 election: Requested vote from peers be0049159fa14dd2a7df37d951b40151 (127.10.255.65:37063), 1c6e114c999d46ec9330a8a6afdc5bd5 (127.10.255.67:34895)
I20260806 09:15:23.247641 19443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6570d8202734dcabcb16713b7b93a4b" candidate_uuid: "f16758241ddd471497d21bbf2cf9124c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5"
I20260806 09:15:23.247675 19156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6570d8202734dcabcb16713b7b93a4b" candidate_uuid: "f16758241ddd471497d21bbf2cf9124c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be0049159fa14dd2a7df37d951b40151"
I20260806 09:15:23.247926 19443 raft_consensus.cc:3037] T e6570d8202734dcabcb16713b7b93a4b P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:23.247973 19156 raft_consensus.cc:3037] T e6570d8202734dcabcb16713b7b93a4b P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:23.250386 19443 raft_consensus.cc:2454] T e6570d8202734dcabcb16713b7b93a4b P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f16758241ddd471497d21bbf2cf9124c in term 1.
I20260806 09:15:23.250967 19228 leader_election.cc:302] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c6e114c999d46ec9330a8a6afdc5bd5, f16758241ddd471497d21bbf2cf9124c; no voters:
I20260806 09:15:23.251111 19156 raft_consensus.cc:2454] T e6570d8202734dcabcb16713b7b93a4b P be0049159fa14dd2a7df37d951b40151 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f16758241ddd471497d21bbf2cf9124c in term 1.
I20260806 09:15:23.251302 19521 raft_consensus.cc:2781] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:15:23.252043 19521 raft_consensus.cc:686] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c [term 1 LEADER]: Becoming Leader. State: Replica: f16758241ddd471497d21bbf2cf9124c, State: Running, Role: LEADER
I20260806 09:15:23.252810 19521 consensus_queue.cc:237] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:23.256103 19559 tablet_replica.cc:439] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c: TxnStatusTablet state changed. Reason: New leader f16758241ddd471497d21bbf2cf9124c. Latest consensus state: current_term: 1 leader_uuid: "f16758241ddd471497d21bbf2cf9124c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } }
I20260806 09:15:23.256508 19559 tablet_replica.cc:442] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c: This TxnStatusTablet replica's current role is: LEADER
I20260806 09:15:23.257282 19561 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 09:15:23.257544 19561 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 09:15:23.257086 18996 catalog_manager.cc:5495] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c reported cstate change: term changed from 0 to 1, leader changed from <none> to f16758241ddd471497d21bbf2cf9124c (127.10.255.66). New cstate: current_term: 1 leader_uuid: "f16758241ddd471497d21bbf2cf9124c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } health_report { overall_health: UNKNOWN } } }
I20260806 09:15:23.289650 19510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:23.283196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40266 (local address 127.10.255.66:44785)
0806 09:15:23.283601 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:23.283609 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:23.283629 (+ 20us) server_negotiation.cc:407] Connection header received
0806 09:15:23.283921 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:23.283925 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:23.284125 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:23.284319 (+ 194us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:15:23.284756 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.285519 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.286894 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.287364 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.287515 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:23.288191 (+ 676us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:15:23.288955 (+ 764us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:15:23.289122 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:23.289213 (+ 91us) server_negotiation.cc:299] Negotiation successful
0806 09:15:23.289304 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277}
I20260806 09:15:23.289676 19552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:23.283170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:44785 (local address 127.0.0.1:40266)
0806 09:15:23.283441 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:23.283463 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:23.283647 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:23.284341 (+ 694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:23.284346 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:23.284358 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 09:15:23.284563 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:23.284579 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.285696 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.285702 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:23.286719 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:23.286733 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.287558 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.287565 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:23.287767 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:23.287886 (+ 119us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 09:15:23.289080 (+ 1194us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 09:15:23.289104 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 09:15:23.289194 (+ 90us) client_negotiation.cc:240] Negotiation successful
0806 09:15:23.289362 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260806 09:15:23.295224 19156 raft_consensus.cc:1261] T e6570d8202734dcabcb16713b7b93a4b P be0049159fa14dd2a7df37d951b40151 [term 1 FOLLOWER]: Refusing update from remote peer f16758241ddd471497d21bbf2cf9124c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:15:23.295441 19443 raft_consensus.cc:1261] T e6570d8202734dcabcb16713b7b93a4b P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 1 FOLLOWER]: Refusing update from remote peer f16758241ddd471497d21bbf2cf9124c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:15:23.296340 19521 consensus_queue.cc:1035] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:15:23.297221 19559 consensus_queue.cc:1035] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c [LEADER]: Connected to new peer: Peer: permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:15:23.305599 19544 consensus_queue.cc:1035] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:15:23.320533 19522 tablet_replica.cc:439] T e6570d8202734dcabcb16713b7b93a4b P be0049159fa14dd2a7df37d951b40151: TxnStatusTablet state changed. Reason: New leader f16758241ddd471497d21bbf2cf9124c. Latest consensus state: current_term: 1 leader_uuid: "f16758241ddd471497d21bbf2cf9124c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } }
I20260806 09:15:23.320999 19522 tablet_replica.cc:442] T e6570d8202734dcabcb16713b7b93a4b P be0049159fa14dd2a7df37d951b40151: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 09:15:23.324851 19564 mvcc.cc:205] Tried to move back new op lower bound from 7315487634606260224 to 7315487634447736832. Current Snapshot: MvccSnapshot[applied={T|T < 7315487634606260224}]
I20260806 09:15:23.328917 19520 tablet_replica.cc:439] T e6570d8202734dcabcb16713b7b93a4b P 1c6e114c999d46ec9330a8a6afdc5bd5: TxnStatusTablet state changed. Reason: New leader f16758241ddd471497d21bbf2cf9124c. Latest consensus state: current_term: 1 leader_uuid: "f16758241ddd471497d21bbf2cf9124c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } }
I20260806 09:15:23.329370 19520 tablet_replica.cc:442] T e6570d8202734dcabcb16713b7b93a4b P 1c6e114c999d46ec9330a8a6afdc5bd5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 09:15:23.331051 19521 tablet_replica.cc:439] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f16758241ddd471497d21bbf2cf9124c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } }
I20260806 09:15:23.331429 19521 tablet_replica.cc:442] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c: This TxnStatusTablet replica's current role is: LEADER
I20260806 09:15:23.367290 19522 tablet_replica.cc:439] T e6570d8202734dcabcb16713b7b93a4b P be0049159fa14dd2a7df37d951b40151: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f16758241ddd471497d21bbf2cf9124c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } }
I20260806 09:15:23.367762 19522 tablet_replica.cc:442] T e6570d8202734dcabcb16713b7b93a4b P be0049159fa14dd2a7df37d951b40151: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 09:15:23.374890 19559 tablet_replica.cc:439] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f16758241ddd471497d21bbf2cf9124c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } }
I20260806 09:15:23.375325 19559 tablet_replica.cc:442] T e6570d8202734dcabcb16713b7b93a4b P f16758241ddd471497d21bbf2cf9124c: This TxnStatusTablet replica's current role is: LEADER
I20260806 09:15:23.378618 19557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:23.353530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40300 (local address 127.10.255.65:37063)
0806 09:15:23.353763 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:23.353773 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:23.364665 (+ 10892us) server_negotiation.cc:407] Connection header received
0806 09:15:23.365005 (+ 340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:23.365012 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:23.365168 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:23.365359 (+ 191us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:15:23.365870 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.366929 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.368856 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.369507 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.369685 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:23.376758 (+ 7073us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:15:23.377592 (+ 834us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:15:23.377854 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:23.378151 (+ 297us) server_negotiation.cc:299] Negotiation successful
0806 09:15:23.378261 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 09:15:23.383283 19544 consensus_queue.cc:1035] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:15:23.412693 19569 tablet_replica.cc:439] T e6570d8202734dcabcb16713b7b93a4b P 1c6e114c999d46ec9330a8a6afdc5bd5: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f16758241ddd471497d21bbf2cf9124c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } }
I20260806 09:15:23.413100 19569 tablet_replica.cc:442] T e6570d8202734dcabcb16713b7b93a4b P 1c6e114c999d46ec9330a8a6afdc5bd5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 09:15:23.425433 19510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:23.418541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:52463 (local address 127.10.255.66:44785)
0806 09:15:23.418733 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:23.418738 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:23.418951 (+ 213us) server_negotiation.cc:407] Connection header received
0806 09:15:23.419129 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:23.419134 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:23.419246 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:23.419372 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:15:23.419913 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.421309 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.422982 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.423804 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.424008 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:23.424540 (+ 532us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:15:23.424695 (+ 155us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:15:23.424794 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:23.424983 (+ 189us) server_negotiation.cc:299] Negotiation successful
0806 09:15:23.425081 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 09:15:23.425488 19580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:23.417870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:44785 (local address 127.10.255.65:52463)
0806 09:15:23.418799 (+ 929us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:23.418817 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:23.418959 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:23.419458 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:23.419462 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:23.419473 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 09:15:23.419699 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:23.419709 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.421523 (+ 1814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.421527 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:23.422796 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:23.422813 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.424093 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.424098 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:23.424241 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:23.424320 (+ 79us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 09:15:23.424836 (+ 516us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 09:15:23.424849 (+ 13us) client_negotiation.cc:769] Sending connection context
0806 09:15:23.424926 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 09:15:23.425150 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":396,"threads_started":1}
I20260806 09:15:23.481109 19557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:23.472355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:58349 (local address 127.10.255.65:37063)
0806 09:15:23.472570 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:23.472578 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:23.473598 (+ 1020us) server_negotiation.cc:407] Connection header received
0806 09:15:23.473850 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:23.473856 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:23.473957 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:23.474070 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:15:23.474815 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.475926 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.478492 (+ 2566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.479078 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.479232 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:23.480094 (+ 862us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:15:23.480237 (+ 143us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:15:23.480358 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:23.480602 (+ 244us) server_negotiation.cc:299] Negotiation successful
0806 09:15:23.480702 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 09:15:23.481566 19583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:23.472321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:37063 (local address 127.10.255.66:58349)
0806 09:15:23.473502 (+ 1181us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:23.473525 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:23.473681 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:23.474098 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:23.474103 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:23.474116 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 09:15:23.474595 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:23.474613 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.476071 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.476078 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:23.478291 (+ 2213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:23.478310 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.479306 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.479313 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:23.479545 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:23.479768 (+ 223us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 09:15:23.480369 (+ 601us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 09:15:23.480384 (+ 15us) client_negotiation.cc:769] Sending connection context
0806 09:15:23.480466 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 09:15:23.480737 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":924,"thread_start_us":730,"threads_started":1}
I20260806 09:15:23.527982 18996 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:15:23.528291 18996 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35662:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:15:23.532308 18996 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2: Sending DeleteTablet for 3 replicas of tablet a8885b4bc71440b1ab88dc4eb8c523e6
I20260806 09:15:23.536329 19418 tablet_service.cc:1514] Processing DeleteTablet for tablet a8885b4bc71440b1ab88dc4eb8c523e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:15:23 UTC) from {username='oryx', principal='oryx/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:56784
I20260806 09:15:23.537349 19276 tablet_service.cc:1514] Processing DeleteTablet for tablet a8885b4bc71440b1ab88dc4eb8c523e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:15:23 UTC) from {username='oryx', principal='oryx/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:40254
I20260806 09:15:23.541049 19135 tablet_service.cc:1514] Processing DeleteTablet for tablet a8885b4bc71440b1ab88dc4eb8c523e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:15:23 UTC) from {username='oryx', principal='oryx/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:40298
I20260806 09:15:23.542732 19587 tablet_replica.cc:330] T a8885b4bc71440b1ab88dc4eb8c523e6 P f16758241ddd471497d21bbf2cf9124c: stopping tablet replica
I20260806 09:15:23.543022 19587 raft_consensus.cc:2229] T a8885b4bc71440b1ab88dc4eb8c523e6 P f16758241ddd471497d21bbf2cf9124c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:15:23.543432 19587 raft_consensus.cc:2258] T a8885b4bc71440b1ab88dc4eb8c523e6 P f16758241ddd471497d21bbf2cf9124c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:15:23.552168 19587 ts_tablet_manager.cc:1905] T a8885b4bc71440b1ab88dc4eb8c523e6 P f16758241ddd471497d21bbf2cf9124c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:15:23.554597 19588 tablet_replica.cc:330] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151: stopping tablet replica
I20260806 09:15:23.554860 19588 raft_consensus.cc:2229] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151 [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:15:23.555647 19588 raft_consensus.cc:2258] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:15:23.556994 19588 ts_tablet_manager.cc:1905] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:15:23.565344 19588 ts_tablet_manager.cc:1918] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 09:15:23.565537 19588 log.cc:1196] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-0/wal/wals/a8885b4bc71440b1ab88dc4eb8c523e6
I20260806 09:15:23.566058 19588 ts_tablet_manager.cc:1939] T a8885b4bc71440b1ab88dc4eb8c523e6 P be0049159fa14dd2a7df37d951b40151: Deleting consensus metadata
I20260806 09:15:23.567368 18981 catalog_manager.cc:4841] TS be0049159fa14dd2a7df37d951b40151 (127.10.255.65:37063): tablet a8885b4bc71440b1ab88dc4eb8c523e6 (table test-table [id=50e43fbd5f754a9a96712d3ce8d23121]) successfully deleted
I20260806 09:15:23.569530 19586 tablet_replica.cc:330] T a8885b4bc71440b1ab88dc4eb8c523e6 P 1c6e114c999d46ec9330a8a6afdc5bd5: stopping tablet replica
I20260806 09:15:23.569820 19586 raft_consensus.cc:2229] T a8885b4bc71440b1ab88dc4eb8c523e6 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:15:23.570096 19586 raft_consensus.cc:2258] T a8885b4bc71440b1ab88dc4eb8c523e6 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:15:23.571460 19586 ts_tablet_manager.cc:1905] T a8885b4bc71440b1ab88dc4eb8c523e6 P 1c6e114c999d46ec9330a8a6afdc5bd5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:15:23.572011 19587 ts_tablet_manager.cc:1918] T a8885b4bc71440b1ab88dc4eb8c523e6 P f16758241ddd471497d21bbf2cf9124c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 09:15:23.572185 19587 log.cc:1196] T a8885b4bc71440b1ab88dc4eb8c523e6 P f16758241ddd471497d21bbf2cf9124c: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/a8885b4bc71440b1ab88dc4eb8c523e6
I20260806 09:15:23.572695 19587 ts_tablet_manager.cc:1939] T a8885b4bc71440b1ab88dc4eb8c523e6 P f16758241ddd471497d21bbf2cf9124c: Deleting consensus metadata
I20260806 09:15:23.574035 18981 catalog_manager.cc:4841] TS f16758241ddd471497d21bbf2cf9124c (127.10.255.66:44785): tablet a8885b4bc71440b1ab88dc4eb8c523e6 (table test-table [id=50e43fbd5f754a9a96712d3ce8d23121]) successfully deleted
I20260806 09:15:23.579689 19586 ts_tablet_manager.cc:1918] T a8885b4bc71440b1ab88dc4eb8c523e6 P 1c6e114c999d46ec9330a8a6afdc5bd5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 09:15:23.580000 19586 log.cc:1196] T a8885b4bc71440b1ab88dc4eb8c523e6 P 1c6e114c999d46ec9330a8a6afdc5bd5: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/a8885b4bc71440b1ab88dc4eb8c523e6
I20260806 09:15:23.580574 19586 ts_tablet_manager.cc:1939] T a8885b4bc71440b1ab88dc4eb8c523e6 P 1c6e114c999d46ec9330a8a6afdc5bd5: Deleting consensus metadata
I20260806 09:15:23.581996 18981 catalog_manager.cc:4841] TS 1c6e114c999d46ec9330a8a6afdc5bd5 (127.10.255.67:34895): tablet a8885b4bc71440b1ab88dc4eb8c523e6 (table test-table [id=50e43fbd5f754a9a96712d3ce8d23121]) successfully deleted
Aug 06 09:15:23 dist-test-slave-mvvj krb5kdc[18951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007723, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 09:15:23 dist-test-slave-mvvj krb5kdc[18951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:23 dist-test-slave-mvvj krb5kdc[18951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
W20260806 09:15:23.692773 19595 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:23.656525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35684 (local address 127.10.255.126:42397)
0806 09:15:23.678074 (+ 21549us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:23.678083 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:23.678108 (+ 25us) server_negotiation.cc:407] Connection header received
0806 09:15:23.678184 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:23.678190 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:23.678284 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:23.678450 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:23.680947 (+ 2497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.682221 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.684451 (+ 2230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.685177 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.685315 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:23.692432 (+ 7117us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35684: BlockingRecv error: recv got EOF from 127.0.0.1:35684 (error 108)
Metrics: {"server-negotiator.queue_time_us":21381,"thread_start_us":22050,"threads_started":1}
Aug 06 09:15:23 dist-test-slave-mvvj krb5kdc[18951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007723, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM
I20260806 09:15:23.718327 19595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:23.696874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35698 (local address 127.10.255.126:42397)
0806 09:15:23.697084 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:23.697091 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:23.697273 (+ 182us) server_negotiation.cc:407] Connection header received
0806 09:15:23.697577 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:23.697584 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:23.697676 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:23.697803 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:23.699706 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.700936 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.702986 (+ 2050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.703714 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.703909 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:23.709814 (+ 5905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:23.709825 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:23.709832 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:23.709912 (+ 80us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:23.714513 (+ 4601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:23.715662 (+ 1149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:23.715671 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:23.715675 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:23.715924 (+ 249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:23.716456 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:23.716461 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:23.716465 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:23.716860 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:23.717148 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:23.717659 (+ 511us) server_negotiation.cc:299] Negotiation successful
0806 09:15:23.717944 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 09:15:23.724134 18996 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35698:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:15:23.725109 18996 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:15:23.735986 19135 tablet_service.cc:1467] Processing CreateTablet for tablet 657615d6615e46a8a4728d0548da24eb (DEFAULT_TABLE table=test-table [id=6a89f815f3d04d3090ed37d464cd773f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:15:23.736627 19135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 657615d6615e46a8a4728d0548da24eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:23.745065 19418 tablet_service.cc:1467] Processing CreateTablet for tablet 657615d6615e46a8a4728d0548da24eb (DEFAULT_TABLE table=test-table [id=6a89f815f3d04d3090ed37d464cd773f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:15:23.745234 19276 tablet_service.cc:1467] Processing CreateTablet for tablet 657615d6615e46a8a4728d0548da24eb (DEFAULT_TABLE table=test-table [id=6a89f815f3d04d3090ed37d464cd773f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:15:23.745644 19418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 657615d6615e46a8a4728d0548da24eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:23.745723 19276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 657615d6615e46a8a4728d0548da24eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:23.752503 19602 tablet_bootstrap.cc:492] T 657615d6615e46a8a4728d0548da24eb P be0049159fa14dd2a7df37d951b40151: Bootstrap starting.
I20260806 09:15:23.755479 19602 tablet_bootstrap.cc:654] T 657615d6615e46a8a4728d0548da24eb P be0049159fa14dd2a7df37d951b40151: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:23.764619 19604 tablet_bootstrap.cc:492] T 657615d6615e46a8a4728d0548da24eb P f16758241ddd471497d21bbf2cf9124c: Bootstrap starting.
I20260806 09:15:23.767362 19604 tablet_bootstrap.cc:654] T 657615d6615e46a8a4728d0548da24eb P f16758241ddd471497d21bbf2cf9124c: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:23.769312 19603 tablet_bootstrap.cc:492] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5: Bootstrap starting.
I20260806 09:15:23.772109 19603 tablet_bootstrap.cc:654] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:23.774439 19602 tablet_bootstrap.cc:492] T 657615d6615e46a8a4728d0548da24eb P be0049159fa14dd2a7df37d951b40151: No bootstrap required, opened a new log
I20260806 09:15:23.774644 19602 ts_tablet_manager.cc:1397] T 657615d6615e46a8a4728d0548da24eb P be0049159fa14dd2a7df37d951b40151: Time spent bootstrapping tablet: real 0.022s user 0.008s sys 0.012s
I20260806 09:15:23.775751 19602 raft_consensus.cc:348] T 657615d6615e46a8a4728d0548da24eb P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:23.776216 19602 raft_consensus.cc:374] T 657615d6615e46a8a4728d0548da24eb P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:23.776394 19602 raft_consensus.cc:729] T 657615d6615e46a8a4728d0548da24eb P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be0049159fa14dd2a7df37d951b40151, State: Initialized, Role: FOLLOWER
I20260806 09:15:23.776695 19602 consensus_queue.cc:260] T 657615d6615e46a8a4728d0548da24eb P be0049159fa14dd2a7df37d951b40151 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:23.776988 19603 tablet_bootstrap.cc:492] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5: No bootstrap required, opened a new log
I20260806 09:15:23.777172 19603 ts_tablet_manager.cc:1397] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.004s
I20260806 09:15:23.777456 19602 ts_tablet_manager.cc:1428] T 657615d6615e46a8a4728d0548da24eb P be0049159fa14dd2a7df37d951b40151: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260806 09:15:23.778614 19604 tablet_bootstrap.cc:492] T 657615d6615e46a8a4728d0548da24eb P f16758241ddd471497d21bbf2cf9124c: No bootstrap required, opened a new log
I20260806 09:15:23.778343 19603 raft_consensus.cc:348] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:23.778713 19603 raft_consensus.cc:374] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:23.778841 19603 raft_consensus.cc:729] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c6e114c999d46ec9330a8a6afdc5bd5, State: Initialized, Role: FOLLOWER
I20260806 09:15:23.778869 19604 ts_tablet_manager.cc:1397] T 657615d6615e46a8a4728d0548da24eb P f16758241ddd471497d21bbf2cf9124c: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.000s
I20260806 09:15:23.779165 19603 consensus_queue.cc:260] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:23.780814 19603 ts_tablet_manager.cc:1428] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5: Time spent starting tablet: real 0.004s user 0.003s sys 0.001s
I20260806 09:15:23.781528 19604 raft_consensus.cc:348] T 657615d6615e46a8a4728d0548da24eb P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:23.781826 19604 raft_consensus.cc:374] T 657615d6615e46a8a4728d0548da24eb P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:23.781958 19604 raft_consensus.cc:729] T 657615d6615e46a8a4728d0548da24eb P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f16758241ddd471497d21bbf2cf9124c, State: Initialized, Role: FOLLOWER
I20260806 09:15:23.782249 19604 consensus_queue.cc:260] T 657615d6615e46a8a4728d0548da24eb P f16758241ddd471497d21bbf2cf9124c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:23.782918 19604 ts_tablet_manager.cc:1428] T 657615d6615e46a8a4728d0548da24eb P f16758241ddd471497d21bbf2cf9124c: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s
I20260806 09:15:23.923406 19569 raft_consensus.cc:482] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:15:23.923673 19569 raft_consensus.cc:504] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:23.924551 19569 leader_election.cc:288] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be0049159fa14dd2a7df37d951b40151 (127.10.255.65:37063), f16758241ddd471497d21bbf2cf9124c (127.10.255.66:44785)
I20260806 09:15:23.925271 19156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "657615d6615e46a8a4728d0548da24eb" candidate_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be0049159fa14dd2a7df37d951b40151" is_pre_election: true
I20260806 09:15:23.925283 19297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "657615d6615e46a8a4728d0548da24eb" candidate_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f16758241ddd471497d21bbf2cf9124c" is_pre_election: true
I20260806 09:15:23.925555 19156 raft_consensus.cc:2454] T 657615d6615e46a8a4728d0548da24eb P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c6e114c999d46ec9330a8a6afdc5bd5 in term 0.
I20260806 09:15:23.925623 19297 raft_consensus.cc:2454] T 657615d6615e46a8a4728d0548da24eb P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1c6e114c999d46ec9330a8a6afdc5bd5 in term 0.
I20260806 09:15:23.926302 19369 leader_election.cc:302] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c6e114c999d46ec9330a8a6afdc5bd5, f16758241ddd471497d21bbf2cf9124c; no voters:
I20260806 09:15:23.926789 19569 raft_consensus.cc:2781] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:15:23.926913 19569 raft_consensus.cc:482] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:15:23.927003 19569 raft_consensus.cc:3037] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:23.930106 19569 raft_consensus.cc:504] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:23.930835 19569 leader_election.cc:288] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5 [CANDIDATE]: Term 1 election: Requested vote from peers be0049159fa14dd2a7df37d951b40151 (127.10.255.65:37063), f16758241ddd471497d21bbf2cf9124c (127.10.255.66:44785)
I20260806 09:15:23.931617 19156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "657615d6615e46a8a4728d0548da24eb" candidate_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be0049159fa14dd2a7df37d951b40151"
I20260806 09:15:23.931928 19156 raft_consensus.cc:3037] T 657615d6615e46a8a4728d0548da24eb P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:23.932042 19297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "657615d6615e46a8a4728d0548da24eb" candidate_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f16758241ddd471497d21bbf2cf9124c"
I20260806 09:15:23.932323 19297 raft_consensus.cc:3037] T 657615d6615e46a8a4728d0548da24eb P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:23.934861 19156 raft_consensus.cc:2454] T 657615d6615e46a8a4728d0548da24eb P be0049159fa14dd2a7df37d951b40151 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c6e114c999d46ec9330a8a6afdc5bd5 in term 1.
I20260806 09:15:23.935513 19369 leader_election.cc:302] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c6e114c999d46ec9330a8a6afdc5bd5, be0049159fa14dd2a7df37d951b40151; no voters:
I20260806 09:15:23.935591 19297 raft_consensus.cc:2454] T 657615d6615e46a8a4728d0548da24eb P f16758241ddd471497d21bbf2cf9124c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1c6e114c999d46ec9330a8a6afdc5bd5 in term 1.
I20260806 09:15:23.935899 19569 raft_consensus.cc:2781] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:15:23.936496 19569 raft_consensus.cc:686] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 1 LEADER]: Becoming Leader. State: Replica: 1c6e114c999d46ec9330a8a6afdc5bd5, State: Running, Role: LEADER
I20260806 09:15:23.936820 19569 consensus_queue.cc:237] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } }
I20260806 09:15:23.939600 18996 catalog_manager.cc:5495] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1c6e114c999d46ec9330a8a6afdc5bd5 (127.10.255.67). New cstate: current_term: 1 leader_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } health_report { overall_health: HEALTHY } } }
I20260806 09:15:23.960096 19611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:23.953384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56802 (local address 127.10.255.67:34895)
0806 09:15:23.954059 (+ 675us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:23.954064 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:23.954081 (+ 17us) server_negotiation.cc:407] Connection header received
0806 09:15:23.954145 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:23.954149 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:23.954213 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:23.954300 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:15:23.954806 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.955843 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.957935 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:23.958418 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:23.958583 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:23.959138 (+ 555us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:15:23.959261 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:15:23.959349 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:23.959590 (+ 241us) server_negotiation.cc:299] Negotiation successful
0806 09:15:23.959670 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":338,"threads_started":1}
I20260806 09:15:23.964080 19297 raft_consensus.cc:1261] T 657615d6615e46a8a4728d0548da24eb P f16758241ddd471497d21bbf2cf9124c [term 1 FOLLOWER]: Refusing update from remote peer 1c6e114c999d46ec9330a8a6afdc5bd5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:15:23.964284 19156 raft_consensus.cc:1261] T 657615d6615e46a8a4728d0548da24eb P be0049159fa14dd2a7df37d951b40151 [term 1 FOLLOWER]: Refusing update from remote peer 1c6e114c999d46ec9330a8a6afdc5bd5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:15:23.964882 19608 consensus_queue.cc:1035] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:15:23.965266 19569 consensus_queue.cc:1035] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:15:23.983049 18994 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:15:23.983363 18994 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:15:23.987460 18994 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2: Sending DeleteTablet for 3 replicas of tablet 657615d6615e46a8a4728d0548da24eb
I20260806 09:15:23.988574 19418 tablet_service.cc:1514] Processing DeleteTablet for tablet 657615d6615e46a8a4728d0548da24eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:15:23 UTC) from {username='oryx', principal='oryx/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:56784
I20260806 09:15:23.988920 19586 tablet_replica.cc:330] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5: stopping tablet replica
I20260806 09:15:23.989045 19276 tablet_service.cc:1514] Processing DeleteTablet for tablet 657615d6615e46a8a4728d0548da24eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:15:23 UTC) from {username='oryx', principal='oryx/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:40254
I20260806 09:15:23.989154 19586 raft_consensus.cc:2229] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:15:23.989374 19587 tablet_replica.cc:330] T 657615d6615e46a8a4728d0548da24eb P f16758241ddd471497d21bbf2cf9124c: stopping tablet replica
I20260806 09:15:23.989554 19586 raft_consensus.cc:2258] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:15:23.989598 19587 raft_consensus.cc:2229] T 657615d6615e46a8a4728d0548da24eb P f16758241ddd471497d21bbf2cf9124c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:15:23.989862 19587 raft_consensus.cc:2258] T 657615d6615e46a8a4728d0548da24eb P f16758241ddd471497d21bbf2cf9124c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:15:23.990267 19136 tablet_service.cc:1514] Processing DeleteTablet for tablet 657615d6615e46a8a4728d0548da24eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:15:23 UTC) from {username='oryx', principal='oryx/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:40298
I20260806 09:15:23.990267 19135 tablet_service.cc:1514] Processing DeleteTablet for tablet 657615d6615e46a8a4728d0548da24eb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:15:23 UTC) from {username='oryx', principal='oryx/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:40298
I20260806 09:15:23.990875 19586 ts_tablet_manager.cc:1905] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:15:23.994143 18995 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35698:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:15:23.994939 18995 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:15:23.996043 19588 tablet_replica.cc:330] T 657615d6615e46a8a4728d0548da24eb P be0049159fa14dd2a7df37d951b40151: stopping tablet replica
I20260806 09:15:23.996204 19587 ts_tablet_manager.cc:1905] T 657615d6615e46a8a4728d0548da24eb P f16758241ddd471497d21bbf2cf9124c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:15:23.996284 19588 raft_consensus.cc:2229] T 657615d6615e46a8a4728d0548da24eb P be0049159fa14dd2a7df37d951b40151 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:15:23.996526 19588 raft_consensus.cc:2258] T 657615d6615e46a8a4728d0548da24eb P be0049159fa14dd2a7df37d951b40151 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:15:23.999645 19586 ts_tablet_manager.cc:1918] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:15:23.999856 19586 log.cc:1196] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/657615d6615e46a8a4728d0548da24eb
I20260806 09:15:24.000404 19586 ts_tablet_manager.cc:1939] T 657615d6615e46a8a4728d0548da24eb P 1c6e114c999d46ec9330a8a6afdc5bd5: Deleting consensus metadata
I20260806 09:15:24.002247 18981 catalog_manager.cc:4841] TS 1c6e114c999d46ec9330a8a6afdc5bd5 (127.10.255.67:34895): tablet 657615d6615e46a8a4728d0548da24eb (table test-table [id=6a89f815f3d04d3090ed37d464cd773f]) successfully deleted
I20260806 09:15:24.003400 19588 ts_tablet_manager.cc:1905] T 657615d6615e46a8a4728d0548da24eb P be0049159fa14dd2a7df37d951b40151: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:15:24.003553 19587 ts_tablet_manager.cc:1918] T 657615d6615e46a8a4728d0548da24eb P f16758241ddd471497d21bbf2cf9124c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:15:24.003726 19587 log.cc:1196] T 657615d6615e46a8a4728d0548da24eb P f16758241ddd471497d21bbf2cf9124c: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/657615d6615e46a8a4728d0548da24eb
I20260806 09:15:24.004204 19587 ts_tablet_manager.cc:1939] T 657615d6615e46a8a4728d0548da24eb P f16758241ddd471497d21bbf2cf9124c: Deleting consensus metadata
I20260806 09:15:24.005491 19276 tablet_service.cc:1467] Processing CreateTablet for tablet 9c1d8d4c8d324672a44cf0840f6189c7 (DEFAULT_TABLE table=test-table [id=12f59091df88463593f0ddea738eab0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:15:24.005990 19276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c1d8d4c8d324672a44cf0840f6189c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:24.007005 19418 tablet_service.cc:1467] Processing CreateTablet for tablet 9c1d8d4c8d324672a44cf0840f6189c7 (DEFAULT_TABLE table=test-table [id=12f59091df88463593f0ddea738eab0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:15:24.007477 19418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c1d8d4c8d324672a44cf0840f6189c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:24.008704 19135 tablet_service.cc:1467] Processing CreateTablet for tablet 9c1d8d4c8d324672a44cf0840f6189c7 (DEFAULT_TABLE table=test-table [id=12f59091df88463593f0ddea738eab0f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:15:24.009160 19135 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c1d8d4c8d324672a44cf0840f6189c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:24.012229 18981 catalog_manager.cc:4841] TS f16758241ddd471497d21bbf2cf9124c (127.10.255.66:44785): tablet 657615d6615e46a8a4728d0548da24eb (table test-table [id=6a89f815f3d04d3090ed37d464cd773f]) successfully deleted
I20260806 09:15:24.014480 19603 tablet_bootstrap.cc:492] T 9c1d8d4c8d324672a44cf0840f6189c7 P 1c6e114c999d46ec9330a8a6afdc5bd5: Bootstrap starting.
I20260806 09:15:24.016507 19603 tablet_bootstrap.cc:654] T 9c1d8d4c8d324672a44cf0840f6189c7 P 1c6e114c999d46ec9330a8a6afdc5bd5: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:24.017483 19604 tablet_bootstrap.cc:492] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c: Bootstrap starting.
I20260806 09:15:24.019318 19604 tablet_bootstrap.cc:654] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:24.021311 19588 ts_tablet_manager.cc:1918] T 657615d6615e46a8a4728d0548da24eb P be0049159fa14dd2a7df37d951b40151: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:15:24.021518 19588 log.cc:1196] T 657615d6615e46a8a4728d0548da24eb P be0049159fa14dd2a7df37d951b40151: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-0/wal/wals/657615d6615e46a8a4728d0548da24eb
I20260806 09:15:24.022073 19588 ts_tablet_manager.cc:1939] T 657615d6615e46a8a4728d0548da24eb P be0049159fa14dd2a7df37d951b40151: Deleting consensus metadata
I20260806 09:15:24.023710 18981 catalog_manager.cc:4841] TS be0049159fa14dd2a7df37d951b40151 (127.10.255.65:37063): tablet 657615d6615e46a8a4728d0548da24eb (table test-table [id=6a89f815f3d04d3090ed37d464cd773f]) successfully deleted
W20260806 09:15:24.024374 18981 catalog_manager.cc:4808] TS be0049159fa14dd2a7df37d951b40151 (127.10.255.65:37063): delete failed for tablet 657615d6615e46a8a4728d0548da24eb because the tablet was not found. No further retry: Not found: Tablet not found: 657615d6615e46a8a4728d0548da24eb
I20260806 09:15:24.026975 19603 tablet_bootstrap.cc:492] T 9c1d8d4c8d324672a44cf0840f6189c7 P 1c6e114c999d46ec9330a8a6afdc5bd5: No bootstrap required, opened a new log
I20260806 09:15:24.027207 19603 ts_tablet_manager.cc:1397] T 9c1d8d4c8d324672a44cf0840f6189c7 P 1c6e114c999d46ec9330a8a6afdc5bd5: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.003s
I20260806 09:15:24.028239 19603 raft_consensus.cc:348] T 9c1d8d4c8d324672a44cf0840f6189c7 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } }
I20260806 09:15:24.028551 19603 raft_consensus.cc:374] T 9c1d8d4c8d324672a44cf0840f6189c7 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:24.028647 19603 raft_consensus.cc:729] T 9c1d8d4c8d324672a44cf0840f6189c7 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c6e114c999d46ec9330a8a6afdc5bd5, State: Initialized, Role: FOLLOWER
I20260806 09:15:24.028930 19603 consensus_queue.cc:260] T 9c1d8d4c8d324672a44cf0840f6189c7 P 1c6e114c999d46ec9330a8a6afdc5bd5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } }
I20260806 09:15:24.029579 19602 tablet_bootstrap.cc:492] T 9c1d8d4c8d324672a44cf0840f6189c7 P be0049159fa14dd2a7df37d951b40151: Bootstrap starting.
I20260806 09:15:24.030447 19603 ts_tablet_manager.cc:1428] T 9c1d8d4c8d324672a44cf0840f6189c7 P 1c6e114c999d46ec9330a8a6afdc5bd5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 09:15:24.031893 19602 tablet_bootstrap.cc:654] T 9c1d8d4c8d324672a44cf0840f6189c7 P be0049159fa14dd2a7df37d951b40151: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:24.032200 19604 tablet_bootstrap.cc:492] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c: No bootstrap required, opened a new log
I20260806 09:15:24.032514 19604 ts_tablet_manager.cc:1397] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.009s
I20260806 09:15:24.033591 19604 raft_consensus.cc:348] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } }
I20260806 09:15:24.034381 19604 raft_consensus.cc:374] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:24.034539 19604 raft_consensus.cc:729] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f16758241ddd471497d21bbf2cf9124c, State: Initialized, Role: FOLLOWER
I20260806 09:15:24.034920 19604 consensus_queue.cc:260] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } }
I20260806 09:15:24.038874 19604 ts_tablet_manager.cc:1428] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260806 09:15:24.046196 19602 tablet_bootstrap.cc:492] T 9c1d8d4c8d324672a44cf0840f6189c7 P be0049159fa14dd2a7df37d951b40151: No bootstrap required, opened a new log
I20260806 09:15:24.046444 19602 ts_tablet_manager.cc:1397] T 9c1d8d4c8d324672a44cf0840f6189c7 P be0049159fa14dd2a7df37d951b40151: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.008s
I20260806 09:15:24.047245 19602 raft_consensus.cc:348] T 9c1d8d4c8d324672a44cf0840f6189c7 P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } }
I20260806 09:15:24.047513 19602 raft_consensus.cc:374] T 9c1d8d4c8d324672a44cf0840f6189c7 P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:24.047662 19602 raft_consensus.cc:729] T 9c1d8d4c8d324672a44cf0840f6189c7 P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be0049159fa14dd2a7df37d951b40151, State: Initialized, Role: FOLLOWER
I20260806 09:15:24.048035 19602 consensus_queue.cc:260] T 9c1d8d4c8d324672a44cf0840f6189c7 P be0049159fa14dd2a7df37d951b40151 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } }
I20260806 09:15:24.048631 19602 ts_tablet_manager.cc:1428] T 9c1d8d4c8d324672a44cf0840f6189c7 P be0049159fa14dd2a7df37d951b40151: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260806 09:15:24.209940 19559 raft_consensus.cc:482] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:15:24.210186 19559 raft_consensus.cc:504] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } }
I20260806 09:15:24.210933 19559 leader_election.cc:288] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c6e114c999d46ec9330a8a6afdc5bd5 (127.10.255.67:34895), be0049159fa14dd2a7df37d951b40151 (127.10.255.65:37063)
I20260806 09:15:24.211947 19442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c1d8d4c8d324672a44cf0840f6189c7" candidate_uuid: "f16758241ddd471497d21bbf2cf9124c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" is_pre_election: true
I20260806 09:15:24.212193 19442 raft_consensus.cc:2454] T 9c1d8d4c8d324672a44cf0840f6189c7 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f16758241ddd471497d21bbf2cf9124c in term 0.
I20260806 09:15:24.212371 19156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c1d8d4c8d324672a44cf0840f6189c7" candidate_uuid: "f16758241ddd471497d21bbf2cf9124c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be0049159fa14dd2a7df37d951b40151" is_pre_election: true
I20260806 09:15:24.212656 19156 raft_consensus.cc:2454] T 9c1d8d4c8d324672a44cf0840f6189c7 P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f16758241ddd471497d21bbf2cf9124c in term 0.
I20260806 09:15:24.212853 19228 leader_election.cc:302] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c6e114c999d46ec9330a8a6afdc5bd5, f16758241ddd471497d21bbf2cf9124c; no voters:
I20260806 09:15:24.213212 19559 raft_consensus.cc:2781] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:15:24.213332 19559 raft_consensus.cc:482] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:15:24.213465 19559 raft_consensus.cc:3037] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:24.215607 19559 raft_consensus.cc:504] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } }
I20260806 09:15:24.216377 19559 leader_election.cc:288] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c [CANDIDATE]: Term 1 election: Requested vote from peers 1c6e114c999d46ec9330a8a6afdc5bd5 (127.10.255.67:34895), be0049159fa14dd2a7df37d951b40151 (127.10.255.65:37063)
I20260806 09:15:24.217047 19442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c1d8d4c8d324672a44cf0840f6189c7" candidate_uuid: "f16758241ddd471497d21bbf2cf9124c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5"
I20260806 09:15:24.217105 19156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c1d8d4c8d324672a44cf0840f6189c7" candidate_uuid: "f16758241ddd471497d21bbf2cf9124c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be0049159fa14dd2a7df37d951b40151"
I20260806 09:15:24.217296 19442 raft_consensus.cc:3037] T 9c1d8d4c8d324672a44cf0840f6189c7 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:24.217336 19156 raft_consensus.cc:3037] T 9c1d8d4c8d324672a44cf0840f6189c7 P be0049159fa14dd2a7df37d951b40151 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:24.219910 19442 raft_consensus.cc:2454] T 9c1d8d4c8d324672a44cf0840f6189c7 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f16758241ddd471497d21bbf2cf9124c in term 1.
I20260806 09:15:24.220522 19228 leader_election.cc:302] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c6e114c999d46ec9330a8a6afdc5bd5, f16758241ddd471497d21bbf2cf9124c; no voters:
I20260806 09:15:24.220928 19559 raft_consensus.cc:2781] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:15:24.220968 19156 raft_consensus.cc:2454] T 9c1d8d4c8d324672a44cf0840f6189c7 P be0049159fa14dd2a7df37d951b40151 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f16758241ddd471497d21bbf2cf9124c in term 1.
I20260806 09:15:24.221477 19559 raft_consensus.cc:686] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c [term 1 LEADER]: Becoming Leader. State: Replica: f16758241ddd471497d21bbf2cf9124c, State: Running, Role: LEADER
I20260806 09:15:24.221801 19559 consensus_queue.cc:237] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } } peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } }
I20260806 09:15:24.224766 18996 catalog_manager.cc:5495] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c reported cstate change: term changed from 0 to 1, leader changed from <none> to f16758241ddd471497d21bbf2cf9124c (127.10.255.66). New cstate: current_term: 1 leader_uuid: "f16758241ddd471497d21bbf2cf9124c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f16758241ddd471497d21bbf2cf9124c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 44785 } health_report { overall_health: HEALTHY } } }
I20260806 09:15:24.256888 19620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:24.251063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40268 (local address 127.10.255.66:44785)
0806 09:15:24.251736 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:24.251741 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:24.251756 (+ 15us) server_negotiation.cc:407] Connection header received
0806 09:15:24.251825 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:24.251829 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:24.251986 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:24.252106 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:15:24.252556 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:24.253334 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:24.254900 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:24.255328 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:24.255490 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:24.256054 (+ 564us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:15:24.256178 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:15:24.256290 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:24.256463 (+ 173us) server_negotiation.cc:299] Negotiation successful
0806 09:15:24.256549 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":389,"threads_started":1}
I20260806 09:15:24.272644 19620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:24.266939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:54923 (local address 127.10.255.66:44785)
0806 09:15:24.267180 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:24.267187 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:24.267567 (+ 380us) server_negotiation.cc:407] Connection header received
0806 09:15:24.267722 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:24.267726 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:24.267799 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:24.267999 (+ 200us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:15:24.268433 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:24.269224 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:24.270834 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:24.271300 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:24.271446 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:24.271900 (+ 454us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:15:24.272007 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:15:24.272109 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:24.272215 (+ 106us) server_negotiation.cc:299] Negotiation successful
0806 09:15:24.272310 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 09:15:24.272764 19623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:24.266867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:44785 (local address 127.10.255.66:54923)
0806 09:15:24.267460 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:24.267477 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:24.267600 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:24.267978 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:24.267983 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:24.267995 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 09:15:24.268251 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:24.268261 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:24.269346 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:24.269354 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:24.270684 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:24.270697 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:24.271473 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:24.271479 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:24.271670 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:24.271709 (+ 39us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 09:15:24.272109 (+ 400us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 09:15:24.272122 (+ 13us) client_negotiation.cc:769] Sending connection context
0806 09:15:24.272201 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 09:15:24.272406 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"mutex_wait_us":48,"thread_start_us":270,"threads_started":1}
I20260806 09:15:24.282915 19442 raft_consensus.cc:1261] T 9c1d8d4c8d324672a44cf0840f6189c7 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 1 FOLLOWER]: Refusing update from remote peer f16758241ddd471497d21bbf2cf9124c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:15:24.282976 19156 raft_consensus.cc:1261] T 9c1d8d4c8d324672a44cf0840f6189c7 P be0049159fa14dd2a7df37d951b40151 [term 1 FOLLOWER]: Refusing update from remote peer f16758241ddd471497d21bbf2cf9124c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:15:24.283730 19619 consensus_queue.cc:1035] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c [LEADER]: Connected to new peer: Peer: permanent_uuid: "be0049159fa14dd2a7df37d951b40151" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:15:24.284288 19617 consensus_queue.cc:1035] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c6e114c999d46ec9330a8a6afdc5bd5" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:15:24.352428 18995 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:15:24.352814 18995 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35698:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:15:24.357015 18995 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 299a35aab9024488a78720fd6e7d9ba2: Sending DeleteTablet for 3 replicas of tablet 9c1d8d4c8d324672a44cf0840f6189c7
I20260806 09:15:24.358214 19418 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c1d8d4c8d324672a44cf0840f6189c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:15:24 UTC) from {username='oryx', principal='oryx/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:56784
I20260806 09:15:24.358278 19135 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c1d8d4c8d324672a44cf0840f6189c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:15:24 UTC) from {username='oryx', principal='oryx/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:40298
I20260806 09:15:24.358330 19276 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c1d8d4c8d324672a44cf0840f6189c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:15:24 UTC) from {username='oryx', principal='oryx/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:40254
I20260806 09:15:24.358624 19586 tablet_replica.cc:330] T 9c1d8d4c8d324672a44cf0840f6189c7 P 1c6e114c999d46ec9330a8a6afdc5bd5: stopping tablet replica
I20260806 09:15:24.358687 19587 tablet_replica.cc:330] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c: stopping tablet replica
I20260806 09:15:24.358688 19588 tablet_replica.cc:330] T 9c1d8d4c8d324672a44cf0840f6189c7 P be0049159fa14dd2a7df37d951b40151: stopping tablet replica
I20260806 09:15:24.358819 19586 raft_consensus.cc:2229] T 9c1d8d4c8d324672a44cf0840f6189c7 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:15:24.358876 19588 raft_consensus.cc:2229] T 9c1d8d4c8d324672a44cf0840f6189c7 P be0049159fa14dd2a7df37d951b40151 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:15:24.358880 19587 raft_consensus.cc:2229] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:15:24.359156 19588 raft_consensus.cc:2258] T 9c1d8d4c8d324672a44cf0840f6189c7 P be0049159fa14dd2a7df37d951b40151 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:15:24.359195 19586 raft_consensus.cc:2258] T 9c1d8d4c8d324672a44cf0840f6189c7 P 1c6e114c999d46ec9330a8a6afdc5bd5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:15:24.359654 19587 raft_consensus.cc:2258] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:15:24.360895 19586 ts_tablet_manager.cc:1905] T 9c1d8d4c8d324672a44cf0840f6189c7 P 1c6e114c999d46ec9330a8a6afdc5bd5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:15:24.361162 19587 ts_tablet_manager.cc:1905] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:15:24.363523 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 19069
I20260806 09:15:24.365610 19588 ts_tablet_manager.cc:1905] T 9c1d8d4c8d324672a44cf0840f6189c7 P be0049159fa14dd2a7df37d951b40151: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:15:24.370239 19587 ts_tablet_manager.cc:1918] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 09:15:24.370617 19587 log.cc:1196] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/9c1d8d4c8d324672a44cf0840f6189c7
I20260806 09:15:24.371326 19587 ts_tablet_manager.cc:1939] T 9c1d8d4c8d324672a44cf0840f6189c7 P f16758241ddd471497d21bbf2cf9124c: Deleting consensus metadata
I20260806 09:15:24.373023 18981 catalog_manager.cc:4841] TS f16758241ddd471497d21bbf2cf9124c (127.10.255.66:44785): tablet 9c1d8d4c8d324672a44cf0840f6189c7 (table test-table [id=12f59091df88463593f0ddea738eab0f]) successfully deleted
I20260806 09:15:24.374498 19588 ts_tablet_manager.cc:1918] T 9c1d8d4c8d324672a44cf0840f6189c7 P be0049159fa14dd2a7df37d951b40151: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 09:15:24.374699 19588 log.cc:1196] T 9c1d8d4c8d324672a44cf0840f6189c7 P be0049159fa14dd2a7df37d951b40151: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-0/wal/wals/9c1d8d4c8d324672a44cf0840f6189c7
I20260806 09:15:24.375239 19588 ts_tablet_manager.cc:1939] T 9c1d8d4c8d324672a44cf0840f6189c7 P be0049159fa14dd2a7df37d951b40151: Deleting consensus metadata
I20260806 09:15:24.378703 19586 ts_tablet_manager.cc:1918] T 9c1d8d4c8d324672a44cf0840f6189c7 P 1c6e114c999d46ec9330a8a6afdc5bd5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 09:15:24.378994 19586 log.cc:1196] T 9c1d8d4c8d324672a44cf0840f6189c7 P 1c6e114c999d46ec9330a8a6afdc5bd5: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/9c1d8d4c8d324672a44cf0840f6189c7
I20260806 09:15:24.379091 18981 catalog_manager.cc:4841] TS be0049159fa14dd2a7df37d951b40151 (127.10.255.65:37063): tablet 9c1d8d4c8d324672a44cf0840f6189c7 (table test-table [id=12f59091df88463593f0ddea738eab0f]) successfully deleted
I20260806 09:15:24.379660 19586 ts_tablet_manager.cc:1939] T 9c1d8d4c8d324672a44cf0840f6189c7 P 1c6e114c999d46ec9330a8a6afdc5bd5: Deleting consensus metadata
I20260806 09:15:24.381170 18981 catalog_manager.cc:4841] TS 1c6e114c999d46ec9330a8a6afdc5bd5 (127.10.255.67:34895): tablet 9c1d8d4c8d324672a44cf0840f6189c7 (table test-table [id=12f59091df88463593f0ddea738eab0f]) successfully deleted
Aug 06 09:15:24 dist-test-slave-mvvj krb5kdc[18951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007723, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.255.65@KRBTEST.COM
I20260806 09:15:24.398427 19631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:24.365002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40314 (local address 127.10.255.65:37063)
0806 09:15:24.377958 (+ 12956us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:24.377965 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:24.377994 (+ 29us) server_negotiation.cc:407] Connection header received
0806 09:15:24.378077 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:24.378082 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:24.378184 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:24.378344 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:24.380307 (+ 1963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:24.381580 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:24.383603 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:24.384228 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:24.384349 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:24.390199 (+ 5850us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:24.390230 (+ 31us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:24.390253 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:24.390311 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:24.394761 (+ 4450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:24.395802 (+ 1041us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:24.395813 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:24.395817 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:24.396044 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:24.396485 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:24.396491 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:24.396502 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:24.397044 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:24.397368 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:24.397719 (+ 351us) server_negotiation.cc:299] Negotiation successful
0806 09:15:24.397986 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12791,"thread_start_us":12644,"threads_started":1}
I20260806 09:15:24.399386 19201 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:24.543061 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 19069
I20260806 09:15:24.570816 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 19211
Aug 06 09:15:24 dist-test-slave-mvvj krb5kdc[18951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007723, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.255.66@KRBTEST.COM
I20260806 09:15:24.594732 19620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:24.571926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40282 (local address 127.10.255.66:44785)
0806 09:15:24.572137 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:24.572143 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:24.572168 (+ 25us) server_negotiation.cc:407] Connection header received
0806 09:15:24.572248 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:24.572252 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:24.572336 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:24.572425 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:24.574274 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:24.575185 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:24.577467 (+ 2282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:24.578901 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:24.579060 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:24.585436 (+ 6376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:24.585459 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:24.585480 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:24.585539 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:24.591024 (+ 5485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:24.592083 (+ 1059us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:24.592092 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:24.592095 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:24.592292 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:24.592818 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:24.592828 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:24.592830 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:24.593282 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:24.593662 (+ 380us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:24.594069 (+ 407us) server_negotiation.cc:299] Negotiation successful
0806 09:15:24.594352 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 09:15:24.595503 19342 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:24.774119 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 19211
I20260806 09:15:24.802532 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 19352
Aug 06 09:15:24 dist-test-slave-mvvj krb5kdc[18951](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007723, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.255.67@KRBTEST.COM
I20260806 09:15:24.825712 19634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:24.803657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56808 (local address 127.10.255.67:34895)
0806 09:15:24.804339 (+ 682us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:24.804345 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:24.804365 (+ 20us) server_negotiation.cc:407] Connection header received
0806 09:15:24.804428 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:24.804432 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:24.804499 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:24.804610 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:24.807195 (+ 2585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:24.808182 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:24.809833 (+ 1651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:24.810411 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:24.810530 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:24.817364 (+ 6834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:24.817386 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:24.817405 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:24.817474 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:24.822070 (+ 4596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:24.823075 (+ 1005us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:24.823084 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:24.823086 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:24.823279 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:24.823743 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:24.823749 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:24.823754 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:24.824301 (+ 547us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:24.824672 (+ 371us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:24.825042 (+ 370us) server_negotiation.cc:299] Negotiation successful
0806 09:15:24.825318 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":359,"threads_started":1}
I20260806 09:15:24.826753 19484 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:24.965098 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 19352
I20260806 09:15:24.990483 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 18964
I20260806 09:15:24.991778 19037 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:25.119489 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 18964
2026-08-06T09:15:25Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (6839 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:15:25 dist-test-slave-mvvj krb5kdc[19639](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:15:25 dist-test-slave-mvvj krb5kdc[19639](info): set up 2 sockets
Aug 06 09:15:25 dist-test-slave-mvvj krb5kdc[19639](info): commencing operation
krb5kdc: starting...
W20260806 09:15:26.291513 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.000s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:15:26 dist-test-slave-mvvj krb5kdc[19639](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007726, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:15:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:15:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:15:26.574191 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:45091
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:39745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:45091
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:15:26.972535 19652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:26.972877 19652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:26.973043 19652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:26.982157 19652 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:15:26.982314 19652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:26.982420 19652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:26.982515 19652 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:15:26.982613 19652 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:15:26.994549 19652 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:39745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:45091
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:45091
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:26.996111 19652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:26.997557 19652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:27.012322 19658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:27.012359 19657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:27.012398 19660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:27.013094 19652 server_base.cc:1034] running on GCE node
I20260806 09:15:27.014238 19652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:27.016322 19652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:27.017630 19652 hybrid_clock.cc:648] HybridClock initialized: now 1786007727017580 us; error 73 us; skew 500 ppm
I20260806 09:15:27.018108 19652 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-06T09:15:27Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1968 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:15:27 dist-test-slave-mvvj krb5kdc[19666](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:15:27 dist-test-slave-mvvj krb5kdc[19666](info): set up 2 sockets
Aug 06 09:15:27 dist-test-slave-mvvj krb5kdc[19666](info): commencing operation
krb5kdc: starting...
W20260806 09:15:28.272929 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.000s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:15:28 dist-test-slave-mvvj krb5kdc[19666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:15:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:15:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:15:28.542214 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:41329
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:41329
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:15:28.924651 19679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:28.925203 19679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:28.925391 19679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:28.934213 19679 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:15:28.934365 19679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:28.934461 19679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:28.934571 19679 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:15:28.934651 19679 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:15:28.945588 19679 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:41329
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:41329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:28.947162 19679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:28.948681 19679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:28.962592 19687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:28.962699 19684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:28.962671 19685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:28.964294 19679 server_base.cc:1034] running on GCE node
I20260806 09:15:28.965540 19679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:28.967794 19679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:28.969177 19679 hybrid_clock.cc:648] HybridClock initialized: now 1786007728969124 us; error 48 us; skew 500 ppm
I20260806 09:15:28.969719 19679 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:28 dist-test-slave-mvvj krb5kdc[19666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007728, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:28.973760 19679 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:15:28.975723 19679 webserver.cc:460] Webserver started at http://127.10.255.126:46395/ using document root <none> and password file <none>
I20260806 09:15:28.976600 19679 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:28.976768 19679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:28.977128 19679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:28.981190 19679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "ea5095d544f54a1b8c10f9fa9a5d6ca3"
format_stamp: "Formatted at 2026-08-06 09:15:28 on dist-test-slave-mvvj"
server_key: "9a72c6a0bedd938b3d611224321d9fb4"
server_key_iv: "42671d3d7f7f0e127afcb98ff5bbc8a5"
server_key_version: "encryptionkey@0"
I20260806 09:15:28.982519 19679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "ea5095d544f54a1b8c10f9fa9a5d6ca3"
format_stamp: "Formatted at 2026-08-06 09:15:28 on dist-test-slave-mvvj"
server_key: "9a72c6a0bedd938b3d611224321d9fb4"
server_key_iv: "42671d3d7f7f0e127afcb98ff5bbc8a5"
server_key_version: "encryptionkey@0"
I20260806 09:15:28.989712 19679 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.007s
I20260806 09:15:28.994535 19694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:28.996784 19679 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260806 09:15:28.997036 19679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "ea5095d544f54a1b8c10f9fa9a5d6ca3"
format_stamp: "Formatted at 2026-08-06 09:15:28 on dist-test-slave-mvvj"
server_key: "9a72c6a0bedd938b3d611224321d9fb4"
server_key_iv: "42671d3d7f7f0e127afcb98ff5bbc8a5"
server_key_version: "encryptionkey@0"
I20260806 09:15:28.997246 19679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:29.029218 19679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:29.034672 19679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:29.035039 19679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:29.056572 19679 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:41329
I20260806 09:15:29.056599 19745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:41329 every 8 connection(s)
I20260806 09:15:29.058132 19679 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:15:29.062366 19746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:29.062758 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 19679
I20260806 09:15:29.062988 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:15:29.063755 11261 external_mini_cluster.cc:1428] Setting key b058ec8a94f7b9a1174b380e1837b59e
I20260806 09:15:29.079643 19746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3: Bootstrap starting.
Aug 06 09:15:29 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:15:29.083621 19746 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:29.084884 19746 log.cc:824] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3: Log is configured to *not* fsync() on all Append() calls
I20260806 09:15:29.088671 19746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3: No bootstrap required, opened a new log
I20260806 09:15:29.090830 19749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:29.065984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55528 (local address 127.10.255.126:41329)
0806 09:15:29.066951 (+ 967us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:29.066964 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:29.067011 (+ 47us) server_negotiation.cc:407] Connection header received
0806 09:15:29.068866 (+ 1855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:29.068893 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:29.069371 (+ 478us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:29.069957 (+ 586us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:29.072047 (+ 2090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:29.073460 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:29.075416 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:29.076283 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:29.076427 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:29.081538 (+ 5111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:29.081548 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:29.081565 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:29.081625 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:29.085721 (+ 4096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:29.086704 (+ 983us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:29.086713 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:29.086720 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:29.086963 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:29.087442 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:29.087447 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:29.087449 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:29.088143 (+ 694us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:29.088440 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:29.089112 (+ 672us) server_negotiation.cc:299] Negotiation successful
0806 09:15:29.089712 (+ 600us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":726,"thread_start_us":458,"threads_started":1}
I20260806 09:15:29.098688 19746 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea5095d544f54a1b8c10f9fa9a5d6ca3" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 41329 } }
I20260806 09:15:29.099179 19746 raft_consensus.cc:374] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:29.099288 19746 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5095d544f54a1b8c10f9fa9a5d6ca3, State: Initialized, Role: FOLLOWER
I20260806 09:15:29.100039 19746 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea5095d544f54a1b8c10f9fa9a5d6ca3" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 41329 } }
I20260806 09:15:29.100365 19746 raft_consensus.cc:388] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:15:29.100531 19746 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:15:29.100701 19746 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:29.103408 19746 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea5095d544f54a1b8c10f9fa9a5d6ca3" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 41329 } }
I20260806 09:15:29.104333 19746 leader_election.cc:302] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea5095d544f54a1b8c10f9fa9a5d6ca3; no voters:
I20260806 09:15:29.105384 19746 leader_election.cc:288] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:15:29.105815 19751 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:15:29.107937 19751 raft_consensus.cc:686] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [term 1 LEADER]: Becoming Leader. State: Replica: ea5095d544f54a1b8c10f9fa9a5d6ca3, State: Running, Role: LEADER
I20260806 09:15:29.109555 19751 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea5095d544f54a1b8c10f9fa9a5d6ca3" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 41329 } }
I20260806 09:15:29.109841 19746 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:15:29.113735 19752 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ea5095d544f54a1b8c10f9fa9a5d6ca3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea5095d544f54a1b8c10f9fa9a5d6ca3" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 41329 } } }
I20260806 09:15:29.113868 19753 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea5095d544f54a1b8c10f9fa9a5d6ca3. Latest consensus state: current_term: 1 leader_uuid: "ea5095d544f54a1b8c10f9fa9a5d6ca3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea5095d544f54a1b8c10f9fa9a5d6ca3" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 41329 } } }
I20260806 09:15:29.114292 19753 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:29.114486 19752 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:29.115320 19760 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:15:29.120913 19760 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:15:29.131600 19760 catalog_manager.cc:1347] Generated new cluster ID: 56578f47f99c421d847b661c75edf6e2
I20260806 09:15:29.131753 19760 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:15:29.147128 19760 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:15:29.148695 19760 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:15:29.166252 19760 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3: Generated new TSK 0
I20260806 09:15:29.167523 19760 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.255.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
I20260806 09:15:29.249665 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:41329
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:15:29.628630 19772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:29.628959 19772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:29.629144 19772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:29.637152 19772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:29.637290 19772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:29.637495 19772 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:15:29.648475 19772 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:41329
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:29.649922 19772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:29.651314 19772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:29.666051 19778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:29.666301 19780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:29.666915 19777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:29.667207 19772 server_base.cc:1034] running on GCE node
I20260806 09:15:29.668081 19772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:29.669193 19772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:29.670492 19772 hybrid_clock.cc:648] HybridClock initialized: now 1786007729670414 us; error 67 us; skew 500 ppm
I20260806 09:15:29.670922 19772 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:29 dist-test-slave-mvvj krb5kdc[19666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007729, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:29.674701 19772 init.cc:377] Logged in from keytab as kudu/127.10.255.65@KRBTEST.COM (short username kudu)
I20260806 09:15:29.676565 19772 webserver.cc:460] Webserver started at http://127.10.255.65:37105/ using document root <none> and password file <none>
I20260806 09:15:29.677374 19772 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:29.677533 19772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:29.677964 19772 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:29.681396 19772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "0b22619e6d844e598fe7fb803edde3d9"
format_stamp: "Formatted at 2026-08-06 09:15:29 on dist-test-slave-mvvj"
server_key: "3f15be5e80c84f808966a116a7f40a90"
server_key_iv: "67be93ecd2acb3b311c6e67748111532"
server_key_version: "encryptionkey@0"
I20260806 09:15:29.682360 19772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "0b22619e6d844e598fe7fb803edde3d9"
format_stamp: "Formatted at 2026-08-06 09:15:29 on dist-test-slave-mvvj"
server_key: "3f15be5e80c84f808966a116a7f40a90"
server_key_iv: "67be93ecd2acb3b311c6e67748111532"
server_key_version: "encryptionkey@0"
I20260806 09:15:29.688452 19772 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260806 09:15:29.692431 19787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:29.694077 19772 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 09:15:29.694305 19772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "0b22619e6d844e598fe7fb803edde3d9"
format_stamp: "Formatted at 2026-08-06 09:15:29 on dist-test-slave-mvvj"
server_key: "3f15be5e80c84f808966a116a7f40a90"
server_key_iv: "67be93ecd2acb3b311c6e67748111532"
server_key_version: "encryptionkey@0"
I20260806 09:15:29.694556 19772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:29.717438 19772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:29.723289 19772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:29.723634 19772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:29.724773 19772 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:15:29.726301 19772 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:29.726383 19772 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:29.726552 19772 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:29.726611 19772 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:29.764179 19772 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:36733
I20260806 09:15:29.764230 19901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:36733 every 8 connection(s)
I20260806 09:15:29.765586 19772 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:15:29.770231 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 19772
I20260806 09:15:29.770464 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:15:29.771369 11261 external_mini_cluster.cc:1428] Setting key 153f9474aae265aaa34c8b3c8dde20ba
Aug 06 09:15:29 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007729, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:15:29.793219 19904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:29.768663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:57169 (local address 127.10.255.126:41329)
0806 09:15:29.769341 (+ 678us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:29.769346 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:29.770499 (+ 1153us) server_negotiation.cc:407] Connection header received
0806 09:15:29.773018 (+ 2519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:29.773023 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:29.773100 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:29.773221 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:29.775586 (+ 2365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:29.776409 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:29.779176 (+ 2767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:29.779653 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:29.779800 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:29.784968 (+ 5168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:29.784979 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:29.784987 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:29.785044 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:29.789002 (+ 3958us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:29.790072 (+ 1070us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:29.790081 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:29.790087 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:29.790271 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:29.790808 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:29.790815 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:29.790821 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:29.791259 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:29.791423 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:29.792396 (+ 973us) server_negotiation.cc:299] Negotiation successful
0806 09:15:29.792708 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":406,"threads_started":1}
I20260806 09:15:29.793978 19905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:29.769241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.65:57169)
0806 09:15:29.770247 (+ 1006us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:29.770303 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:29.772700 (+ 2397us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:29.773600 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:29.773610 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:29.774460 (+ 850us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:29.775354 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:29.775386 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:29.776599 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:29.776608 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:29.778927 (+ 2319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:29.778952 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:29.780001 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:29.780013 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:29.780408 (+ 395us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:29.781343 (+ 935us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:29.781388 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:29.784619 (+ 3231us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:29.789268 (+ 4649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:29.789279 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:29.789296 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:29.789902 (+ 606us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:29.790398 (+ 496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:29.790402 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:29.790404 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:29.790679 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:29.791444 (+ 765us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:29.791451 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:29.791945 (+ 494us) client_negotiation.cc:769] Sending connection context
0806 09:15:29.792239 (+ 294us) client_negotiation.cc:240] Negotiation successful
0806 09:15:29.792720 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":662,"thread_start_us":406,"threads_started":1}
I20260806 09:15:29.796028 19902 heartbeater.cc:347] Connected to a master server at 127.10.255.126:41329
I20260806 09:15:29.796375 19902 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:29.797201 19902 heartbeater.cc:511] Master 127.10.255.126:41329 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.255.66@KRBTEST.COM; defaulting to no policy
I20260806 09:15:29.800132 19711 ts_manager.cc:194] Registered new tserver with Master: 0b22619e6d844e598fe7fb803edde3d9 (127.10.255.65:36733)
I20260806 09:15:29.801991 19711 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.65@KRBTEST.COM'} at 127.10.255.65:57169
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
I20260806 09:15:29.836220 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:41329
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:15:30.208415 19909 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:30.208794 19909 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:30.208969 19909 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:30.216956 19909 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:30.217160 19909 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:30.217283 19909 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:15:30.228464 19909 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:41329
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:30.229828 19909 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:30.231153 19909 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:30.246021 19915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:30.246071 19914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:30.245865 19917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:30.247248 19909 server_base.cc:1034] running on GCE node
I20260806 09:15:30.248112 19909 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:30.249241 19909 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:30.250567 19909 hybrid_clock.cc:648] HybridClock initialized: now 1786007730250495 us; error 72 us; skew 500 ppm
I20260806 09:15:30.250988 19909 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:30 dist-test-slave-mvvj krb5kdc[19666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007730, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:30.260228 19909 init.cc:377] Logged in from keytab as kudu/127.10.255.66@KRBTEST.COM (short username kudu)
I20260806 09:15:30.262317 19909 webserver.cc:460] Webserver started at http://127.10.255.66:39037/ using document root <none> and password file <none>
I20260806 09:15:30.263125 19909 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:30.263288 19909 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:30.263638 19909 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:30.267024 19909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "6d785c1b7f7f480a9c1e9ab66568ee59"
format_stamp: "Formatted at 2026-08-06 09:15:30 on dist-test-slave-mvvj"
server_key: "2db8e646c7acf5f988c87c5c87b529ec"
server_key_iv: "6a533b45337c7d6a2f11ed430178086b"
server_key_version: "encryptionkey@0"
I20260806 09:15:30.268010 19909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "6d785c1b7f7f480a9c1e9ab66568ee59"
format_stamp: "Formatted at 2026-08-06 09:15:30 on dist-test-slave-mvvj"
server_key: "2db8e646c7acf5f988c87c5c87b529ec"
server_key_iv: "6a533b45337c7d6a2f11ed430178086b"
server_key_version: "encryptionkey@0"
I20260806 09:15:30.274034 19909 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 09:15:30.278230 19924 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:30.280671 19909 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:15:30.280937 19909 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "6d785c1b7f7f480a9c1e9ab66568ee59"
format_stamp: "Formatted at 2026-08-06 09:15:30 on dist-test-slave-mvvj"
server_key: "2db8e646c7acf5f988c87c5c87b529ec"
server_key_iv: "6a533b45337c7d6a2f11ed430178086b"
server_key_version: "encryptionkey@0"
I20260806 09:15:30.281215 19909 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:30.300349 19909 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:30.306471 19909 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:30.306910 19909 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:30.308116 19909 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:15:30.309702 19909 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:30.309815 19909 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:30.309983 19909 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:30.310081 19909 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:30.348532 19909 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:34885
I20260806 09:15:30.348593 20037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:34885 every 8 connection(s)
I20260806 09:15:30.349984 19909 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:15:30.353339 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 19909
I20260806 09:15:30.353592 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:15:30.354133 11261 external_mini_cluster.cc:1428] Setting key 0792cc6ced86dfd3a2e25676ad9f03c6
Aug 06 09:15:30 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007730, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:15:30.376091 20040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:30.352827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:56229 (local address 127.10.255.126:41329)
0806 09:15:30.353444 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:30.353454 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:30.354549 (+ 1095us) server_negotiation.cc:407] Connection header received
0806 09:15:30.356821 (+ 2272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:30.356827 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:30.356920 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:30.357117 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:30.358781 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:30.360186 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:30.362278 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:30.363199 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:30.363373 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:30.367802 (+ 4429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:30.367813 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:30.367821 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:30.367908 (+ 87us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:30.372202 (+ 4294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:30.373085 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:30.373094 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:30.373101 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:30.373282 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:30.373772 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:30.373781 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:30.373788 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:30.374227 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:30.374397 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:30.375176 (+ 779us) server_negotiation.cc:299] Negotiation successful
0806 09:15:30.375474 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":461,"thread_start_us":320,"threads_started":1}
I20260806 09:15:30.376901 20041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:30.353399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.66:56229)
0806 09:15:30.354358 (+ 959us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:30.354406 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:30.356518 (+ 2112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:30.357325 (+ 807us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:30.357334 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:30.357883 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:30.358506 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:30.358527 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:30.360417 (+ 1890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:30.360423 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:30.362080 (+ 1657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:30.362095 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:30.363489 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:30.363495 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:30.363725 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:30.364647 (+ 922us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:30.364678 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:30.367475 (+ 2797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:30.372396 (+ 4921us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:30.372407 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:30.372424 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:30.372931 (+ 507us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:30.373422 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:30.373427 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:30.373430 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:30.373643 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:30.374370 (+ 727us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:30.374377 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:30.374767 (+ 390us) client_negotiation.cc:769] Sending connection context
0806 09:15:30.375030 (+ 263us) client_negotiation.cc:240] Negotiation successful
0806 09:15:30.375472 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"thread_start_us":419,"threads_started":1}
I20260806 09:15:30.378871 20038 heartbeater.cc:347] Connected to a master server at 127.10.255.126:41329
I20260806 09:15:30.379311 20038 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:30.380673 20038 heartbeater.cc:511] Master 127.10.255.126:41329 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.255.67@KRBTEST.COM; defaulting to no policy
I20260806 09:15:30.382978 19711 ts_manager.cc:194] Registered new tserver with Master: 6d785c1b7f7f480a9c1e9ab66568ee59 (127.10.255.66:34885)
I20260806 09:15:30.384142 19711 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.66@KRBTEST.COM'} at 127.10.255.66:56229
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
I20260806 09:15:30.421203 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:41329
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:15:30.805735 19902 heartbeater.cc:503] Master 127.10.255.126:41329 was elected leader, sending a full tablet report...
W20260806 09:15:30.814311 20044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:30.814663 20044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:30.814769 20044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:30.823078 20044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:30.823247 20044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:30.823369 20044 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:15:30.834616 20044 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:41329
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:30.836176 20044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:30.837638 20044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:30.853389 20049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:30.853343 20052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:30.853456 20050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:30.857887 20044 server_base.cc:1034] running on GCE node
I20260806 09:15:30.858767 20044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:30.860091 20044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:30.861404 20044 hybrid_clock.cc:648] HybridClock initialized: now 1786007730861323 us; error 83 us; skew 500 ppm
I20260806 09:15:30.861881 20044 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:30 dist-test-slave-mvvj krb5kdc[19666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007730, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:30.865885 20044 init.cc:377] Logged in from keytab as kudu/127.10.255.67@KRBTEST.COM (short username kudu)
I20260806 09:15:30.867784 20044 webserver.cc:460] Webserver started at http://127.10.255.67:35611/ using document root <none> and password file <none>
I20260806 09:15:30.868733 20044 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:30.868902 20044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:30.869585 20044 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:30.873070 20044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "72560131a5f848abba82a6f240be858a"
format_stamp: "Formatted at 2026-08-06 09:15:30 on dist-test-slave-mvvj"
server_key: "f7b785fc043d417449350942c34b4017"
server_key_iv: "3f1a200f08857f33aeab70ac0ef03664"
server_key_version: "encryptionkey@0"
I20260806 09:15:30.874065 20044 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "72560131a5f848abba82a6f240be858a"
format_stamp: "Formatted at 2026-08-06 09:15:30 on dist-test-slave-mvvj"
server_key: "f7b785fc043d417449350942c34b4017"
server_key_iv: "3f1a200f08857f33aeab70ac0ef03664"
server_key_version: "encryptionkey@0"
I20260806 09:15:30.881301 20044 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260806 09:15:30.886332 20059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:30.888358 20044 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260806 09:15:30.888602 20044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "72560131a5f848abba82a6f240be858a"
format_stamp: "Formatted at 2026-08-06 09:15:30 on dist-test-slave-mvvj"
server_key: "f7b785fc043d417449350942c34b4017"
server_key_iv: "3f1a200f08857f33aeab70ac0ef03664"
server_key_version: "encryptionkey@0"
I20260806 09:15:30.888859 20044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:30.903303 20044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:30.908885 20044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:30.909238 20044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:30.910351 20044 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:15:30.912057 20044 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:30.912139 20044 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:30.912230 20044 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:30.912276 20044 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:30.951372 20044 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:45963
I20260806 09:15:30.951421 20172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:45963 every 8 connection(s)
I20260806 09:15:30.952805 20044 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:15:30.961717 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 20044
I20260806 09:15:30.961927 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:15:30.962544 11261 external_mini_cluster.cc:1428] Setting key dd9dafd62e176b5e631f2368e9616a3d
Aug 06 09:15:30 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007730, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:15:30.977522 20175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:30.955734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:49019 (local address 127.10.255.126:41329)
0806 09:15:30.956338 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:30.956346 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:30.957356 (+ 1010us) server_negotiation.cc:407] Connection header received
0806 09:15:30.959359 (+ 2003us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:30.959363 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:30.959464 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:30.959573 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:30.961726 (+ 2153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:30.962939 (+ 1213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:30.965401 (+ 2462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:30.966016 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:30.966170 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:30.970917 (+ 4747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:30.970923 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:30.970926 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:30.970971 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:30.973868 (+ 2897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:30.974787 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:30.974791 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:30.974794 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:30.974929 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:30.975416 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:30.975428 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:30.975431 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:30.975724 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:30.975916 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:30.976840 (+ 924us) server_negotiation.cc:299] Negotiation successful
0806 09:15:30.977108 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":468,"thread_start_us":310,"threads_started":1}
I20260806 09:15:30.978762 20176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:30.956232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.67:49019)
0806 09:15:30.957145 (+ 913us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:30.957197 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:30.959039 (+ 1842us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:30.959824 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:30.959904 (+ 80us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:30.960741 (+ 837us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:30.961401 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:30.961424 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:30.963208 (+ 1784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:30.963214 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:30.965221 (+ 2007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:30.965238 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:30.966267 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:30.966273 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:30.966537 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:30.967243 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:30.967267 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:30.970595 (+ 3328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:30.974070 (+ 3475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:30.974082 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:30.974105 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:30.974620 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:30.975053 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:30.975059 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:30.975062 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:30.975279 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:30.975896 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:30.975905 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:30.976343 (+ 438us) client_negotiation.cc:769] Sending connection context
0806 09:15:30.976700 (+ 357us) client_negotiation.cc:240] Negotiation successful
0806 09:15:30.977306 (+ 606us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":384,"threads_started":1}
I20260806 09:15:30.981235 20173 heartbeater.cc:347] Connected to a master server at 127.10.255.126:41329
I20260806 09:15:30.981721 20173 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:30.982647 20173 heartbeater.cc:511] Master 127.10.255.126:41329 requested a full tablet report, sending...
I20260806 09:15:30.984689 19711 ts_manager.cc:194] Registered new tserver with Master: 72560131a5f848abba82a6f240be858a (127.10.255.67:45963)
I20260806 09:15:30.985737 19711 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.67@KRBTEST.COM'} at 127.10.255.67:49019
I20260806 09:15:30.992424 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.10.255.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.255.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.255.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.65.keytab.
Entry for principal oryx/127.10.255.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.65.keytab.
WARNING: no policy specified for oryx/127.10.255.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.255.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.255.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.66.keytab.
Entry for principal oryx/127.10.255.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.66.keytab.
WARNING: no policy specified for oryx/127.10.255.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.255.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.255.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.67.keytab.
Entry for principal oryx/127.10.255.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.67.keytab.
I20260806 09:15:31.161717 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 19772
Aug 06 09:15:31 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.65@KRBTEST.COM
I20260806 09:15:31.181123 20184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:31.163233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37082 (local address 127.10.255.65:36733)
0806 09:15:31.164065 (+ 832us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:31.164073 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:31.164101 (+ 28us) server_negotiation.cc:407] Connection header received
0806 09:15:31.164168 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:31.164175 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:31.164398 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:31.164548 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:31.166081 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:31.167174 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:31.168649 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:31.169329 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:31.169458 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:31.174390 (+ 4932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:31.174417 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:31.174435 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:31.174484 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:31.177901 (+ 3417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:31.178818 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:31.178827 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:31.178830 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:31.178985 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:31.179366 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:31.179369 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:31.179371 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:31.179824 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:31.180195 (+ 371us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:31.180503 (+ 308us) server_negotiation.cc:299] Negotiation successful
0806 09:15:31.180780 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":641,"thread_start_us":442,"threads_started":1}
I20260806 09:15:31.182880 19897 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:31.276877 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 19772
I20260806 09:15:31.296798 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 19909
Aug 06 09:15:31 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.66@KRBTEST.COM
I20260806 09:15:31.317011 20186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:31.297802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52408 (local address 127.10.255.66:34885)
0806 09:15:31.298529 (+ 727us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:31.298537 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:31.298566 (+ 29us) server_negotiation.cc:407] Connection header received
0806 09:15:31.298639 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:31.298646 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:31.298861 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:31.299006 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:31.300675 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:31.301923 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:31.303548 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:31.304322 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:31.304528 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:31.309406 (+ 4878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:31.309425 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:31.309450 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:31.309501 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:31.313184 (+ 3683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:31.314177 (+ 993us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:31.314185 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:31.314188 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:31.314352 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:31.315044 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:31.315049 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:31.315051 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:31.315571 (+ 520us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:31.315903 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:31.316285 (+ 382us) server_negotiation.cc:299] Negotiation successful
0806 09:15:31.316669 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":412,"threads_started":1}
I20260806 09:15:31.318485 20033 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:31.406045 20038 heartbeater.cc:503] Master 127.10.255.126:41329 was elected leader, sending a full tablet report...
I20260806 09:15:31.407280 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 19909
W20260806 09:15:31.426467 19696 connection.cc:535] server connection from 127.10.255.66:56229 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 09:15:31.426642 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 20044
Aug 06 09:15:31 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.67@KRBTEST.COM
I20260806 09:15:31.447093 20188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:31.428027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60286 (local address 127.10.255.67:45963)
0806 09:15:31.428662 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:31.428678 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:31.428711 (+ 33us) server_negotiation.cc:407] Connection header received
0806 09:15:31.428786 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:31.428793 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:31.429032 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:31.429226 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:31.431021 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:31.432221 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:31.433670 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:31.434315 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:31.434500 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:31.439980 (+ 5480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:31.440002 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:31.440020 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:31.440072 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:31.443662 (+ 3590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:31.444680 (+ 1018us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:31.444688 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:31.444691 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:31.444842 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:31.445291 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:31.445296 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:31.445298 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:31.445702 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:31.446037 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:31.446381 (+ 344us) server_negotiation.cc:299] Negotiation successful
0806 09:15:31.446694 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":313,"threads_started":1}
I20260806 09:15:31.448542 20168 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:31.546463 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 20044
I20260806 09:15:31.566596 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 19679
I20260806 09:15:31.568087 19741 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:31.680371 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 19679
I20260806 09:15:31.703915 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:41329
--webserver_interface=127.10.255.126
--webserver_port=46395
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:41329
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:15:32.093652 20191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:32.094056 20191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:32.094244 20191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:32.102089 20191 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:15:32.102231 20191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:32.102308 20191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:32.102404 20191 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:15:32.102470 20191 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:15:32.113366 20191 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:41329
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:41329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=46395
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:32.115161 20191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:32.116777 20191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:32.131199 20196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:32.131176 20197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:32.131217 20199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:32.132182 20191 server_base.cc:1034] running on GCE node
I20260806 09:15:32.133206 20191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:32.134985 20191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:32.136300 20191 hybrid_clock.cc:648] HybridClock initialized: now 1786007732136235 us; error 52 us; skew 500 ppm
I20260806 09:15:32.136819 20191 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:32 dist-test-slave-mvvj krb5kdc[19666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007732, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:32.140661 20191 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:15:32.142863 20191 webserver.cc:460] Webserver started at http://127.10.255.126:46395/ using document root <none> and password file <none>
I20260806 09:15:32.143762 20191 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:32.144001 20191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:32.151211 20191 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.002s
I20260806 09:15:32.154989 20206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:32.156828 20191 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:15:32.157111 20191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "ea5095d544f54a1b8c10f9fa9a5d6ca3"
format_stamp: "Formatted at 2026-08-06 09:15:28 on dist-test-slave-mvvj"
server_key: "9a72c6a0bedd938b3d611224321d9fb4"
server_key_iv: "42671d3d7f7f0e127afcb98ff5bbc8a5"
server_key_version: "encryptionkey@0"
I20260806 09:15:32.158293 20191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:32.189162 20191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:32.194680 20191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:32.195056 20191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:32.220081 20191 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:41329
I20260806 09:15:32.220100 20257 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:41329 every 8 connection(s)
I20260806 09:15:32.221889 20191 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:15:32.224324 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 20191
I20260806 09:15:32.225246 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:36733
--local_ip_for_outbound_sockets=127.10.255.65
--tserver_master_addrs=127.10.255.126:41329
--webserver_port=37105
--webserver_interface=127.10.255.65
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.255.65
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.65.keytab with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:15:32.230832 20258 sys_catalog.cc:263] Verifying existing consensus state
I20260806 09:15:32.235705 20258 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3: Bootstrap starting.
I20260806 09:15:32.268486 20258 log.cc:824] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3: Log is configured to *not* fsync() on all Append() calls
I20260806 09:15:32.281390 20258 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 09:15:32.282141 20258 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3: Bootstrap complete.
I20260806 09:15:32.293937 20258 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea5095d544f54a1b8c10f9fa9a5d6ca3" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 41329 } }
I20260806 09:15:32.295341 20258 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea5095d544f54a1b8c10f9fa9a5d6ca3, State: Initialized, Role: FOLLOWER
I20260806 09:15:32.296172 20258 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea5095d544f54a1b8c10f9fa9a5d6ca3" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 41329 } }
I20260806 09:15:32.296485 20258 raft_consensus.cc:388] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:15:32.296628 20258 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:15:32.296830 20258 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [term 1 FOLLOWER]: Advancing to term 2
I20260806 09:15:32.301584 20258 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea5095d544f54a1b8c10f9fa9a5d6ca3" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 41329 } }
I20260806 09:15:32.302228 20258 leader_election.cc:302] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea5095d544f54a1b8c10f9fa9a5d6ca3; no voters:
I20260806 09:15:32.303231 20258 leader_election.cc:288] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 09:15:32.303443 20262 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 09:15:32.304827 20262 raft_consensus.cc:686] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [term 2 LEADER]: Becoming Leader. State: Replica: ea5095d544f54a1b8c10f9fa9a5d6ca3, State: Running, Role: LEADER
I20260806 09:15:32.305760 20262 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea5095d544f54a1b8c10f9fa9a5d6ca3" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 41329 } }
I20260806 09:15:32.306455 20258 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:15:32.309293 20264 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea5095d544f54a1b8c10f9fa9a5d6ca3. Latest consensus state: current_term: 2 leader_uuid: "ea5095d544f54a1b8c10f9fa9a5d6ca3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea5095d544f54a1b8c10f9fa9a5d6ca3" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 41329 } } }
I20260806 09:15:32.309268 20263 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ea5095d544f54a1b8c10f9fa9a5d6ca3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea5095d544f54a1b8c10f9fa9a5d6ca3" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 41329 } } }
I20260806 09:15:32.309978 20264 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:32.309986 20263 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3 [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:32.322484 20268 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:15:32.330157 20268 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:15:32.331903 20268 catalog_manager.cc:1259] Loaded cluster ID: 56578f47f99c421d847b661c75edf6e2
I20260806 09:15:32.332085 20268 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:15:32.336664 20268 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:15:32.338384 20268 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ea5095d544f54a1b8c10f9fa9a5d6ca3: Loaded TSK: 0
I20260806 09:15:32.340240 20268 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 09:15:32.643126 20260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:32.643519 20260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:32.643687 20260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:32.651582 20260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:32.651780 20260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:32.652004 20260 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:15:32.663328 20260 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.65.keytab
--principal=oryx/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:36733
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=37105
--tserver_master_addrs=127.10.255.126:41329
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:32.665275 20260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:32.666725 20260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:32.686620 20286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:32.687014 20285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:32.687947 20288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:32.688020 20260 server_base.cc:1034] running on GCE node
I20260806 09:15:32.688920 20260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:32.690143 20260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:32.691470 20260 hybrid_clock.cc:648] HybridClock initialized: now 1786007732691415 us; error 54 us; skew 500 ppm
I20260806 09:15:32.691978 20260 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:32 dist-test-slave-mvvj krb5kdc[19666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007732, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:32.697288 20260 init.cc:377] Logged in from keytab as oryx/127.10.255.65@KRBTEST.COM (short username oryx)
I20260806 09:15:32.699460 20260 webserver.cc:460] Webserver started at http://127.10.255.65:37105/ using document root <none> and password file <none>
I20260806 09:15:32.700390 20260 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:32.700572 20260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:32.709482 20260 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.007s sys 0.000s
I20260806 09:15:32.713562 20295 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:32.716148 20260 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.001s
I20260806 09:15:32.716396 20260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "0b22619e6d844e598fe7fb803edde3d9"
format_stamp: "Formatted at 2026-08-06 09:15:29 on dist-test-slave-mvvj"
server_key: "3f15be5e80c84f808966a116a7f40a90"
server_key_iv: "67be93ecd2acb3b311c6e67748111532"
server_key_version: "encryptionkey@0"
I20260806 09:15:32.718056 20260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:32.751183 20260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:32.757246 20260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:32.757786 20260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:32.759163 20260 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:15:32.760829 20260 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:32.760941 20260 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:32.761089 20260 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:32.761195 20260 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:32.801028 20260 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:36733
I20260806 09:15:32.801103 20408 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:36733 every 8 connection(s)
I20260806 09:15:32.802757 20260 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:15:32.810775 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 20260
I20260806 09:15:32.811676 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:34885
--local_ip_for_outbound_sockets=127.10.255.66
--tserver_master_addrs=127.10.255.126:41329
--webserver_port=39037
--webserver_interface=127.10.255.66
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.255.66
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.66.keytab with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 09:15:32 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:32 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:32.828063 20413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:32.806485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.65:59109)
0806 09:15:32.807672 (+ 1187us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:32.807731 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:32.810094 (+ 2363us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:32.812367 (+ 2273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:32.812376 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:32.813038 (+ 662us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:32.813669 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:32.813691 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:32.816414 (+ 2723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:32.816420 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:32.817864 (+ 1444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:32.817886 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:32.819630 (+ 1744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:32.819639 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:32.820108 (+ 469us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:32.821120 (+ 1012us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:32.821170 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:32.826845 (+ 5675us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":832,"thread_start_us":481,"threads_started":1}
W20260806 09:15:32.828855 20409 heartbeater.cc:644] Failed to heartbeat to 127.10.255.126:41329 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.255.126:41329: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
W20260806 09:15:32.829807 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:32.806444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:59109 (local address 127.10.255.126:41329)
0806 09:15:32.807230 (+ 786us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:32.807244 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:32.807980 (+ 736us) server_negotiation.cc:407] Connection header received
0806 09:15:32.810885 (+ 2905us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:32.810910 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:32.811511 (+ 601us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:32.812090 (+ 579us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:32.814020 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:32.816138 (+ 2118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:32.818089 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:32.819293 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:32.819529 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:32.827423 (+ 7894us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.65:59109: BlockingRecv error: recv got EOF from 127.10.255.65:59109 (error 108)
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":335,"threads_started":1}
Aug 06 09:15:32 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:32 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
W20260806 09:15:32.842029 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:32.829711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:58319 (local address 127.10.255.126:41329)
0806 09:15:32.830706 (+ 995us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:32.830716 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:32.830746 (+ 30us) server_negotiation.cc:407] Connection header received
0806 09:15:32.830822 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:32.830831 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:32.830927 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:32.831065 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:32.832154 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:32.833608 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:32.835332 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:32.836267 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:32.836459 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:32.841728 (+ 5269us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.65:58319: BlockingRecv error: recv got EOF from 127.10.255.65:58319 (error 108)
Metrics: {"server-negotiator.queue_time_us":840,"thread_start_us":1681,"threads_started":1}
I20260806 09:15:32.841770 20413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:32.829627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.65:58319)
0806 09:15:32.829973 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:32.830002 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:32.830165 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:32.831161 (+ 996us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:32.831170 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:32.831710 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:32.831985 (+ 275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:32.831996 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:32.833842 (+ 1846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:32.833850 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:32.835135 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:32.835155 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:32.836483 (+ 1328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:32.836489 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:32.836651 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:32.837415 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:32.837441 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:32.841336 (+ 3895us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160}
Aug 06 09:15:32 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:32 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:32.853416 20413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:32.843396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.65:50567)
0806 09:15:32.843669 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:32.843693 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:32.843889 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:32.844293 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:32.844297 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:32.844793 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:32.844992 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:32.845003 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:32.846624 (+ 1621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:32.846629 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:32.847680 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:32.847693 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:32.848880 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:32.848886 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:32.849029 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:32.849728 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:32.849748 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:32.853076 (+ 3328us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117}
W20260806 09:15:32.853576 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:32.843658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:50567 (local address 127.10.255.126:41329)
0806 09:15:32.843891 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:32.843898 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:32.843921 (+ 23us) server_negotiation.cc:407] Connection header received
0806 09:15:32.844028 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:32.844034 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:32.844128 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:32.844241 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:32.845157 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:32.846442 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:32.847893 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:32.848692 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:32.848843 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:32.853328 (+ 4485us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.65:50567: BlockingRecv error: recv got EOF from 127.10.255.65:50567 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260806 09:15:32.853896 20409 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 09:15:33.205713 20414 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:33.206061 20414 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:33.206220 20414 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:33.214421 20414 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:33.214567 20414 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:33.214857 20414 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:15:33.226533 20414 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.66.keytab
--principal=oryx/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:34885
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=39037
--tserver_master_addrs=127.10.255.126:41329
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:33.228116 20414 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:33.229532 20414 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:33.245247 20421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:33.245254 20420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:33.245258 20423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:33.246753 20414 server_base.cc:1034] running on GCE node
I20260806 09:15:33.247567 20414 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:33.248831 20414 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:33.250099 20414 hybrid_clock.cc:648] HybridClock initialized: now 1786007733250026 us; error 65 us; skew 500 ppm
I20260806 09:15:33.250509 20414 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:33 dist-test-slave-mvvj krb5kdc[19666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007733, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:33.254458 20414 init.cc:377] Logged in from keytab as oryx/127.10.255.66@KRBTEST.COM (short username oryx)
I20260806 09:15:33.256560 20414 webserver.cc:460] Webserver started at http://127.10.255.66:39037/ using document root <none> and password file <none>
I20260806 09:15:33.257388 20414 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:33.257579 20414 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:33.264413 20414 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.007s sys 0.000s
I20260806 09:15:33.268266 20430 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:33.270020 20414 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:15:33.270293 20414 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "6d785c1b7f7f480a9c1e9ab66568ee59"
format_stamp: "Formatted at 2026-08-06 09:15:30 on dist-test-slave-mvvj"
server_key: "2db8e646c7acf5f988c87c5c87b529ec"
server_key_iv: "6a533b45337c7d6a2f11ed430178086b"
server_key_version: "encryptionkey@0"
I20260806 09:15:33.271499 20414 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:33.287959 20414 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:33.293581 20414 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:33.293947 20414 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:33.295105 20414 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:15:33.296708 20414 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:33.296849 20414 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:33.296996 20414 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:33.297093 20414 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:33.335912 20414 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:34885
I20260806 09:15:33.335943 20542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:34885 every 8 connection(s)
I20260806 09:15:33.337602 20414 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:15:33.346314 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 20414
I20260806 09:15:33.347168 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:45963
--local_ip_for_outbound_sockets=127.10.255.67
--tserver_master_addrs=127.10.255.126:41329
--webserver_port=35611
--webserver_interface=127.10.255.67
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43477
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.255.67
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.67.keytab with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 09:15:33 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:33 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
W20260806 09:15:33.359754 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:33.340757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:59769 (local address 127.10.255.126:41329)
0806 09:15:33.340989 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:33.340995 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:33.342486 (+ 1491us) server_negotiation.cc:407] Connection header received
0806 09:15:33.345118 (+ 2632us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:33.345124 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:33.345206 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:33.345311 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:33.348120 (+ 2809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.348877 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.352131 (+ 3254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.352630 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.352751 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:33.359416 (+ 6665us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.66:59769: BlockingRecv error: recv got EOF from 127.10.255.66:59769 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 09:15:33.360292 20545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:33.341358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.66:59769)
0806 09:15:33.342248 (+ 890us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:33.342309 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:33.344701 (+ 2392us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:33.345627 (+ 926us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:33.345637 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:33.346713 (+ 1076us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:33.347768 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:33.347805 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.349122 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.349131 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:33.351790 (+ 2659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:33.351825 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.352942 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.352994 (+ 52us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:33.353390 (+ 396us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:33.354473 (+ 1083us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:33.354514 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:33.359073 (+ 4559us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":360,"threads_started":1}
W20260806 09:15:33.361033 20543 heartbeater.cc:644] Failed to heartbeat to 127.10.255.126:41329 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.255.126:41329: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Aug 06 09:15:33 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:33 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:33.371735 20545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:33.361716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.66:49193)
0806 09:15:33.361915 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:33.361942 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:33.362047 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:33.362578 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:33.362585 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:33.362951 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:33.363122 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:33.363131 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.364816 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.364820 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:33.365885 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:33.365901 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.367194 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.367199 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:33.367346 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:33.368212 (+ 866us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:33.368231 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:33.371502 (+ 3271us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 09:15:33.372331 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:33.361822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:49193 (local address 127.10.255.126:41329)
0806 09:15:33.362021 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:33.362029 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:33.362053 (+ 24us) server_negotiation.cc:407] Connection header received
0806 09:15:33.362224 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:33.362233 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:33.362341 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:33.362466 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:33.363283 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.364625 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.366107 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.366980 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.367176 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:33.371977 (+ 4801us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.66:49193: BlockingRecv error: recv got EOF from 127.10.255.66:49193 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 06 09:15:33 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:33 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:33.382617 20545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:33.372659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.66:51425)
0806 09:15:33.372840 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:33.372861 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:33.372986 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:33.373535 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:33.373539 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:33.373876 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:33.374039 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:33.374049 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.375357 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.375363 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:33.376757 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:33.376777 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.377677 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.377683 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:33.377907 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:33.378715 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:33.378752 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:33.382253 (+ 3501us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":55}
W20260806 09:15:33.382808 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:33.373088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:51425 (local address 127.10.255.126:41329)
0806 09:15:33.373262 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:33.373266 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:33.373281 (+ 15us) server_negotiation.cc:407] Connection header received
0806 09:15:33.373332 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:33.373335 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:33.373390 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:33.373500 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:33.374197 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.375180 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.376950 (+ 1770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.377490 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.377645 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:33.382560 (+ 4915us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.66:51425: BlockingRecv error: recv got EOF from 127.10.255.66:51425 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260806 09:15:33.383080 20543 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 09:15:33.770332 20546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:33.770665 20546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:33.770812 20546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:33.778801 20546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:33.778940 20546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:33.779127 20546 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:15:33.790056 20546 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43477
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/krb5kdc/oryx_127.10.255.67.keytab
--principal=oryx/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:45963
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=35611
--tserver_master_addrs=127.10.255.126:41329
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:33.791584 20546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:33.793089 20546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:33.808506 20551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:33.808815 20552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:33.808874 20554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:33.809820 20546 server_base.cc:1034] running on GCE node
I20260806 09:15:33.811169 20546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:33.812748 20546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:33.814080 20546 hybrid_clock.cc:648] HybridClock initialized: now 1786007733814040 us; error 88 us; skew 500 ppm
I20260806 09:15:33.814522 20546 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:33 dist-test-slave-mvvj krb5kdc[19666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007733, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:33.819206 20546 init.cc:377] Logged in from keytab as oryx/127.10.255.67@KRBTEST.COM (short username oryx)
I20260806 09:15:33.822065 20546 webserver.cc:460] Webserver started at http://127.10.255.67:35611/ using document root <none> and password file <none>
I20260806 09:15:33.823307 20546 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:33.823526 20546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:33.832382 20546 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.004s sys 0.003s
I20260806 09:15:33.836030 20561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:33.837822 20546 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:15:33.838084 20546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "72560131a5f848abba82a6f240be858a"
format_stamp: "Formatted at 2026-08-06 09:15:30 on dist-test-slave-mvvj"
server_key: "f7b785fc043d417449350942c34b4017"
server_key_iv: "3f1a200f08857f33aeab70ac0ef03664"
server_key_version: "encryptionkey@0"
I20260806 09:15:33.839310 20546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:33.859301 20546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
Aug 06 09:15:33 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:33 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:33.865681 20546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:33.866029 20546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:33.866291 20566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:33.854945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.65:39685)
0806 09:15:33.855531 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:33.855559 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:33.855723 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:33.856230 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:33.856234 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:33.856710 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:33.856932 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:33.856943 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.858425 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.858430 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:33.859557 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:33.859578 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.860730 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.860736 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:33.860877 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:33.861511 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:33.861537 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:33.865986 (+ 4449us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":593,"threads_started":1}
W20260806 09:15:33.866773 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:33.855165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:39685 (local address 127.10.255.126:41329)
0806 09:15:33.855374 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:33.855379 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:33.855751 (+ 372us) server_negotiation.cc:407] Connection header received
0806 09:15:33.855905 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:33.855910 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:33.856000 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:33.856128 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:33.857133 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.858225 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.859740 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.860461 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.860626 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:33.866330 (+ 5704us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.65:39685: BlockingRecv error: recv got EOF from 127.10.255.65:39685 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
I20260806 09:15:33.867373 20546 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:15:33.869437 20546 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:33.869630 20546 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:33.869771 20546 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:33.869831 20546 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:33.914048 20546 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:45963
I20260806 09:15:33.914443 20676 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:45963 every 8 connection(s)
I20260806 09:15:33.916249 20546 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:15:33.922070 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 20546
Aug 06 09:15:33 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:33 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
W20260806 09:15:33.940728 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:33.921864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:37203 (local address 127.10.255.126:41329)
0806 09:15:33.922189 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:33.922199 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:33.924551 (+ 2352us) server_negotiation.cc:407] Connection header received
0806 09:15:33.926907 (+ 2356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:33.926913 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:33.927017 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:33.927159 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:33.929559 (+ 2400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.930753 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.933021 (+ 2268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.933876 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.934084 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:33.940416 (+ 6332us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.67:37203: BlockingRecv error: recv got EOF from 127.10.255.67:37203 (error 108)
Metrics: {"mutex_wait_us":117,"server-negotiator.queue_time_us":129}
I20260806 09:15:33.941530 20679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:33.922325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.67:37203)
0806 09:15:33.924278 (+ 1953us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:33.924414 (+ 136us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:33.926520 (+ 2106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:33.927665 (+ 1145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:33.927675 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:33.928622 (+ 947us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:33.929331 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:33.929353 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.930989 (+ 1636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.930996 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:33.932808 (+ 1812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:33.932825 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.934237 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.934246 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:33.934506 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:33.935390 (+ 884us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:33.935418 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:33.940193 (+ 4775us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1140,"thread_start_us":890,"threads_started":1}
W20260806 09:15:33.942477 20677 heartbeater.cc:644] Failed to heartbeat to 127.10.255.126:41329 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.255.126:41329: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
I20260806 09:15:33.946576 20680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:33.923186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55540 (local address 127.10.255.126:41329)
0806 09:15:33.927443 (+ 4257us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:33.927449 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:33.928033 (+ 584us) server_negotiation.cc:407] Connection header received
0806 09:15:33.928251 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:33.928256 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:33.928342 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:33.928458 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:33.930503 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.931802 (+ 1299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.933304 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.933866 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.933972 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:33.937559 (+ 3587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:33.937574 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:33.937688 (+ 114us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:33.937771 (+ 83us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:33.941847 (+ 4076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:33.943025 (+ 1178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:33.943038 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:33.943050 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:33.943387 (+ 337us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:33.944004 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:33.944009 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:33.944014 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:33.944642 (+ 628us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:33.944968 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:33.945619 (+ 651us) server_negotiation.cc:299] Negotiation successful
0806 09:15:33.946111 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":4103,"thread_start_us":3955,"threads_started":1}
Aug 06 09:15:33 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:33 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:33.954185 20679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:33.943274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.67:33755)
0806 09:15:33.943700 (+ 426us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:33.943722 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:33.943837 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:33.944241 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:33.944248 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:33.944840 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:33.945039 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:33.945051 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.946796 (+ 1745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.946807 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:33.948074 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:33.948095 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.949061 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.949070 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:33.949277 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:33.950095 (+ 818us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:33.950121 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:33.953932 (+ 3811us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":268}
W20260806 09:15:33.954504 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:33.943515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:33755 (local address 127.10.255.126:41329)
0806 09:15:33.943808 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:33.943813 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:33.943859 (+ 46us) server_negotiation.cc:407] Connection header received
0806 09:15:33.944011 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:33.944014 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:33.944097 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:33.944208 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:33.945308 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.946551 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.948311 (+ 1760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.948866 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.948988 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:33.954194 (+ 5206us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.67:33755: BlockingRecv error: recv got EOF from 127.10.255.67:33755 (error 108)
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":161}
Aug 06 09:15:33 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:33 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:33.965363 20679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:33.955010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.67:58277)
0806 09:15:33.955188 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:33.955207 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:33.955318 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:33.955658 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:33.955662 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:33.956048 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:33.956211 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:33.956221 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.957969 (+ 1748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.957975 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:33.959086 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:33.959102 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.960045 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.960051 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:33.960241 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:33.960984 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:33.961011 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:33.965033 (+ 4022us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":61}
W20260806 09:15:33.965550 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:33.955153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:58277 (local address 127.10.255.126:41329)
0806 09:15:33.955309 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:33.955313 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:33.955331 (+ 18us) server_negotiation.cc:407] Connection header received
0806 09:15:33.955407 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:33.955411 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:33.955467 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:33.955626 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:33.956523 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.957763 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.959294 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:33.959790 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:33.960025 (+ 235us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:33.965310 (+ 5285us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.67:58277: BlockingRecv error: recv got EOF from 127.10.255.67:58277 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260806 09:15:33.965715 20677 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 06 09:15:34 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:34 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:34.394754 20683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:34.384093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.66:40549)
0806 09:15:34.384727 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:34.384745 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:34.385000 (+ 255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:34.385545 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:34.385551 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:34.386275 (+ 724us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:34.386600 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:34.386614 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:34.387944 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:34.387955 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:34.389103 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:34.389122 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:34.390175 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:34.390183 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:34.390385 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:34.391125 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:34.391144 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:34.394392 (+ 3248us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":343,"threads_started":1}
W20260806 09:15:34.394941 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:34.384171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:40549 (local address 127.10.255.126:41329)
0806 09:15:34.384595 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:34.384603 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:34.384859 (+ 256us) server_negotiation.cc:407] Connection header received
0806 09:15:34.385201 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:34.385205 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:34.385278 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:34.385478 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:34.386830 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:34.387717 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:34.389386 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:34.389914 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:34.390085 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:34.394664 (+ 4579us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.66:40549: BlockingRecv error: recv got EOF from 127.10.255.66:40549 (error 108)
Metrics: {"server-negotiator.queue_time_us":134}
Aug 06 09:15:34 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:34 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:34.878777 20684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:34.868054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.65:34491)
0806 09:15:34.868718 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:34.868736 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:34.868885 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:34.869290 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:34.869295 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:34.869795 (+ 500us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:34.870027 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:34.870039 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:34.871798 (+ 1759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:34.871805 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:34.873008 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:34.873028 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:34.874136 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:34.874142 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:34.874286 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:34.875064 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:34.875085 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:34.878510 (+ 3425us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":382,"threads_started":1}
W20260806 09:15:34.879112 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:34.868061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:34491 (local address 127.10.255.126:41329)
0806 09:15:34.868281 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:34.868287 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:34.868860 (+ 573us) server_negotiation.cc:407] Connection header received
0806 09:15:34.869021 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:34.869025 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:34.869094 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:34.869191 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:34.870370 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:34.871545 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:34.873204 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:34.873936 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:34.874055 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:34.878810 (+ 4755us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.65:34491: BlockingRecv error: recv got EOF from 127.10.255.65:34491 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 06 09:15:34 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:34 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:34.976562 20685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:34.966346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.67:43091)
0806 09:15:34.966884 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:34.966906 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:34.967047 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:34.967412 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:34.967415 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:34.967931 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:34.968178 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:34.968188 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:34.969364 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:34.969370 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:34.970360 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:34.970372 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:34.971203 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:34.971208 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:34.971343 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:34.972361 (+ 1018us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:34.972382 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:34.976199 (+ 3817us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":301,"threads_started":1}
W20260806 09:15:34.976691 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:34.966536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:43091 (local address 127.10.255.126:41329)
0806 09:15:34.966788 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:34.966794 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:34.967041 (+ 247us) server_negotiation.cc:407] Connection header received
0806 09:15:34.967191 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:34.967194 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:34.967261 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:34.967348 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:34.968346 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:34.969197 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:34.970565 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:34.971002 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:34.971109 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:34.976416 (+ 5307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.67:43091: BlockingRecv error: recv got EOF from 127.10.255.67:43091 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
Aug 06 09:15:35 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:35 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:35.412470 20686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:35.396007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.66:46235)
0806 09:15:35.396589 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:35.396607 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:35.396780 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:35.397163 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:35.397167 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:35.397603 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:35.397780 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:35.397789 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:35.398923 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:35.398930 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:35.399912 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:35.399926 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:35.400672 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:35.400678 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:35.400863 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:35.408821 (+ 7958us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:35.408846 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:35.412082 (+ 3236us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":288,"threads_started":1}
W20260806 09:15:35.412596 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:35.396107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:46235 (local address 127.10.255.126:41329)
0806 09:15:35.396350 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:35.396359 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:35.396708 (+ 349us) server_negotiation.cc:407] Connection header received
0806 09:15:35.396924 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:35.396928 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:35.397018 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:35.397128 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:35.397939 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:35.398774 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:35.400076 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:35.400502 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:35.400644 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:35.412342 (+ 11698us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.66:46235: BlockingRecv error: recv got EOF from 127.10.255.66:46235 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 06 09:15:35 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:35 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:35.889864 20687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:35.880067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.65:42333)
0806 09:15:35.880794 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:35.880828 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:35.880978 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:35.881359 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:35.881363 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:35.881747 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:35.881940 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:35.881949 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:35.883050 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:35.883054 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:35.884040 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:35.884054 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:35.885038 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:35.885048 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:35.885250 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:35.886161 (+ 911us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:35.886186 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:35.889593 (+ 3407us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":469,"threads_started":1}
W20260806 09:15:35.890244 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:35.880513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:42333 (local address 127.10.255.126:41329)
0806 09:15:35.880753 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:35.880758 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:35.881010 (+ 252us) server_negotiation.cc:407] Connection header received
0806 09:15:35.881090 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:35.881094 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:35.881161 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:35.881261 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:35.882106 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:35.882907 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:35.884222 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:35.884773 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:35.884964 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:35.889917 (+ 4953us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.65:42333: BlockingRecv error: recv got EOF from 127.10.255.65:42333 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 06 09:15:35 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:35 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:35.987696 20688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:35.977841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.67:35857)
0806 09:15:35.978691 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:35.978713 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:35.978834 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:35.979231 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:35.979235 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:35.979637 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:35.979812 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:35.979821 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:35.981047 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:35.981051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:35.982090 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:35.982108 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:35.983022 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:35.983028 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:35.983156 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:35.983985 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:35.984006 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:35.987306 (+ 3300us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":709,"thread_start_us":571,"threads_started":1}
W20260806 09:15:35.987905 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:35.977894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:35857 (local address 127.10.255.126:41329)
0806 09:15:35.978176 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:35.978185 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:35.978803 (+ 618us) server_negotiation.cc:407] Connection header received
0806 09:15:35.979011 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:35.979016 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:35.979083 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:35.979179 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:35.980048 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:35.980861 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:35.982280 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:35.982811 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:35.982931 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:35.987579 (+ 4648us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.67:35857: BlockingRecv error: recv got EOF from 127.10.255.67:35857 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 06 09:15:36 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:36 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:36.423372 20689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:36.413674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.66:44807)
0806 09:15:36.414315 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:36.414344 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:36.414481 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:36.414819 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:36.414822 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:36.415194 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:36.415373 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:36.415382 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:36.416643 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:36.416651 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:36.417770 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:36.417783 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:36.418600 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:36.418606 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:36.418793 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:36.419474 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:36.419493 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:36.422937 (+ 3444us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":411,"threads_started":1}
W20260806 09:15:36.423532 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:36.413872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:44807 (local address 127.10.255.126:41329)
0806 09:15:36.414086 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:36.414091 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:36.414454 (+ 363us) server_negotiation.cc:407] Connection header received
0806 09:15:36.414599 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:36.414603 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:36.414671 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:36.414766 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:36.415542 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:36.416493 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:36.417918 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:36.418444 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:36.418586 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:36.423246 (+ 4660us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.66:44807: BlockingRecv error: recv got EOF from 127.10.255.66:44807 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 06 09:15:36 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:36 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:36.900763 20690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:36.891005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.65:53773)
0806 09:15:36.891547 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:36.891565 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:36.891706 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:36.892219 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:36.892223 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:36.892699 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:36.892860 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:36.892869 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:36.893997 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:36.894002 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:36.895017 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:36.895030 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:36.895824 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:36.895847 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:36.896050 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:36.896750 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:36.896769 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:36.900397 (+ 3628us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":299,"threads_started":1}
W20260806 09:15:36.900882 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:36.891197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:53773 (local address 127.10.255.126:41329)
0806 09:15:36.891456 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:36.891462 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:36.891670 (+ 208us) server_negotiation.cc:407] Connection header received
0806 09:15:36.891904 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:36.891913 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:36.892028 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:36.892163 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:36.893036 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:36.893802 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:36.895186 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:36.895644 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:36.895763 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:36.900616 (+ 4853us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.65:53773: BlockingRecv error: recv got EOF from 127.10.255.65:53773 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
Aug 06 09:15:36 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:36 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:36.999116 20691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:36.989179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.67:40445)
0806 09:15:36.989833 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:36.989886 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:36.990042 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:36.990541 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:36.990547 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:36.991174 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:36.991459 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:36.991502 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:36.992725 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:36.992729 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:36.993696 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:36.993709 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:36.994519 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:36.994524 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:36.994686 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:36.995355 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:36.995415 (+ 60us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:36.998625 (+ 3210us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":413,"threads_started":1}
W20260806 09:15:36.999181 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:36.989426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:40445 (local address 127.10.255.126:41329)
0806 09:15:36.989666 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:36.989674 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:36.989995 (+ 321us) server_negotiation.cc:407] Connection header received
0806 09:15:36.990220 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:36.990226 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:36.990312 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:36.990452 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:36.991736 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:36.992575 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:36.993853 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:36.994343 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:36.994447 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:36.998909 (+ 4462us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.67:40445: BlockingRecv error: recv got EOF from 127.10.255.67:40445 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
Aug 06 09:15:37 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:37 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:37.435061 20692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:37.424573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.66:37385)
0806 09:15:37.425252 (+ 679us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:37.425271 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:37.425482 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:37.425959 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:37.425963 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:37.426386 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:37.426561 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:37.426570 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:37.427958 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:37.427965 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:37.429087 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:37.429104 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:37.430233 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:37.430239 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:37.430451 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:37.431394 (+ 943us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:37.431419 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:37.434813 (+ 3394us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":341,"threads_started":1}
W20260806 09:15:37.435575 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:37.424821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:37385 (local address 127.10.255.126:41329)
0806 09:15:37.425052 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:37.425058 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:37.425370 (+ 312us) server_negotiation.cc:407] Connection header received
0806 09:15:37.425681 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:37.425686 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:37.425762 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:37.425864 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:37.426779 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:37.427726 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:37.429294 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:37.430006 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:37.430163 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:37.435161 (+ 4998us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.66:37385: BlockingRecv error: recv got EOF from 127.10.255.66:37385 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 06 09:15:37 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:37 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:37.911196 20693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:37.901990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.65:56603)
0806 09:15:37.902583 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:37.902600 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:37.902740 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:37.903125 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:37.903128 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:37.903592 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:37.903760 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:37.903770 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:37.904818 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:37.904822 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:37.905805 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:37.905818 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:37.906876 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:37.906881 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:37.907031 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:37.907773 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:37.907794 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:37.910898 (+ 3104us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":268,"threads_started":1}
W20260806 09:15:37.911870 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:37.902063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:56603 (local address 127.10.255.126:41329)
0806 09:15:37.902324 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:37.902332 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:37.902704 (+ 372us) server_negotiation.cc:407] Connection header received
0806 09:15:37.902854 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:37.902858 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:37.902922 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:37.903041 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:37.903907 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:37.904673 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:37.906018 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:37.906714 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:37.906868 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:37.911256 (+ 4388us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.65:56603: BlockingRecv error: recv got EOF from 127.10.255.65:56603 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 06 09:15:38 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:38 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:38.010345 20694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:38.000575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.67:35531)
0806 09:15:38.001259 (+ 684us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:38.001281 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:38.001457 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:38.001837 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:38.001841 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:38.002340 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:38.002521 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:38.002531 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:38.003677 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:38.003685 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:38.004793 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:38.004807 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:38.005590 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:38.005596 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:38.005785 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:38.006508 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:38.006533 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:38.010068 (+ 3535us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":442,"threads_started":1}
W20260806 09:15:38.010687 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:38.000704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:35531 (local address 127.10.255.126:41329)
0806 09:15:38.000913 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:38.000918 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:38.001392 (+ 474us) server_negotiation.cc:407] Connection header received
0806 09:15:38.001600 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:38.001611 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:38.001677 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:38.001800 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:38.002695 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:38.003536 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:38.004959 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:38.005430 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:38.005572 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:38.010353 (+ 4781us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.67:35531: BlockingRecv error: recv got EOF from 127.10.255.67:35531 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 06 09:15:38 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:38 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:38.446375 20695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:38.436291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.66:35589)
0806 09:15:38.436900 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:38.436917 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:38.437082 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:38.437451 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:38.437456 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:38.437991 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:38.438158 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:38.438167 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:38.439273 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:38.439279 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:38.440244 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:38.440257 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:38.441025 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:38.441030 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:38.441216 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:38.441994 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:38.442015 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:38.446024 (+ 4009us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":282,"threads_started":1}
W20260806 09:15:38.446631 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:38.436573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:35589 (local address 127.10.255.126:41329)
0806 09:15:38.436822 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:38.436829 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:38.437034 (+ 205us) server_negotiation.cc:407] Connection header received
0806 09:15:38.437232 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:38.437241 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:38.437305 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:38.437414 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:38.438318 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:38.439113 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:38.440398 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:38.440856 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:38.441004 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:38.446316 (+ 5312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.66:35589: BlockingRecv error: recv got EOF from 127.10.255.66:35589 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Aug 06 09:15:38 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:38 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:38.923032 20696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:38.912540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.65:49101)
0806 09:15:38.913177 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:38.913203 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:38.913342 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:38.913962 (+ 620us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:38.913968 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:38.914536 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:38.914739 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:38.914752 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:38.916477 (+ 1725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:38.916483 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:38.917632 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:38.917648 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:38.918517 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:38.918523 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:38.918663 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:38.919400 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:38.919426 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:38.922788 (+ 3362us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":379,"threads_started":1}
W20260806 09:15:38.923585 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:38.912841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:49101 (local address 127.10.255.126:41329)
0806 09:15:38.913073 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:38.913078 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:38.913292 (+ 214us) server_negotiation.cc:407] Connection header received
0806 09:15:38.913690 (+ 398us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:38.913695 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:38.913775 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:38.913878 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:38.914982 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:38.916269 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:38.917808 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:38.918271 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:38.918394 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:38.923258 (+ 4864us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.65:49101: BlockingRecv error: recv got EOF from 127.10.255.65:49101 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 06 09:15:39 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:39 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:39.022437 20697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:39.011548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.67:34655)
0806 09:15:39.012248 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:39.012272 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:39.012416 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:39.012830 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:39.012834 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:39.013322 (+ 488us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:39.013520 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:39.013530 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:39.014969 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:39.014976 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:39.016196 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:39.016212 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:39.017117 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:39.017123 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:39.017272 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:39.018027 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:39.018049 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:39.022022 (+ 3973us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":372,"threads_started":1}
W20260806 09:15:39.022586 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:39.011950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:34655 (local address 127.10.255.126:41329)
0806 09:15:39.012200 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:39.012206 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:39.012386 (+ 180us) server_negotiation.cc:407] Connection header received
0806 09:15:39.012581 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:39.012585 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:39.012651 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:39.012746 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:39.013871 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:39.014786 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:39.016422 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:39.016917 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:39.017034 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:39.022278 (+ 5244us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.67:34655: BlockingRecv error: recv got EOF from 127.10.255.67:34655 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 06 09:15:39 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:39 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
W20260806 09:15:39.457451 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:39.447639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:42243 (local address 127.10.255.126:41329)
0806 09:15:39.447841 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:39.447864 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:39.448305 (+ 441us) server_negotiation.cc:407] Connection header received
0806 09:15:39.448428 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:39.448432 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:39.448505 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:39.448606 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:39.449437 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:39.450270 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:39.451640 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:39.452336 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:39.452470 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:39.457182 (+ 4712us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.66:42243: BlockingRecv error: recv got EOF from 127.10.255.66:42243 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 09:15:39.458074 20698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:39.447498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.66:42243)
0806 09:15:39.448166 (+ 668us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:39.448185 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:39.448310 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:39.448674 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:39.448678 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:39.449094 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:39.449260 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:39.449270 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:39.450493 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:39.450498 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:39.451451 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:39.451466 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:39.452652 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:39.452659 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:39.452853 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:39.453533 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:39.453552 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:39.457765 (+ 4213us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":398,"threads_started":1}
Aug 06 09:15:39 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:39 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:39.934724 20699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:39.924425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.65:46209)
0806 09:15:39.925189 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:39.925205 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:39.925338 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:39.925762 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:39.925766 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:39.926296 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:39.926539 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:39.926549 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:39.927786 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:39.927791 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:39.929122 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:39.929136 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:39.930307 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:39.930314 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:39.930454 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:39.931131 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:39.931152 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:39.934401 (+ 3249us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":641,"thread_start_us":365,"threads_started":1}
W20260806 09:15:39.935001 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:39.924551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:46209 (local address 127.10.255.126:41329)
0806 09:15:39.924890 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:39.924895 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:39.925298 (+ 403us) server_negotiation.cc:407] Connection header received
0806 09:15:39.925504 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:39.925508 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:39.925577 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:39.925688 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:39.926709 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:39.927617 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:39.929294 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:39.930071 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:39.930225 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:39.934680 (+ 4455us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.65:46209: BlockingRecv error: recv got EOF from 127.10.255.65:46209 (error 108)
Metrics: {"server-negotiator.queue_time_us":159}
Aug 06 09:15:40 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:40 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:40.034029 20700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:40.023725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.67:56223)
0806 09:15:40.024543 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:40.024581 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:40.024736 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:40.025072 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:40.025076 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:40.025657 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:40.025829 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:40.025840 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:40.026950 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:40.026955 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:40.028127 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:40.028143 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:40.028971 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:40.028976 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:40.029117 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:40.029933 (+ 816us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:40.029960 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:40.033778 (+ 3818us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":445,"threads_started":1}
W20260806 09:15:40.034453 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:40.023856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:56223 (local address 127.10.255.126:41329)
0806 09:15:40.024092 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:40.024097 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:40.024724 (+ 627us) server_negotiation.cc:407] Connection header received
0806 09:15:40.024835 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:40.024839 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:40.024905 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:40.025000 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:40.026034 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:40.026770 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:40.028314 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:40.028782 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:40.028900 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:40.034182 (+ 5282us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.67:56223: BlockingRecv error: recv got EOF from 127.10.255.67:56223 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 06 09:15:40 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:40 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:40.478327 20701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:40.459737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.66:56327)
0806 09:15:40.460460 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:40.460477 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:40.460668 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:40.461061 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:40.461066 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:40.461538 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:40.461723 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:40.461733 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:40.462979 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:40.462984 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:40.464087 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:40.464104 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:40.464901 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:40.464907 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:40.465090 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:40.473529 (+ 8439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:40.473562 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:40.477907 (+ 4345us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":306,"threads_started":1}
W20260806 09:15:40.478441 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:40.459935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:56327 (local address 127.10.255.126:41329)
0806 09:15:40.460243 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:40.460252 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:40.460580 (+ 328us) server_negotiation.cc:407] Connection header received
0806 09:15:40.460835 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:40.460839 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:40.460905 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:40.461021 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:40.461886 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:40.462806 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:40.464248 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:40.464715 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:40.464857 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:40.478151 (+ 13294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.66:56327: BlockingRecv error: recv got EOF from 127.10.255.66:56327 (error 108)
Metrics: {"server-negotiator.queue_time_us":118}
Aug 06 09:15:40 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:40 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:40.945456 20702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:40.935819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.65:49717)
0806 09:15:40.936474 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:40.936499 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:40.936624 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:40.936953 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:40.936956 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:40.937382 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:40.937592 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:40.937602 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:40.938765 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:40.938770 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:40.939742 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:40.939757 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:40.940601 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:40.940606 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:40.940739 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:40.941567 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:40.941587 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:40.945070 (+ 3483us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":316,"threads_started":1}
W20260806 09:15:40.945647 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:40.935921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:49717 (local address 127.10.255.126:41329)
0806 09:15:40.936180 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:40.936187 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:40.936608 (+ 421us) server_negotiation.cc:407] Connection header received
0806 09:15:40.936740 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:40.936744 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:40.936810 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:40.936901 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:40.937758 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:40.938574 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:40.939913 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:40.940390 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:40.940510 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:40.945378 (+ 4868us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.65:49717: BlockingRecv error: recv got EOF from 127.10.255.65:49717 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Aug 06 09:15:41 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:41 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:41.046236 20703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:41.035781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.67:40535)
0806 09:15:41.036626 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:41.036653 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:41.036853 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:41.037240 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:41.037245 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:41.037723 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:41.037896 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:41.037904 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:41.039043 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:41.039054 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:41.040341 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:41.040361 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:41.041529 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:41.041535 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:41.041704 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:41.042439 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:41.042466 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:41.045911 (+ 3445us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":685,"thread_start_us":350,"threads_started":1}
W20260806 09:15:41.046479 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:41.036148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:40535 (local address 127.10.255.126:41329)
0806 09:15:41.036432 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:41.036439 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:41.036763 (+ 324us) server_negotiation.cc:407] Connection header received
0806 09:15:41.036996 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:41.037004 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:41.037082 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:41.037200 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:41.038094 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:41.038872 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:41.040599 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:41.041344 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:41.041486 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:41.046209 (+ 4723us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.67:40535: BlockingRecv error: recv got EOF from 127.10.255.67:40535 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
Aug 06 09:15:41 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:41 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:41.489264 20704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:41.479563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.66:52853)
0806 09:15:41.480184 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:41.480201 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:41.480320 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:41.480641 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:41.480644 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:41.481076 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:41.481235 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:41.481244 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:41.482658 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:41.482665 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:41.483772 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:41.483790 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:41.484692 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:41.484698 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:41.484849 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:41.485574 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:41.485596 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:41.488980 (+ 3384us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":353,"threads_started":1}
W20260806 09:15:41.489622 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:41.479652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:52853 (local address 127.10.255.126:41329)
0806 09:15:41.479874 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:41.479880 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:41.480310 (+ 430us) server_negotiation.cc:407] Connection header received
0806 09:15:41.480434 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:41.480438 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:41.480504 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:41.480591 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:41.481395 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:41.482453 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:41.484028 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:41.484464 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:41.484575 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:41.489248 (+ 4673us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.66:52853: BlockingRecv error: recv got EOF from 127.10.255.66:52853 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 06 09:15:41 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:41 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:41.957854 20705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:41.946912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.65:42169)
0806 09:15:41.947950 (+ 1038us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:41.947970 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:41.948195 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:41.948653 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:41.948659 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:41.949126 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:41.949314 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:41.949324 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:41.950517 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:41.950525 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:41.951691 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:41.951706 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:41.952644 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:41.952651 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:41.952853 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:41.953665 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:41.953695 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:41.957597 (+ 3902us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":866,"thread_start_us":693,"threads_started":1}
W20260806 09:15:41.958214 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:41.947000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:42169 (local address 127.10.255.126:41329)
0806 09:15:41.947321 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:41.947332 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:41.948139 (+ 807us) server_negotiation.cc:407] Connection header received
0806 09:15:41.948373 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:41.948379 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:41.948476 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:41.948601 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:41.949505 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:41.950330 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:41.951899 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:41.952431 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:41.952589 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:41.957834 (+ 5245us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.65:42169: BlockingRecv error: recv got EOF from 127.10.255.65:42169 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 06 09:15:42 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:42 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:42.057137 20706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:42.047324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.67:48531)
0806 09:15:42.048022 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:42.048045 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:42.048169 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:42.048515 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:42.048518 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:42.048936 (+ 418us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:42.049089 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:42.049099 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:42.050355 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:42.050360 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:42.051505 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:42.051520 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:42.052556 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:42.052563 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:42.052718 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:42.053458 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:42.053485 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:42.056742 (+ 3257us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":311,"threads_started":1}
W20260806 09:15:42.057188 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:42.047407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:48531 (local address 127.10.255.126:41329)
0806 09:15:42.047640 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:42.047650 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:42.048116 (+ 466us) server_negotiation.cc:407] Connection header received
0806 09:15:42.048272 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:42.048275 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:42.048335 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:42.048411 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:42.049263 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:42.050163 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:42.051679 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:42.052278 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:42.052391 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:42.056991 (+ 4600us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.67:48531: BlockingRecv error: recv got EOF from 127.10.255.67:48531 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 06 09:15:42 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:42 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:42.501873 20707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:42.490512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.66:55775)
0806 09:15:42.491158 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:42.491175 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:42.491346 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:42.491797 (+ 451us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:42.491801 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:42.492420 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:42.492750 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:42.492766 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:42.494598 (+ 1832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:42.494603 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:42.495623 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:42.495639 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:42.496592 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:42.496613 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:42.496880 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:42.497915 (+ 1035us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:42.497941 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:42.501532 (+ 3591us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":547,"thread_start_us":334,"threads_started":1}
W20260806 09:15:42.502308 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:42.490622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:55775 (local address 127.10.255.126:41329)
0806 09:15:42.490815 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:42.490820 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:42.491285 (+ 465us) server_negotiation.cc:407] Connection header received
0806 09:15:42.491484 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:42.491488 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:42.491555 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:42.491697 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:42.493002 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:42.494404 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:42.495791 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:42.496261 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:42.496382 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:42.501949 (+ 5567us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.66:55775: BlockingRecv error: recv got EOF from 127.10.255.66:55775 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
Aug 06 09:15:42 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:42 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:42.969715 20708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:42.959229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.65:38969)
0806 09:15:42.959882 (+ 653us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:42.959900 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:42.960048 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:42.960423 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:42.960427 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:42.960843 (+ 416us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:42.961035 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:42.961046 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:42.962702 (+ 1656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:42.962708 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:42.964018 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:42.964039 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:42.964866 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:42.964873 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:42.965028 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:42.965717 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:42.965738 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:42.969467 (+ 3729us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":395,"threads_started":1}
W20260806 09:15:42.970155 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:42.959329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:38969 (local address 127.10.255.126:41329)
0806 09:15:42.959641 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:42.959650 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:42.960005 (+ 355us) server_negotiation.cc:407] Connection header received
0806 09:15:42.960169 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:42.960173 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:42.960255 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:42.960344 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:42.961279 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:42.962337 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:42.964214 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:42.964680 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:42.964800 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:42.969759 (+ 4959us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.65:38969: BlockingRecv error: recv got EOF from 127.10.255.65:38969 (error 108)
Metrics: {"server-negotiator.queue_time_us":111}
Aug 06 09:15:43 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:43 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:43.068512 20709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:43.058450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.67:33735)
0806 09:15:43.059080 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:43.059114 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:43.059249 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:43.059668 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:43.059672 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:43.060164 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:43.060354 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:43.060364 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:43.061613 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:43.061620 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:43.062723 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:43.062739 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:43.063653 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:43.063660 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:43.063809 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:43.064542 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:43.064562 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:43.068179 (+ 3617us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":352,"threads_started":1}
W20260806 09:15:43.068709 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:43.058530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:33735 (local address 127.10.255.126:41329)
0806 09:15:43.058721 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:43.058726 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:43.059225 (+ 499us) server_negotiation.cc:407] Connection header received
0806 09:15:43.059365 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:43.059369 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:43.059436 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:43.059543 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:43.060607 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:43.061421 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:43.062939 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:43.063437 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:43.063567 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:43.068428 (+ 4861us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.67:33735: BlockingRecv error: recv got EOF from 127.10.255.67:33735 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 06 09:15:43 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:43 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:43.513702 20710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:43.503215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.66:47157)
0806 09:15:43.503959 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:43.503977 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:43.504163 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:43.504574 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:43.504580 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:43.505006 (+ 426us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:43.505163 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:43.505172 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:43.506447 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:43.506454 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:43.507473 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:43.507490 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:43.508595 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:43.508599 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:43.508734 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:43.509490 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:43.509510 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:43.513333 (+ 3823us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":462,"threads_started":1}
W20260806 09:15:43.513830 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:43.503362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:47157 (local address 127.10.255.126:41329)
0806 09:15:43.503616 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:43.503625 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:43.504100 (+ 475us) server_negotiation.cc:407] Connection header received
0806 09:15:43.504345 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:43.504349 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:43.504417 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:43.504533 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:43.505327 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:43.506265 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:43.507702 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:43.508326 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:43.508569 (+ 243us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:43.513565 (+ 4996us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.66:47157: BlockingRecv error: recv got EOF from 127.10.255.66:47157 (error 108)
Metrics: {"server-negotiator.queue_time_us":100}
Aug 06 09:15:43 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:43 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:43.980748 20711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:43.970893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.65:50983)
0806 09:15:43.971461 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:43.971483 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:43.971663 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:43.972111 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:43.972116 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:43.972583 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:43.972765 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:43.972774 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:43.973821 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:43.973828 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:43.974753 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:43.974766 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:43.975621 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:43.975628 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:43.975812 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:43.976690 (+ 878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:43.976714 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:43.980356 (+ 3642us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":300,"threads_started":1}
W20260806 09:15:43.981007 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:43.971160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:50983 (local address 127.10.255.126:41329)
0806 09:15:43.971452 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:43.971460 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:43.971582 (+ 122us) server_negotiation.cc:407] Connection header received
0806 09:15:43.971809 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:43.971821 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:43.971963 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:43.972076 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:43.972926 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:43.973673 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:43.974908 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:43.975435 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:43.975575 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:43.980666 (+ 5091us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.65:50983: BlockingRecv error: recv got EOF from 127.10.255.65:50983 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 06 09:15:44 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:44 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:44.080456 20712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:44.070043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.67:54949)
0806 09:15:44.070580 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:44.070604 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:44.070735 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:44.071264 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:44.071269 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:44.071678 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:44.071867 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:44.071878 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:44.073502 (+ 1624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:44.073507 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:44.075086 (+ 1579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:44.075105 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:44.076079 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:44.076085 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:44.076225 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:44.076976 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:44.076996 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:44.080195 (+ 3199us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":311,"threads_started":1}
W20260806 09:15:44.080768 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:44.070234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:54949 (local address 127.10.255.126:41329)
0806 09:15:44.070538 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:44.070546 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:44.070697 (+ 151us) server_negotiation.cc:407] Connection header received
0806 09:15:44.070895 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:44.070899 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:44.070977 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:44.071113 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:44.072116 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:44.073251 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:44.075261 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:44.075817 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:44.076035 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:44.080476 (+ 4441us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.67:54949: BlockingRecv error: recv got EOF from 127.10.255.67:54949 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
Aug 06 09:15:44 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:44 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:44.525481 20713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:44.515178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.66:52873)
0806 09:15:44.515887 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:44.515908 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:44.516088 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:44.516675 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:44.516681 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:44.517284 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:44.517490 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:44.517500 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:44.518738 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:44.518746 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:44.519756 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:44.519770 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:44.520645 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:44.520651 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:44.520856 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:44.521532 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:44.521558 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:44.525166 (+ 3608us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":344,"threads_started":1}
W20260806 09:15:44.525821 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:44.515310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:52873 (local address 127.10.255.126:41329)
0806 09:15:44.515544 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:44.515552 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:44.516016 (+ 464us) server_negotiation.cc:407] Connection header received
0806 09:15:44.516348 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:44.516356 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:44.516463 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:44.516652 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:44.517660 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:44.518552 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:44.519980 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:44.520438 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:44.520602 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:44.525485 (+ 4883us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.66:52873: BlockingRecv error: recv got EOF from 127.10.255.66:52873 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 06 09:15:44 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:44 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:44.992707 20714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:44.982081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.65:41451)
0806 09:15:44.982755 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:44.982773 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:44.982908 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:44.983436 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:44.983440 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:44.983891 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:44.984061 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:44.984070 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:44.985336 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:44.985340 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:44.986636 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:44.986651 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:44.987699 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:44.987705 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:44.987902 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:44.988666 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:44.988685 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:44.992440 (+ 3755us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":453,"threads_started":1}
W20260806 09:15:44.993054 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:44.982285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:41451 (local address 127.10.255.126:41329)
0806 09:15:44.982590 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:44.982599 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:44.982906 (+ 307us) server_negotiation.cc:407] Connection header received
0806 09:15:44.983089 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:44.983094 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:44.983202 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:44.983297 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:44.984243 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:44.985152 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:44.986802 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:44.987503 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:44.987677 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:44.992757 (+ 5080us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.65:41451: BlockingRecv error: recv got EOF from 127.10.255.65:41451 (error 108)
Metrics: {"server-negotiator.queue_time_us":119}
Aug 06 09:15:45 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:45 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:45.092047 20715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:45.081512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.67:59979)
0806 09:15:45.082091 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:45.082112 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:45.082286 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:45.082674 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:45.082679 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:45.083241 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:45.083423 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:45.083434 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:45.084679 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:45.084687 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:45.085646 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:45.085658 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:45.086663 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:45.086670 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:45.086897 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:45.087901 (+ 1004us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:45.087925 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:45.091618 (+ 3693us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":316,"threads_started":1}
W20260806 09:15:45.092238 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:45.081631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:59979 (local address 127.10.255.126:41329)
0806 09:15:45.081939 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:45.081946 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:45.082204 (+ 258us) server_negotiation.cc:407] Connection header received
0806 09:15:45.082429 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:45.082435 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:45.082520 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:45.082634 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:45.083607 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:45.084534 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:45.085802 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:45.086305 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:45.086684 (+ 379us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:45.091893 (+ 5209us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.67:59979: BlockingRecv error: recv got EOF from 127.10.255.67:59979 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
Aug 06 09:15:45 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:45 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:45.543699 20716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:45.526593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.66:41249)
0806 09:15:45.527151 (+ 558us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:45.527169 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:45.527348 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:45.527754 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:45.527759 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:45.528285 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:45.528463 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:45.528473 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:45.529652 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:45.529662 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:45.530732 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:45.530745 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:45.531608 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:45.531615 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:45.531887 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:45.539896 (+ 8009us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:45.539932 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:45.543417 (+ 3485us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":324,"threads_started":1}
W20260806 09:15:45.544139 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:45.526691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:41249 (local address 127.10.255.126:41329)
0806 09:15:45.526989 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:45.526998 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:45.527266 (+ 268us) server_negotiation.cc:407] Connection header received
0806 09:15:45.527501 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:45.527507 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:45.527592 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:45.527705 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:45.528642 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:45.529480 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:45.530910 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:45.531425 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:45.531571 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:45.543795 (+ 12224us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.66:41249: BlockingRecv error: recv got EOF from 127.10.255.66:41249 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 06 09:15:45 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:45 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:46.003880 20717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:45.994100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.65:38025)
0806 09:15:45.994803 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:45.994820 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:45.994958 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:45.995391 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:45.995395 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:45.996018 (+ 623us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:45.996259 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:45.996274 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:45.997595 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:45.997600 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:45.998625 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:45.998640 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:45.999411 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:45.999418 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:45.999551 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:46.000216 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:46.000237 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:46.003496 (+ 3259us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":404,"threads_started":1}
W20260806 09:15:46.004092 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:45.994281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:38025 (local address 127.10.255.126:41329)
0806 09:15:45.994515 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:45.994520 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:45.994930 (+ 410us) server_negotiation.cc:407] Connection header received
0806 09:15:45.995107 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:45.995111 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:45.995192 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:45.995333 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:45.996474 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:45.997437 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:45.998786 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:45.999224 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:45.999329 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:46.003762 (+ 4433us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.65:38025: BlockingRecv error: recv got EOF from 127.10.255.65:38025 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 06 09:15:46 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:46 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:46.102944 20718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:46.093294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.67:33403)
0806 09:15:46.093883 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:46.093904 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:46.094097 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:46.094473 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:46.094478 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:46.094927 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:46.095090 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:46.095099 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:46.096276 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:46.096281 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:46.097231 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:46.097244 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:46.098067 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:46.098073 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:46.098276 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:46.099072 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:46.099128 (+ 56us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:46.102688 (+ 3560us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":350,"threads_started":1}
W20260806 09:15:46.103214 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:46.093433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:33403 (local address 127.10.255.126:41329)
0806 09:15:46.093736 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:46.093744 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:46.094003 (+ 259us) server_negotiation.cc:407] Connection header received
0806 09:15:46.094247 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:46.094252 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:46.094316 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:46.094428 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:46.095289 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:46.096111 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:46.097401 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:46.097889 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:46.098032 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:46.102961 (+ 4929us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.67:33403: BlockingRecv error: recv got EOF from 127.10.255.67:33403 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Aug 06 09:15:46 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:46 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:46.555181 20719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:46.545053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.66:48019)
0806 09:15:46.545852 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:46.545870 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:46.546068 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:46.546467 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:46.546472 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:46.546911 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:46.547080 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:46.547090 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:46.548308 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:46.548314 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:46.549288 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:46.549396 (+ 108us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:46.550372 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:46.550381 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:46.550584 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:46.551289 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:46.551308 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:46.554908 (+ 3600us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":696,"thread_start_us":529,"threads_started":1}
W20260806 09:15:46.555428 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:46.545308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:48019 (local address 127.10.255.126:41329)
0806 09:15:46.545600 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:46.545609 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:46.546003 (+ 394us) server_negotiation.cc:407] Connection header received
0806 09:15:46.546215 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:46.546229 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:46.546295 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:46.546416 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:46.547249 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:46.548153 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:46.549595 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:46.550131 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:46.550290 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:46.555157 (+ 4867us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.66:48019: BlockingRecv error: recv got EOF from 127.10.255.66:48019 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
Aug 06 09:15:47 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:47 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:47.015098 20720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:47.005384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.65:33391)
0806 09:15:47.006140 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:47.006164 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:47.006338 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:47.006853 (+ 515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:47.006862 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:47.007401 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:47.007688 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:47.007699 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:47.008869 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:47.008874 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:47.009872 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:47.009886 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:47.010720 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:47.010726 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:47.010864 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:47.011691 (+ 827us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:47.011712 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:47.014819 (+ 3107us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":307,"threads_started":1}
W20260806 09:15:47.015421 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:47.005503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:33391 (local address 127.10.255.126:41329)
0806 09:15:47.005757 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:47.005764 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:47.006293 (+ 529us) server_negotiation.cc:407] Connection header received
0806 09:15:47.006518 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:47.006527 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:47.006646 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:47.006757 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:47.007888 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:47.008705 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:47.010059 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:47.010537 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:47.010648 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:47.015100 (+ 4452us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.65:33391: BlockingRecv error: recv got EOF from 127.10.255.65:33391 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 06 09:15:47 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:47 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:47.114219 20721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:47.104086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.67:33103)
0806 09:15:47.104777 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:47.104798 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:47.104975 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:47.105341 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:47.105346 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:47.105824 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:47.106012 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:47.106023 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:47.107287 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:47.107292 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:47.109022 (+ 1730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:47.109044 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:47.110015 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:47.110020 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:47.110162 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:47.110800 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:47.110818 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:47.113952 (+ 3134us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":575,"thread_start_us":416,"threads_started":1}
W20260806 09:15:47.114688 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:47.104217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:33103 (local address 127.10.255.126:41329)
0806 09:15:47.104624 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:47.104632 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:47.104899 (+ 267us) server_negotiation.cc:407] Connection header received
0806 09:15:47.105112 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:47.105117 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:47.105192 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:47.105307 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:47.106174 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:47.107081 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:47.109241 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:47.109804 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:47.109919 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:47.114212 (+ 4293us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.67:33103: BlockingRecv error: recv got EOF from 127.10.255.67:33103 (error 108)
Metrics: {"server-negotiator.queue_time_us":189}
Aug 06 09:15:47 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:47 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:47.566329 20722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:47.556569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.66:38201)
0806 09:15:47.557331 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:47.557350 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:47.557543 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:47.557933 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:47.557939 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:47.558492 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:47.558745 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:47.558755 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:47.560041 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:47.560046 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:47.561001 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:47.561014 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:47.561800 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:47.561807 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:47.562024 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:47.562806 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:47.562824 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:47.565960 (+ 3136us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":457,"threads_started":1}
W20260806 09:15:47.566442 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:47.556699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:38201 (local address 127.10.255.126:41329)
0806 09:15:47.557067 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:47.557075 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:47.557465 (+ 390us) server_negotiation.cc:407] Connection header received
0806 09:15:47.557697 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:47.557707 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:47.557773 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:47.557890 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:47.558912 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:47.559874 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:47.561169 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:47.561632 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:47.561777 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:47.566204 (+ 4427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.66:38201: BlockingRecv error: recv got EOF from 127.10.255.66:38201 (error 108)
Metrics: {"server-negotiator.queue_time_us":134}
Aug 06 09:15:48 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:48 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.65@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:48.026542 20723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:48.016511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.65:50893)
0806 09:15:48.017165 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:48.017183 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:48.017365 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:48.017791 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:48.017796 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:48.018272 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:48.018468 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:48.018478 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:48.019549 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:48.019555 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:48.020552 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:48.020574 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:48.021345 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:48.021352 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:48.021529 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:48.022462 (+ 933us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:48.022506 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:48.026243 (+ 3737us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":321,"threads_started":1}
W20260806 09:15:48.026772 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:48.016725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:50893 (local address 127.10.255.126:41329)
0806 09:15:48.017012 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:48.017019 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:48.017286 (+ 267us) server_negotiation.cc:407] Connection header received
0806 09:15:48.017535 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:48.017545 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:48.017631 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:48.017751 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:48.018641 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:48.019382 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:48.020736 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:48.021165 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:48.021309 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:48.026522 (+ 5213us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.65:50893: BlockingRecv error: recv got EOF from 127.10.255.65:50893 (error 108)
Metrics: {"server-negotiator.queue_time_us":113}
Aug 06 09:15:48 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:48 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.67@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:48.125937 20724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:48.115421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.67:33431)
0806 09:15:48.116066 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:48.116090 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:48.116205 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:48.116686 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:48.116691 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:48.117136 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:48.117342 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:48.117352 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:48.118598 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:48.118603 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:48.119718 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:48.119744 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:48.120702 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:48.120707 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:48.120850 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:48.121533 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:48.121551 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:48.125562 (+ 4011us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":350,"threads_started":1}
W20260806 09:15:48.126075 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:48.115672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:33431 (local address 127.10.255.126:41329)
0806 09:15:48.116141 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:48.116146 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:48.116168 (+ 22us) server_negotiation.cc:407] Connection header received
0806 09:15:48.116362 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:48.116366 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:48.116435 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:48.116581 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:48.117577 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:48.118404 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:48.119955 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:48.120494 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:48.120614 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:48.125811 (+ 5197us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.67:33431: BlockingRecv error: recv got EOF from 127.10.255.67:33431 (error 108)
Metrics: {"server-negotiator.queue_time_us":295}
Aug 06 09:15:48 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
Aug 06 09:15:48 dist-test-slave-mvvj krb5kdc[19666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.255.66@KRBTEST.COM for oryx/127.10.255.126@KRBTEST.COM, Server not found in Kerberos database
I20260806 09:15:48.576897 20725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:48.567770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:41329 (local address 127.10.255.66:37651)
0806 09:15:48.568421 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:48.568445 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:48.568612 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:48.568994 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:48.568999 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:48.569454 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:48.569623 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:48.569632 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:48.570762 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:48.570767 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:48.571705 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:48.571717 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:48.572568 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:48.572574 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:48.572752 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:48.573389 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:48.573407 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:48.576494 (+ 3087us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.255.126:41329: Server oryx/127.10.255.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":413,"threads_started":1}
W20260806 09:15:48.577042 20412 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:48.567787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:37651 (local address 127.10.255.126:41329)
0806 09:15:48.568047 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:48.568055 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:48.568538 (+ 483us) server_negotiation.cc:407] Connection header received
0806 09:15:48.568744 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:48.568754 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:48.568834 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:48.568955 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:48.569772 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:48.570606 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:48.571917 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:48.572376 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:48.572540 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:48.576745 (+ 4205us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.255.66:37651: BlockingRecv error: recv got EOF from 127.10.255.66:37651 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
I20260806 09:15:48.924151 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 20260
I20260806 09:15:48.937700 20727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:48.925556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33800 (local address 127.10.255.65:36733)
0806 09:15:48.926180 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:48.926187 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:48.926213 (+ 26us) server_negotiation.cc:407] Connection header received
0806 09:15:48.926278 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:48.926285 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:48.926523 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:48.926680 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:48.928221 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:48.929326 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:48.930746 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:48.931373 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:48.931488 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:48.934217 (+ 2729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:48.934228 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:48.934243 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:48.934283 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:48.937148 (+ 2865us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.255.65@KRBTEST.COM not found in keytab (ticket kvno 2)
0806 09:15:48.937459 (+ 311us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:33800: Request ticket server kudu/127.10.255.65@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":301,"threads_started":1}
W20260806 09:15:48.937836 20727 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:33800: Request ticket server kudu/127.10.255.65@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260806 09:15:48.937950 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 20260: Not authorized: Client connection negotiation failed: client connection to 127.10.255.65:36733: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.255.65@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260806 09:15:48.938205 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 20260
I20260806 09:15:48.957664 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 20414
I20260806 09:15:48.972115 20728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:48.959043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56406 (local address 127.10.255.66:34885)
0806 09:15:48.959749 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:48.959756 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:48.959789 (+ 33us) server_negotiation.cc:407] Connection header received
0806 09:15:48.959935 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:48.959943 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:48.960197 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:48.960367 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:48.961890 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:48.963145 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:48.964583 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:48.965273 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:48.965405 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:48.968487 (+ 3082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:48.968497 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:48.968512 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:48.968552 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:48.971484 (+ 2932us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.255.66@KRBTEST.COM not found in keytab (ticket kvno 2)
0806 09:15:48.971781 (+ 297us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56406: Request ticket server kudu/127.10.255.66@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":367,"threads_started":1}
W20260806 09:15:48.972246 20728 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56406: Request ticket server kudu/127.10.255.66@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260806 09:15:48.972411 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 20414: Not authorized: Client connection negotiation failed: client connection to 127.10.255.66:34885: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.255.66@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260806 09:15:48.972599 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 20414
I20260806 09:15:48.991091 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 20546
I20260806 09:15:49.004820 20729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:48.992223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36700 (local address 127.10.255.67:45963)
0806 09:15:48.992844 (+ 621us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:48.992851 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:48.992883 (+ 32us) server_negotiation.cc:407] Connection header received
0806 09:15:48.992952 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:48.992959 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:48.993198 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:48.993364 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:48.994786 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:48.995798 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:48.997328 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:48.997931 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:48.998058 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:49.001104 (+ 3046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:49.001114 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:49.001130 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:49.001170 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:49.004216 (+ 3046us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.255.67@KRBTEST.COM not found in keytab (ticket kvno 2)
0806 09:15:49.004555 (+ 339us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36700: Request ticket server kudu/127.10.255.67@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":320,"threads_started":1}
W20260806 09:15:49.004963 20729 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36700: Request ticket server kudu/127.10.255.67@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260806 09:15:49.005000 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 20546: Not authorized: Client connection negotiation failed: client connection to 127.10.255.67:45963: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.255.67@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260806 09:15:49.005213 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 20546
I20260806 09:15:49.026134 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 20191
I20260806 09:15:49.027508 20253 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:49.150373 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 20191
2026-08-06T09:15:49Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (22066 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-06T09:15:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:15:49Z Disabled control of system clock
I20260806 09:15:49.239773 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:32947
--webserver_interface=127.10.255.126
--webserver_port=0
--builtin_ntp_servers=127.10.255.84:42107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:32947
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 09:15:49.600550 20734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:49.600888 20734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:49.601037 20734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:49.609522 20734 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:15:49.609676 20734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:49.609714 20734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:49.609848 20734 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:15:49.609951 20734 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:15:49.624100 20734 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:42107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:32947
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:32947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:49.625653 20734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:49.627748 20734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:49.643392 20742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:49.643534 20740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:49.643573 20739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:49.643867 20734 server_base.cc:1034] running on GCE node
I20260806 09:15:49.644965 20734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:49.646688 20734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:49.647992 20734 hybrid_clock.cc:648] HybridClock initialized: now 1786007749647941 us; error 34 us; skew 500 ppm
I20260806 09:15:49.648491 20734 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:15:49.651402 20734 webserver.cc:460] Webserver started at http://127.10.255.126:38097/ using document root <none> and password file <none>
I20260806 09:15:49.652338 20734 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:49.652442 20734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:49.652817 20734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:49.656168 20734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "902aaaa7bbf1438fb6d8e842c21d0f06"
format_stamp: "Formatted at 2026-08-06 09:15:49 on dist-test-slave-mvvj"
server_key: "7933f159cbc5fec4910a05fa27861c26"
server_key_iv: "6afb609549cd73e3003eae5ef489dbac"
server_key_version: "encryptionkey@0"
I20260806 09:15:49.657071 20734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "902aaaa7bbf1438fb6d8e842c21d0f06"
format_stamp: "Formatted at 2026-08-06 09:15:49 on dist-test-slave-mvvj"
server_key: "7933f159cbc5fec4910a05fa27861c26"
server_key_iv: "6afb609549cd73e3003eae5ef489dbac"
server_key_version: "encryptionkey@0"
I20260806 09:15:49.663026 20734 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260806 09:15:49.667394 20748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:49.669387 20734 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260806 09:15:49.669644 20734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "902aaaa7bbf1438fb6d8e842c21d0f06"
format_stamp: "Formatted at 2026-08-06 09:15:49 on dist-test-slave-mvvj"
server_key: "7933f159cbc5fec4910a05fa27861c26"
server_key_iv: "6afb609549cd73e3003eae5ef489dbac"
server_key_version: "encryptionkey@0"
I20260806 09:15:49.669956 20734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:49.689436 20734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:49.690438 20734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:49.690793 20734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:49.712720 20734 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:32947
I20260806 09:15:49.712757 20800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:32947 every 8 connection(s)
I20260806 09:15:49.714234 20734 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:15:49.716732 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 20734
I20260806 09:15:49.716961 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:15:49.717864 11261 external_mini_cluster.cc:1428] Setting key 5319db73e1efd4eebb202fd00dac360c
I20260806 09:15:49.720415 20801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:49.734249 20804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:49.720563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59560 (local address 127.10.255.126:32947)
0806 09:15:49.721817 (+ 1254us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:49.721830 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:49.721878 (+ 48us) server_negotiation.cc:407] Connection header received
0806 09:15:49.723775 (+ 1897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:49.723801 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:49.724434 (+ 633us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:49.724903 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:49.725703 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:49.727293 (+ 1590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:49.728904 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:49.729644 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:49.729880 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:49.731200 (+ 1320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:49.731208 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:49.731226 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:15:49.732152 (+ 926us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:49.732261 (+ 109us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:15:49.732291 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:49.732471 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:49.732737 (+ 266us) server_negotiation.cc:299] Negotiation successful
0806 09:15:49.733103 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":764,"thread_start_us":465,"threads_started":1}
I20260806 09:15:49.735097 20801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 902aaaa7bbf1438fb6d8e842c21d0f06: Bootstrap starting.
I20260806 09:15:49.739566 20801 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 902aaaa7bbf1438fb6d8e842c21d0f06: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:49.740932 20801 log.cc:824] T 00000000000000000000000000000000 P 902aaaa7bbf1438fb6d8e842c21d0f06: Log is configured to *not* fsync() on all Append() calls
I20260806 09:15:49.745047 20801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 902aaaa7bbf1438fb6d8e842c21d0f06: No bootstrap required, opened a new log
I20260806 09:15:49.753930 20801 raft_consensus.cc:348] T 00000000000000000000000000000000 P 902aaaa7bbf1438fb6d8e842c21d0f06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902aaaa7bbf1438fb6d8e842c21d0f06" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 32947 } }
I20260806 09:15:49.754391 20801 raft_consensus.cc:374] T 00000000000000000000000000000000 P 902aaaa7bbf1438fb6d8e842c21d0f06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:49.754499 20801 raft_consensus.cc:729] T 00000000000000000000000000000000 P 902aaaa7bbf1438fb6d8e842c21d0f06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 902aaaa7bbf1438fb6d8e842c21d0f06, State: Initialized, Role: FOLLOWER
I20260806 09:15:49.755095 20801 consensus_queue.cc:260] T 00000000000000000000000000000000 P 902aaaa7bbf1438fb6d8e842c21d0f06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902aaaa7bbf1438fb6d8e842c21d0f06" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 32947 } }
I20260806 09:15:49.755354 20801 raft_consensus.cc:388] T 00000000000000000000000000000000 P 902aaaa7bbf1438fb6d8e842c21d0f06 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:15:49.755503 20801 raft_consensus.cc:482] T 00000000000000000000000000000000 P 902aaaa7bbf1438fb6d8e842c21d0f06 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:15:49.755654 20801 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 902aaaa7bbf1438fb6d8e842c21d0f06 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:49.759066 20801 raft_consensus.cc:504] T 00000000000000000000000000000000 P 902aaaa7bbf1438fb6d8e842c21d0f06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902aaaa7bbf1438fb6d8e842c21d0f06" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 32947 } }
I20260806 09:15:49.759773 20801 leader_election.cc:302] T 00000000000000000000000000000000 P 902aaaa7bbf1438fb6d8e842c21d0f06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 902aaaa7bbf1438fb6d8e842c21d0f06; no voters:
I20260806 09:15:49.760581 20801 leader_election.cc:288] T 00000000000000000000000000000000 P 902aaaa7bbf1438fb6d8e842c21d0f06 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:15:49.760811 20806 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 902aaaa7bbf1438fb6d8e842c21d0f06 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:15:49.761623 20806 raft_consensus.cc:686] T 00000000000000000000000000000000 P 902aaaa7bbf1438fb6d8e842c21d0f06 [term 1 LEADER]: Becoming Leader. State: Replica: 902aaaa7bbf1438fb6d8e842c21d0f06, State: Running, Role: LEADER
I20260806 09:15:49.762328 20806 consensus_queue.cc:237] T 00000000000000000000000000000000 P 902aaaa7bbf1438fb6d8e842c21d0f06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902aaaa7bbf1438fb6d8e842c21d0f06" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 32947 } }
I20260806 09:15:49.763619 20801 sys_catalog.cc:564] T 00000000000000000000000000000000 P 902aaaa7bbf1438fb6d8e842c21d0f06 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:15:49.765928 20808 sys_catalog.cc:455] T 00000000000000000000000000000000 P 902aaaa7bbf1438fb6d8e842c21d0f06 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 902aaaa7bbf1438fb6d8e842c21d0f06. Latest consensus state: current_term: 1 leader_uuid: "902aaaa7bbf1438fb6d8e842c21d0f06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902aaaa7bbf1438fb6d8e842c21d0f06" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 32947 } } }
I20260806 09:15:49.765775 20807 sys_catalog.cc:455] T 00000000000000000000000000000000 P 902aaaa7bbf1438fb6d8e842c21d0f06 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "902aaaa7bbf1438fb6d8e842c21d0f06" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902aaaa7bbf1438fb6d8e842c21d0f06" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 32947 } } }
I20260806 09:15:49.766731 20807 sys_catalog.cc:458] T 00000000000000000000000000000000 P 902aaaa7bbf1438fb6d8e842c21d0f06 [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:49.766732 20808 sys_catalog.cc:458] T 00000000000000000000000000000000 P 902aaaa7bbf1438fb6d8e842c21d0f06 [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:49.768844 20813 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:15:49.774930 20813 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:15:49.784888 20813 catalog_manager.cc:1347] Generated new cluster ID: c8076d8dbdb449aeacd1b8bb8b548c9a
I20260806 09:15:49.785029 20813 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:15:49.801515 20813 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:15:49.804180 20813 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:15:49.824712 20813 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 902aaaa7bbf1438fb6d8e842c21d0f06: Generated new TSK 0
I20260806 09:15:49.826046 20813 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:15:49.839489 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:32947
--builtin_ntp_servers=127.10.255.84:42107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260806 09:15:50.225780 20825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:50.226163 20825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:50.226372 20825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:50.235670 20825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:50.235843 20825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:50.236115 20825 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:15:50.248046 20825 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:42107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:32947
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:50.249600 20825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:50.251696 20825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:50.274199 20831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:50.281818 20830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:50.283108 20834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:50.283473 20825 server_base.cc:1034] running on GCE node
I20260806 09:15:50.284981 20825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:50.286566 20825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:50.287868 20825 hybrid_clock.cc:648] HybridClock initialized: now 1786007750287760 us; error 70 us; skew 500 ppm
I20260806 09:15:50.288369 20825 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:15:50.291956 20825 webserver.cc:460] Webserver started at http://127.10.255.65:38071/ using document root <none> and password file <none>
I20260806 09:15:50.293062 20825 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:50.293205 20825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:50.293648 20825 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:50.298918 20825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "20d47568686d44e595955d6020f64df9"
format_stamp: "Formatted at 2026-08-06 09:15:50 on dist-test-slave-mvvj"
server_key: "e5b1aa73dad9cb1276289ce4e5087181"
server_key_iv: "831e61266f7eb3fcceb164c5e82b6496"
server_key_version: "encryptionkey@0"
I20260806 09:15:50.300473 20825 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "20d47568686d44e595955d6020f64df9"
format_stamp: "Formatted at 2026-08-06 09:15:50 on dist-test-slave-mvvj"
server_key: "e5b1aa73dad9cb1276289ce4e5087181"
server_key_iv: "831e61266f7eb3fcceb164c5e82b6496"
server_key_version: "encryptionkey@0"
I20260806 09:15:50.309904 20825 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.004s sys 0.004s
I20260806 09:15:50.315783 20839 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:50.318106 20825 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 09:15:50.318379 20825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "20d47568686d44e595955d6020f64df9"
format_stamp: "Formatted at 2026-08-06 09:15:50 on dist-test-slave-mvvj"
server_key: "e5b1aa73dad9cb1276289ce4e5087181"
server_key_iv: "831e61266f7eb3fcceb164c5e82b6496"
server_key_version: "encryptionkey@0"
I20260806 09:15:50.318719 20825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:50.342206 20825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:50.343590 20825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:50.344063 20825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:50.345639 20825 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:15:50.348304 20825 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:50.348467 20825 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:50.348624 20825 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:50.348728 20825 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:50.401463 20825 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:38493
I20260806 09:15:50.401463 20952 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:38493 every 8 connection(s)
I20260806 09:15:50.404704 20825 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:15:50.410989 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 20825
I20260806 09:15:50.411208 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:15:50.412120 11261 external_mini_cluster.cc:1428] Setting key cf9b8059f0f3e1385c02b6cecf225bab
I20260806 09:15:50.415988 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:32947
--builtin_ntp_servers=127.10.255.84:42107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260806 09:15:50.423593 20955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:50.408498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:57193 (local address 127.10.255.126:32947)
0806 09:15:50.409172 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:50.409176 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:50.411928 (+ 2752us) server_negotiation.cc:407] Connection header received
0806 09:15:50.413530 (+ 1602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:50.413536 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:50.413640 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:50.413773 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:50.415266 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:50.416713 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:50.419596 (+ 2883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:50.420123 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:50.420261 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:50.422332 (+ 2071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:50.422342 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:50.422351 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:15:50.422385 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:50.422453 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:15:50.422475 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:50.422600 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:50.422906 (+ 306us) server_negotiation.cc:299] Negotiation successful
0806 09:15:50.423057 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":434,"threads_started":1}
I20260806 09:15:50.425029 20956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:50.409276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32947 (local address 127.10.255.65:57193)
0806 09:15:50.410488 (+ 1212us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:50.410546 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:50.413171 (+ 2625us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:50.414061 (+ 890us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:50.414072 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:50.414178 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:50.415039 (+ 861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:50.415069 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:50.416968 (+ 1899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:50.416977 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:50.419345 (+ 2368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:50.419383 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:50.420432 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:50.420442 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:50.420820 (+ 378us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:50.421833 (+ 1013us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 09:15:50.421839 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:50.421906 (+ 67us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 09:15:50.422038 (+ 132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:50.422617 (+ 579us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:50.422631 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:50.422644 (+ 13us) client_negotiation.cc:769] Sending connection context
0806 09:15:50.422872 (+ 228us) client_negotiation.cc:240] Negotiation successful
0806 09:15:50.423389 (+ 517us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":618,"thread_start_us":378,"threads_started":1}
I20260806 09:15:50.427433 20953 heartbeater.cc:347] Connected to a master server at 127.10.255.126:32947
I20260806 09:15:50.427878 20953 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:50.429035 20953 heartbeater.cc:511] Master 127.10.255.126:32947 requested a full tablet report, sending...
I20260806 09:15:50.432225 20766 ts_manager.cc:194] Registered new tserver with Master: 20d47568686d44e595955d6020f64df9 (127.10.255.65:38493)
I20260806 09:15:50.434659 20766 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.255.65:57193
W20260806 09:15:50.796659 20957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:50.797049 20957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:50.797227 20957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:50.804998 20957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:50.805181 20957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:50.805358 20957 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:15:50.815659 20957 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:42107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:32947
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:50.817085 20957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:50.819018 20957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:50.833792 20965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:50.833727 20963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:50.833750 20962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:50.834553 20957 server_base.cc:1034] running on GCE node
I20260806 09:15:50.835315 20957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:50.836499 20957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:50.837798 20957 hybrid_clock.cc:648] HybridClock initialized: now 1786007750837732 us; error 79 us; skew 500 ppm
I20260806 09:15:50.838208 20957 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:15:50.847702 20957 webserver.cc:460] Webserver started at http://127.10.255.66:37923/ using document root <none> and password file <none>
I20260806 09:15:50.848901 20957 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:50.849099 20957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:50.849510 20957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:50.853149 20957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "a6dfc176d72c4932981f912dc027d439"
format_stamp: "Formatted at 2026-08-06 09:15:50 on dist-test-slave-mvvj"
server_key: "a0114d6ae62217d25d9204729c86cb36"
server_key_iv: "464a058fb78dd897a489580154dba95d"
server_key_version: "encryptionkey@0"
I20260806 09:15:50.854200 20957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "a6dfc176d72c4932981f912dc027d439"
format_stamp: "Formatted at 2026-08-06 09:15:50 on dist-test-slave-mvvj"
server_key: "a0114d6ae62217d25d9204729c86cb36"
server_key_iv: "464a058fb78dd897a489580154dba95d"
server_key_version: "encryptionkey@0"
I20260806 09:15:50.860669 20957 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 09:15:50.865499 20971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:50.867738 20957 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260806 09:15:50.868016 20957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "a6dfc176d72c4932981f912dc027d439"
format_stamp: "Formatted at 2026-08-06 09:15:50 on dist-test-slave-mvvj"
server_key: "a0114d6ae62217d25d9204729c86cb36"
server_key_iv: "464a058fb78dd897a489580154dba95d"
server_key_version: "encryptionkey@0"
I20260806 09:15:50.868299 20957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:50.884923 20957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:50.885921 20957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:50.886294 20957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:50.887425 20957 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:15:50.889204 20957 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:50.889340 20957 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:50.889487 20957 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:50.889585 20957 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:50.931203 20957 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:46795
I20260806 09:15:50.931255 21084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:46795 every 8 connection(s)
I20260806 09:15:50.932691 20957 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:15:50.939531 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 20957
I20260806 09:15:50.939756 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:15:50.940256 11261 external_mini_cluster.cc:1428] Setting key 8a3b6740cc083df877b82e58b6ace11c
I20260806 09:15:50.943539 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:32947
--builtin_ntp_servers=127.10.255.84:42107
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260806 09:15:50.947348 21087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:50.935532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:36807 (local address 127.10.255.126:32947)
0806 09:15:50.936070 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:50.936075 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:50.937302 (+ 1227us) server_negotiation.cc:407] Connection header received
0806 09:15:50.939239 (+ 1937us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:50.939245 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:50.939348 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:50.939492 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:50.940873 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:50.941810 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:50.943810 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:50.944264 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:50.944385 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:50.946381 (+ 1996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:50.946389 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:50.946394 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:15:50.946478 (+ 84us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:50.946543 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:15:50.946565 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:50.946667 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:50.946974 (+ 307us) server_negotiation.cc:299] Negotiation successful
0806 09:15:50.947067 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":257,"threads_started":1}
I20260806 09:15:50.949018 21088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:50.936111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32947 (local address 127.10.255.66:36807)
0806 09:15:50.937116 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:50.937163 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:50.938910 (+ 1747us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:50.939797 (+ 887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:50.939806 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:50.939980 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:50.940674 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:50.940694 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:50.941992 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:50.941998 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:50.943539 (+ 1541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:50.943553 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:50.944543 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:50.944553 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:50.944941 (+ 388us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:50.945861 (+ 920us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 09:15:50.945867 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:50.945929 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 09:15:50.946060 (+ 131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:50.946703 (+ 643us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:50.946718 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:50.946730 (+ 12us) client_negotiation.cc:769] Sending connection context
0806 09:15:50.946947 (+ 217us) client_negotiation.cc:240] Negotiation successful
0806 09:15:50.947455 (+ 508us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":303,"threads_started":1}
I20260806 09:15:50.950667 21085 heartbeater.cc:347] Connected to a master server at 127.10.255.126:32947
I20260806 09:15:50.951030 21085 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:50.952105 21085 heartbeater.cc:511] Master 127.10.255.126:32947 requested a full tablet report, sending...
I20260806 09:15:50.953944 20766 ts_manager.cc:194] Registered new tserver with Master: a6dfc176d72c4932981f912dc027d439 (127.10.255.66:46795)
I20260806 09:15:50.954871 20766 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.255.66:36807
W20260806 09:15:51.308727 21089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:51.309044 21089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:51.309199 21089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:51.316989 21089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:51.317126 21089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:51.317310 21089 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:15:51.327718 21089 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:42107
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:32947
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:51.329191 21089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:51.331156 21089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:51.346622 21094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:51.346699 21095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:51.346678 21097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:51.348490 21089 server_base.cc:1034] running on GCE node
I20260806 09:15:51.349269 21089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:51.350449 21089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:51.351727 21089 hybrid_clock.cc:648] HybridClock initialized: now 1786007751351655 us; error 62 us; skew 500 ppm
I20260806 09:15:51.352174 21089 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:15:51.354892 21089 webserver.cc:460] Webserver started at http://127.10.255.67:40463/ using document root <none> and password file <none>
I20260806 09:15:51.355700 21089 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:51.355824 21089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:51.356231 21089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:51.359454 21089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "f893afffc7d14750885fb92911855fbf"
format_stamp: "Formatted at 2026-08-06 09:15:51 on dist-test-slave-mvvj"
server_key: "4f5e988ab24eae7bc8107247eea95240"
server_key_iv: "4f3929bfc6472207d3b1b759d9b789c4"
server_key_version: "encryptionkey@0"
I20260806 09:15:51.360555 21089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "f893afffc7d14750885fb92911855fbf"
format_stamp: "Formatted at 2026-08-06 09:15:51 on dist-test-slave-mvvj"
server_key: "4f5e988ab24eae7bc8107247eea95240"
server_key_iv: "4f3929bfc6472207d3b1b759d9b789c4"
server_key_version: "encryptionkey@0"
I20260806 09:15:51.367317 21089 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 09:15:51.371609 21103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:51.373382 21089 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:15:51.373584 21089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "f893afffc7d14750885fb92911855fbf"
format_stamp: "Formatted at 2026-08-06 09:15:51 on dist-test-slave-mvvj"
server_key: "4f5e988ab24eae7bc8107247eea95240"
server_key_iv: "4f3929bfc6472207d3b1b759d9b789c4"
server_key_version: "encryptionkey@0"
I20260806 09:15:51.373837 21089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:51.409734 21089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:51.410735 21089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:51.411068 21089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:51.412233 21089 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:15:51.413924 21089 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:51.414054 21089 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:51.414197 21089 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:51.414288 21089 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:51.439811 20953 heartbeater.cc:503] Master 127.10.255.126:32947 was elected leader, sending a full tablet report...
I20260806 09:15:51.453930 21089 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:39653
I20260806 09:15:51.454073 21216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:39653 every 8 connection(s)
I20260806 09:15:51.455432 21089 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:15:51.465694 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 21089
I20260806 09:15:51.465906 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:15:51.466500 11261 external_mini_cluster.cc:1428] Setting key 6574b2a098648451e23a586dc483786a
I20260806 09:15:51.481851 21219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:51.459437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:37659 (local address 127.10.255.126:32947)
0806 09:15:51.472314 (+ 12877us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:51.472318 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:51.472336 (+ 18us) server_negotiation.cc:407] Connection header received
0806 09:15:51.472387 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:51.472392 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:51.472457 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:51.472562 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:51.474099 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:51.475185 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:51.477380 (+ 2195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:51.477986 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:51.478133 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:51.480248 (+ 2115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:51.480254 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:51.480258 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:15:51.480282 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:51.480339 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:15:51.480354 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:51.480453 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:51.480989 (+ 536us) server_negotiation.cc:299] Negotiation successful
0806 09:15:51.481198 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12757,"thread_start_us":12573,"threads_started":1}
I20260806 09:15:51.483330 21220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:51.462170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32947 (local address 127.10.255.67:37659)
0806 09:15:51.463723 (+ 1553us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:51.463789 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:51.468520 (+ 4731us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:51.472907 (+ 4387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:51.472918 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:51.473069 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:51.473883 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:51.473906 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:51.475411 (+ 1505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:51.475416 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:51.477151 (+ 1735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:51.477176 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:51.478317 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:51.478325 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:51.478715 (+ 390us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:51.479733 (+ 1018us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 09:15:51.479736 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:51.479794 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 09:15:51.479985 (+ 191us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:51.480602 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:51.480620 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:51.480631 (+ 11us) client_negotiation.cc:769] Sending connection context
0806 09:15:51.480903 (+ 272us) client_negotiation.cc:240] Negotiation successful
0806 09:15:51.481485 (+ 582us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":715,"thread_start_us":404,"threads_started":1}
I20260806 09:15:51.484978 21217 heartbeater.cc:347] Connected to a master server at 127.10.255.126:32947
I20260806 09:15:51.485338 21217 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:51.486258 21217 heartbeater.cc:511] Master 127.10.255.126:32947 requested a full tablet report, sending...
I20260806 09:15:51.487967 20766 ts_manager.cc:194] Registered new tserver with Master: f893afffc7d14750885fb92911855fbf (127.10.255.67:39653)
I20260806 09:15:51.488843 20766 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.255.67:37659
I20260806 09:15:51.497530 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 09:15:51.505115 21219 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:51.502882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59574 (local address 127.10.255.126:32947)
0806 09:15:51.503122 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:51.503128 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:51.503810 (+ 682us) server_negotiation.cc:407] Connection header received
0806 09:15:51.504044 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:51.504049 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:51.504123 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:51.504226 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:51.504770 (+ 544us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59574: BlockingRecv error: recv got EOF from 127.0.0.1:59574 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
I20260806 09:15:51.506230 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 20825
I20260806 09:15:51.516700 21227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:51.507296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58744 (local address 127.10.255.65:38493)
0806 09:15:51.507950 (+ 654us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:51.507958 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:51.507989 (+ 31us) server_negotiation.cc:407] Connection header received
0806 09:15:51.508055 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:51.508062 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:51.508286 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:51.508509 (+ 223us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:51.509162 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:51.510476 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:51.512074 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:51.512847 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:51.512996 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:51.514723 (+ 1727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:51.514734 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:51.514750 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:15:51.515393 (+ 643us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:51.515464 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:15:51.515489 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:51.515606 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:51.516174 (+ 568us) server_negotiation.cc:299] Negotiation successful
0806 09:15:51.516336 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":300,"threads_started":1}
I20260806 09:15:51.518591 20948 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:51.612993 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 20825
I20260806 09:15:51.632612 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 20957
I20260806 09:15:51.641793 21229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:51.633690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36806 (local address 127.10.255.66:46795)
0806 09:15:51.634244 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:51.634252 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:51.634281 (+ 29us) server_negotiation.cc:407] Connection header received
0806 09:15:51.634355 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:51.634362 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:51.634601 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:51.634750 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:51.635191 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:51.636330 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:51.637762 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:51.638390 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:51.638514 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:51.639687 (+ 1173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:51.639696 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:51.639711 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:15:51.640682 (+ 971us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:51.640739 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:15:51.640769 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:51.640873 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:51.641135 (+ 262us) server_negotiation.cc:299] Negotiation successful
0806 09:15:51.641374 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":292,"threads_started":1}
I20260806 09:15:51.643249 21080 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:51.732143 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 20957
I20260806 09:15:51.751444 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 21089
I20260806 09:15:51.760990 21231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:51.752763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53340 (local address 127.10.255.67:39653)
0806 09:15:51.753563 (+ 800us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:51.753572 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:51.753616 (+ 44us) server_negotiation.cc:407] Connection header received
0806 09:15:51.753691 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:51.753698 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:51.753932 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:51.754091 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:51.754616 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:51.755752 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:51.757228 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:51.757907 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:51.758036 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:51.759241 (+ 1205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:51.759250 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:51.759270 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:15:51.760038 (+ 768us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:51.760104 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:15:51.760125 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:51.760221 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:51.760377 (+ 156us) server_negotiation.cc:299] Negotiation successful
0806 09:15:51.760613 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":541,"thread_start_us":353,"threads_started":1}
I20260806 09:15:51.762552 21212 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:51.850198 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 21089
I20260806 09:15:51.869362 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 20734
I20260806 09:15:51.870790 20796 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:51.979051 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 20734
2026-08-06T09:15:51Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2820 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-06T09:15:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:15:52Z Disabled control of system clock
I20260806 09:15:52.061657 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:40583
--webserver_interface=127.10.255.126
--webserver_port=0
--builtin_ntp_servers=127.10.255.84:40819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:40583
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 09:15:52.415022 21237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:52.415393 21237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:52.415550 21237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:52.425601 21237 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:15:52.425755 21237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:52.425837 21237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:52.425940 21237 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:15:52.426033 21237 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:15:52.436033 21237 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:40819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:40583
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:40583
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:52.437621 21237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:52.439667 21237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:52.453169 21242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:52.453249 21243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:52.453202 21245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:52.454378 21237 server_base.cc:1034] running on GCE node
I20260806 09:15:52.455344 21237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:52.457157 21237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:52.458622 21237 hybrid_clock.cc:648] HybridClock initialized: now 1786007752458434 us; error 55 us; skew 500 ppm
I20260806 09:15:52.459172 21237 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:15:52.462045 21237 webserver.cc:460] Webserver started at http://127.10.255.126:39383/ using document root <none> and password file <none>
I20260806 09:15:52.462881 21237 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:52.463042 21237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:52.463420 21237 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:52.466879 21237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "e83e1f3b12794e85b5dd57a6b6e10211"
format_stamp: "Formatted at 2026-08-06 09:15:52 on dist-test-slave-mvvj"
server_key: "f1e061a036198893c14d79650303948b"
server_key_iv: "0e9e910cbd00b7bcbfa2d904c48a767f"
server_key_version: "encryptionkey@0"
I20260806 09:15:52.467984 21237 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "e83e1f3b12794e85b5dd57a6b6e10211"
format_stamp: "Formatted at 2026-08-06 09:15:52 on dist-test-slave-mvvj"
server_key: "f1e061a036198893c14d79650303948b"
server_key_iv: "0e9e910cbd00b7bcbfa2d904c48a767f"
server_key_version: "encryptionkey@0"
I20260806 09:15:52.474705 21237 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 09:15:52.479426 21251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:52.481904 21237 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:15:52.482206 21237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "e83e1f3b12794e85b5dd57a6b6e10211"
format_stamp: "Formatted at 2026-08-06 09:15:52 on dist-test-slave-mvvj"
server_key: "f1e061a036198893c14d79650303948b"
server_key_iv: "0e9e910cbd00b7bcbfa2d904c48a767f"
server_key_version: "encryptionkey@0"
I20260806 09:15:52.482576 21237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:52.489720 21237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:52.490712 21237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:52.491086 21237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:52.513230 21237 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:40583
I20260806 09:15:52.513270 21303 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:40583 every 8 connection(s)
I20260806 09:15:52.514886 21237 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:15:52.518873 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 21237
I20260806 09:15:52.519145 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:15:52.520082 11261 external_mini_cluster.cc:1428] Setting key dbca4b8a1c33a2b9eb67534f2929bea1
I20260806 09:15:52.520117 21304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:52.529765 21307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:52.522412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58292 (local address 127.10.255.126:40583)
0806 09:15:52.523618 (+ 1206us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:52.523630 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:52.523685 (+ 55us) server_negotiation.cc:407] Connection header received
0806 09:15:52.525809 (+ 2124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:52.525839 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:52.526348 (+ 509us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:52.526794 (+ 446us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:52.528001 (+ 1207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:52.528025 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:52.528039 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:15:52.528056 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:52.528131 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:15:52.528154 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:52.528347 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:52.528450 (+ 103us) server_negotiation.cc:299] Negotiation successful
0806 09:15:52.528776 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":683,"thread_start_us":422,"threads_started":1}
I20260806 09:15:52.534726 21304 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e83e1f3b12794e85b5dd57a6b6e10211: Bootstrap starting.
I20260806 09:15:52.538344 21304 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e83e1f3b12794e85b5dd57a6b6e10211: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:52.539537 21304 log.cc:824] T 00000000000000000000000000000000 P e83e1f3b12794e85b5dd57a6b6e10211: Log is configured to *not* fsync() on all Append() calls
I20260806 09:15:52.542950 21304 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e83e1f3b12794e85b5dd57a6b6e10211: No bootstrap required, opened a new log
I20260806 09:15:52.550716 21304 raft_consensus.cc:348] T 00000000000000000000000000000000 P e83e1f3b12794e85b5dd57a6b6e10211 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e83e1f3b12794e85b5dd57a6b6e10211" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40583 } }
I20260806 09:15:52.551192 21304 raft_consensus.cc:374] T 00000000000000000000000000000000 P e83e1f3b12794e85b5dd57a6b6e10211 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:52.551308 21304 raft_consensus.cc:729] T 00000000000000000000000000000000 P e83e1f3b12794e85b5dd57a6b6e10211 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e83e1f3b12794e85b5dd57a6b6e10211, State: Initialized, Role: FOLLOWER
I20260806 09:15:52.552085 21304 consensus_queue.cc:260] T 00000000000000000000000000000000 P e83e1f3b12794e85b5dd57a6b6e10211 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e83e1f3b12794e85b5dd57a6b6e10211" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40583 } }
I20260806 09:15:52.552362 21304 raft_consensus.cc:388] T 00000000000000000000000000000000 P e83e1f3b12794e85b5dd57a6b6e10211 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:15:52.552531 21304 raft_consensus.cc:482] T 00000000000000000000000000000000 P e83e1f3b12794e85b5dd57a6b6e10211 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:15:52.552722 21304 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e83e1f3b12794e85b5dd57a6b6e10211 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:52.555020 21304 raft_consensus.cc:504] T 00000000000000000000000000000000 P e83e1f3b12794e85b5dd57a6b6e10211 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e83e1f3b12794e85b5dd57a6b6e10211" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40583 } }
I20260806 09:15:52.555634 21304 leader_election.cc:302] T 00000000000000000000000000000000 P e83e1f3b12794e85b5dd57a6b6e10211 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e83e1f3b12794e85b5dd57a6b6e10211; no voters:
I20260806 09:15:52.556376 21304 leader_election.cc:288] T 00000000000000000000000000000000 P e83e1f3b12794e85b5dd57a6b6e10211 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:15:52.556557 21309 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e83e1f3b12794e85b5dd57a6b6e10211 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:15:52.557569 21309 raft_consensus.cc:686] T 00000000000000000000000000000000 P e83e1f3b12794e85b5dd57a6b6e10211 [term 1 LEADER]: Becoming Leader. State: Replica: e83e1f3b12794e85b5dd57a6b6e10211, State: Running, Role: LEADER
I20260806 09:15:52.558168 21309 consensus_queue.cc:237] T 00000000000000000000000000000000 P e83e1f3b12794e85b5dd57a6b6e10211 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e83e1f3b12794e85b5dd57a6b6e10211" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40583 } }
I20260806 09:15:52.558867 21304 sys_catalog.cc:564] T 00000000000000000000000000000000 P e83e1f3b12794e85b5dd57a6b6e10211 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:15:52.561091 21311 sys_catalog.cc:455] T 00000000000000000000000000000000 P e83e1f3b12794e85b5dd57a6b6e10211 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e83e1f3b12794e85b5dd57a6b6e10211. Latest consensus state: current_term: 1 leader_uuid: "e83e1f3b12794e85b5dd57a6b6e10211" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e83e1f3b12794e85b5dd57a6b6e10211" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40583 } } }
I20260806 09:15:52.562062 21311 sys_catalog.cc:458] T 00000000000000000000000000000000 P e83e1f3b12794e85b5dd57a6b6e10211 [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:52.561697 21310 sys_catalog.cc:455] T 00000000000000000000000000000000 P e83e1f3b12794e85b5dd57a6b6e10211 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e83e1f3b12794e85b5dd57a6b6e10211" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e83e1f3b12794e85b5dd57a6b6e10211" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40583 } } }
I20260806 09:15:52.562294 21310 sys_catalog.cc:458] T 00000000000000000000000000000000 P e83e1f3b12794e85b5dd57a6b6e10211 [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:52.564563 21314 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:15:52.570484 21314 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:15:52.582311 21314 catalog_manager.cc:1347] Generated new cluster ID: 27c4c2bebaa84825b4721ca7c62e2f65
I20260806 09:15:52.582480 21314 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:15:52.620014 21314 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:15:52.620558 21314 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:15:52.645051 21314 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e83e1f3b12794e85b5dd57a6b6e10211: Generated new TSK 0
I20260806 09:15:52.646119 21314 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:15:52.663141 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:40583
--builtin_ntp_servers=127.10.255.84:40819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 09:15:53.072217 21328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:53.072557 21328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:53.072724 21328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:53.080886 21328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:53.081032 21328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:53.081212 21328 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:15:53.091557 21328 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:40819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:40583
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:53.093060 21328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:53.094995 21328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:53.110852 21333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:53.111239 21334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:53.111866 21336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:53.113267 21328 server_base.cc:1034] running on GCE node
I20260806 09:15:53.114446 21328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:53.115721 21328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:53.117007 21328 hybrid_clock.cc:648] HybridClock initialized: now 1786007753116954 us; error 55 us; skew 500 ppm
I20260806 09:15:53.117398 21328 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:15:53.120200 21328 webserver.cc:460] Webserver started at http://127.10.255.65:38975/ using document root <none> and password file <none>
I20260806 09:15:53.121034 21328 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:53.121186 21328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:53.121613 21328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:53.124943 21328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "31e45d363623475ea58e61bb01338062"
format_stamp: "Formatted at 2026-08-06 09:15:53 on dist-test-slave-mvvj"
server_key: "7b24515312fc7abba1cb5a5bcd8e8800"
server_key_iv: "766c0ef0f0769c3e513f299c03b47f94"
server_key_version: "encryptionkey@0"
I20260806 09:15:53.125862 21328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "31e45d363623475ea58e61bb01338062"
format_stamp: "Formatted at 2026-08-06 09:15:53 on dist-test-slave-mvvj"
server_key: "7b24515312fc7abba1cb5a5bcd8e8800"
server_key_iv: "766c0ef0f0769c3e513f299c03b47f94"
server_key_version: "encryptionkey@0"
I20260806 09:15:53.132081 21328 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260806 09:15:53.136557 21342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:53.138218 21328 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:15:53.138440 21328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "31e45d363623475ea58e61bb01338062"
format_stamp: "Formatted at 2026-08-06 09:15:53 on dist-test-slave-mvvj"
server_key: "7b24515312fc7abba1cb5a5bcd8e8800"
server_key_iv: "766c0ef0f0769c3e513f299c03b47f94"
server_key_version: "encryptionkey@0"
I20260806 09:15:53.138711 21328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:53.145229 21328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:53.146291 21328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:53.146603 21328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:53.147707 21328 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:15:53.149374 21328 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:53.149509 21328 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:53.149645 21328 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:53.149734 21328 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:53.189149 21328 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:44141
I20260806 09:15:53.189213 21456 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:44141 every 8 connection(s)
I20260806 09:15:53.190639 21328 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:15:53.197269 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 21328
I20260806 09:15:53.197530 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:15:53.198335 11261 external_mini_cluster.cc:1428] Setting key 510e7b7938d650918be17071e7a4a22a
I20260806 09:15:53.200685 21460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:53.193776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:56347 (local address 127.10.255.126:40583)
0806 09:15:53.194316 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:53.194321 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:53.195413 (+ 1092us) server_negotiation.cc:407] Connection header received
0806 09:15:53.197793 (+ 2380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:53.197799 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:53.197865 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:53.197998 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:53.199734 (+ 1736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:53.199740 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:53.199744 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:15:53.199763 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:53.199820 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:15:53.199866 (+ 46us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:53.200002 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:53.200222 (+ 220us) server_negotiation.cc:299] Negotiation successful
0806 09:15:53.200294 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":323,"threads_started":1}
I20260806 09:15:53.202025 21461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:53.194242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:40583 (local address 127.10.255.65:56347)
0806 09:15:53.195238 (+ 996us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:53.195284 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:53.197325 (+ 2041us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:53.198330 (+ 1005us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:53.198344 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:53.198513 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:53.199399 (+ 886us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 09:15:53.199402 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:53.199445 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 09:15:53.199554 (+ 109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:53.199989 (+ 435us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:53.199999 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:53.200006 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 09:15:53.200267 (+ 261us) client_negotiation.cc:240] Negotiation successful
0806 09:15:53.200618 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":297,"threads_started":1}
I20260806 09:15:53.202024 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:40583
--builtin_ntp_servers=127.10.255.84:40819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260806 09:15:53.204074 21458 heartbeater.cc:347] Connected to a master server at 127.10.255.126:40583
I20260806 09:15:53.204418 21458 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:53.205121 21458 heartbeater.cc:511] Master 127.10.255.126:40583 requested a full tablet report, sending...
I20260806 09:15:53.207587 21268 ts_manager.cc:194] Registered new tserver with Master: 31e45d363623475ea58e61bb01338062 (127.10.255.65:44141)
W20260806 09:15:53.575619 21462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:53.575976 21462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:53.576155 21462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:53.584143 21462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:53.584270 21462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:53.584460 21462 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:15:53.595784 21462 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:40819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:40583
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:53.597337 21462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:53.600173 21462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:53.619433 21468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:53.619724 21470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:53.619423 21467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:53.621179 21462 server_base.cc:1034] running on GCE node
I20260806 09:15:53.621973 21462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:53.623139 21462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:53.624454 21462 hybrid_clock.cc:648] HybridClock initialized: now 1786007753624389 us; error 55 us; skew 500 ppm
I20260806 09:15:53.624838 21462 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:15:53.627521 21462 webserver.cc:460] Webserver started at http://127.10.255.66:43207/ using document root <none> and password file <none>
I20260806 09:15:53.628513 21462 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:53.628624 21462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:53.628922 21462 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:53.632266 21462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "b113464a0bc2435d8d2fca2402f0cd5a"
format_stamp: "Formatted at 2026-08-06 09:15:53 on dist-test-slave-mvvj"
server_key: "6d3a1acf9f1addb0b66930c3cebe34b1"
server_key_iv: "3b973ecb6034d3b8bbe100be708203fe"
server_key_version: "encryptionkey@0"
I20260806 09:15:53.633221 21462 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "b113464a0bc2435d8d2fca2402f0cd5a"
format_stamp: "Formatted at 2026-08-06 09:15:53 on dist-test-slave-mvvj"
server_key: "6d3a1acf9f1addb0b66930c3cebe34b1"
server_key_iv: "3b973ecb6034d3b8bbe100be708203fe"
server_key_version: "encryptionkey@0"
I20260806 09:15:53.640519 21462 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260806 09:15:53.644559 21476 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:53.646234 21462 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 09:15:53.646458 21462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "b113464a0bc2435d8d2fca2402f0cd5a"
format_stamp: "Formatted at 2026-08-06 09:15:53 on dist-test-slave-mvvj"
server_key: "6d3a1acf9f1addb0b66930c3cebe34b1"
server_key_iv: "3b973ecb6034d3b8bbe100be708203fe"
server_key_version: "encryptionkey@0"
I20260806 09:15:53.646728 21462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:53.653374 21462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:53.654399 21462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:53.654691 21462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:53.655766 21462 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:15:53.657449 21462 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:53.657541 21462 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:53.657651 21462 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:53.657752 21462 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:53.697098 21462 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:41443
I20260806 09:15:53.697216 21589 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:41443 every 8 connection(s)
I20260806 09:15:53.698562 21462 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:15:53.701155 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 21462
I20260806 09:15:53.701383 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:15:53.701915 11261 external_mini_cluster.cc:1428] Setting key 471030e5b530f79a9c431ae9e4941e9b
I20260806 09:15:53.705504 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:40583
--builtin_ntp_servers=127.10.255.84:40819
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260806 09:15:53.709098 21592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:53.701644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:43593 (local address 127.10.255.126:40583)
0806 09:15:53.702194 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:53.702200 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:53.703715 (+ 1515us) server_negotiation.cc:407] Connection header received
0806 09:15:53.705872 (+ 2157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:53.705877 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:53.705942 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:53.706072 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:53.707693 (+ 1621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:53.707699 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:53.707704 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:15:53.707735 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:53.707943 (+ 208us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:15:53.707974 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:53.708504 (+ 530us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:53.708668 (+ 164us) server_negotiation.cc:299] Negotiation successful
0806 09:15:53.708752 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":276,"threads_started":1}
I20260806 09:15:53.710258 21593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:53.702352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:40583 (local address 127.10.255.66:43593)
0806 09:15:53.703538 (+ 1186us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:53.703587 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:53.705423 (+ 1836us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:53.706365 (+ 942us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:53.706375 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:53.706493 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:53.707326 (+ 833us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 09:15:53.707329 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:53.707375 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 09:15:53.707488 (+ 113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:53.708377 (+ 889us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:53.708391 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:53.708402 (+ 11us) client_negotiation.cc:769] Sending connection context
0806 09:15:53.708765 (+ 363us) client_negotiation.cc:240] Negotiation successful
0806 09:15:53.709156 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":371,"threads_started":1}
I20260806 09:15:53.712201 21590 heartbeater.cc:347] Connected to a master server at 127.10.255.126:40583
I20260806 09:15:53.712653 21590 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:53.713366 21590 heartbeater.cc:511] Master 127.10.255.126:40583 requested a full tablet report, sending...
I20260806 09:15:53.715319 21268 ts_manager.cc:194] Registered new tserver with Master: b113464a0bc2435d8d2fca2402f0cd5a (127.10.255.66:41443)
W20260806 09:15:54.089516 21594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:54.089944 21594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:54.090122 21594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:54.097873 21594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:54.098050 21594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:54.098233 21594 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:15:54.108094 21594 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:40819
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:40583
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:54.109573 21594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:54.111749 21594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:54.128010 21599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:54.127942 21602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:54.127960 21600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:54.129143 21594 server_base.cc:1034] running on GCE node
I20260806 09:15:54.129951 21594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:54.131081 21594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:54.132313 21594 hybrid_clock.cc:648] HybridClock initialized: now 1786007754132236 us; error 70 us; skew 500 ppm
I20260806 09:15:54.132714 21594 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:15:54.135473 21594 webserver.cc:460] Webserver started at http://127.10.255.67:37457/ using document root <none> and password file <none>
I20260806 09:15:54.136394 21594 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:54.136518 21594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:54.136893 21594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:54.140316 21594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "fa183737b49f477a94a43a7057e3c0ec"
format_stamp: "Formatted at 2026-08-06 09:15:54 on dist-test-slave-mvvj"
server_key: "e783d3d83cbc33b0875a9b666458c35a"
server_key_iv: "8c330ed085951ab4edb2ed2c3d10df55"
server_key_version: "encryptionkey@0"
I20260806 09:15:54.141225 21594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "fa183737b49f477a94a43a7057e3c0ec"
format_stamp: "Formatted at 2026-08-06 09:15:54 on dist-test-slave-mvvj"
server_key: "e783d3d83cbc33b0875a9b666458c35a"
server_key_iv: "8c330ed085951ab4edb2ed2c3d10df55"
server_key_version: "encryptionkey@0"
I20260806 09:15:54.147324 21594 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260806 09:15:54.151813 21608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:54.153718 21594 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:15:54.153957 21594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "fa183737b49f477a94a43a7057e3c0ec"
format_stamp: "Formatted at 2026-08-06 09:15:54 on dist-test-slave-mvvj"
server_key: "e783d3d83cbc33b0875a9b666458c35a"
server_key_iv: "8c330ed085951ab4edb2ed2c3d10df55"
server_key_version: "encryptionkey@0"
I20260806 09:15:54.154255 21594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:54.161545 21594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:54.162649 21594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:54.163008 21594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:54.164413 21594 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:15:54.166342 21594 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:54.166491 21594 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:54.166628 21594 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:54.166832 21594 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260806 09:15:54.206614 21594 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:42251
I20260806 09:15:54.206670 21721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:42251 every 8 connection(s)
I20260806 09:15:54.208177 21594 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:15:54.211403 21458 heartbeater.cc:503] Master 127.10.255.126:40583 was elected leader, sending a full tablet report...
I20260806 09:15:54.215322 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 21594
I20260806 09:15:54.215534 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:15:54.216157 11261 external_mini_cluster.cc:1428] Setting key cda9f9f21696199aad70b14c4e72e970
I20260806 09:15:54.217511 21724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:54.210970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:59971 (local address 127.10.255.126:40583)
0806 09:15:54.213519 (+ 2549us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:54.213526 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:54.213545 (+ 19us) server_negotiation.cc:407] Connection header received
0806 09:15:54.214707 (+ 1162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:54.214716 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:54.214783 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:54.214938 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:54.216445 (+ 1507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:54.216452 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:54.216457 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:15:54.216479 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:54.216534 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:15:54.216551 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:54.216682 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:54.217032 (+ 350us) server_negotiation.cc:299] Negotiation successful
0806 09:15:54.217105 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2426,"thread_start_us":2308,"threads_started":1}
I20260806 09:15:54.218430 21725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:54.211625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:40583 (local address 127.10.255.67:59971)
0806 09:15:54.212764 (+ 1139us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:54.212811 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:54.214349 (+ 1538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:54.215145 (+ 796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:54.215154 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:54.215249 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:54.216088 (+ 839us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 09:15:54.216092 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:54.216135 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 09:15:54.216233 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:54.216654 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:54.216662 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:54.216668 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 09:15:54.217034 (+ 366us) client_negotiation.cc:240] Negotiation successful
0806 09:15:54.217316 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"thread_start_us":395,"threads_started":1}
I20260806 09:15:54.220005 21722 heartbeater.cc:347] Connected to a master server at 127.10.255.126:40583
I20260806 09:15:54.220296 21722 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:54.220930 21722 heartbeater.cc:511] Master 127.10.255.126:40583 requested a full tablet report, sending...
I20260806 09:15:54.222375 21267 ts_manager.cc:194] Registered new tserver with Master: fa183737b49f477a94a43a7057e3c0ec (127.10.255.67:42251)
I20260806 09:15:54.232877 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 09:15:54.239780 21724 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:15:54.237934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58306 (local address 127.10.255.126:40583)
0806 09:15:54.238143 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:54.238150 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:54.238621 (+ 471us) server_negotiation.cc:407] Connection header received
0806 09:15:54.238857 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:54.238873 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:54.238930 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:54.239040 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:54.239452 (+ 412us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58306: BlockingRecv error: recv got EOF from 127.0.0.1:58306 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 09:15:54.240556 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 21328
I20260806 09:15:54.245200 21732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:54.241928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50434 (local address 127.10.255.65:44141)
0806 09:15:54.242579 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:54.242587 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:54.242613 (+ 26us) server_negotiation.cc:407] Connection header received
0806 09:15:54.242675 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:54.242681 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:54.243008 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:54.243198 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:54.244380 (+ 1182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:54.244386 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:54.244399 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:15:54.244410 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:54.244458 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:15:54.244473 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:54.244695 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:54.244765 (+ 70us) server_negotiation.cc:299] Negotiation successful
0806 09:15:54.244880 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":266,"threads_started":1}
I20260806 09:15:54.246551 21452 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:54.334204 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 21328
I20260806 09:15:54.354064 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 21462
I20260806 09:15:54.358245 21734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:54.355192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46652 (local address 127.10.255.66:41443)
0806 09:15:54.355795 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:54.355803 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:54.355883 (+ 80us) server_negotiation.cc:407] Connection header received
0806 09:15:54.355970 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:54.355977 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:54.356212 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:54.356403 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:54.357500 (+ 1097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:54.357507 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:54.357521 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:15:54.357534 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:54.357579 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:15:54.357594 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:54.357754 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:54.357839 (+ 85us) server_negotiation.cc:299] Negotiation successful
0806 09:15:54.357947 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":314,"threads_started":1}
I20260806 09:15:54.360013 21585 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:54.449285 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 21462
I20260806 09:15:54.468048 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 21594
I20260806 09:15:54.472671 21736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:54.469141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47038 (local address 127.10.255.67:42251)
0806 09:15:54.469847 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:54.469854 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:54.469886 (+ 32us) server_negotiation.cc:407] Connection header received
0806 09:15:54.469978 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:54.469986 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:54.470217 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:54.470355 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:54.471648 (+ 1293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:54.471655 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:54.471668 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:15:54.471689 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:54.471736 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:15:54.471751 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:54.472126 (+ 375us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:54.472189 (+ 63us) server_negotiation.cc:299] Negotiation successful
0806 09:15:54.472328 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547,"thread_start_us":343,"threads_started":1}
I20260806 09:15:54.474098 21717 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:54.570603 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 21594
I20260806 09:15:54.588310 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 21237
I20260806 09:15:54.589802 21299 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:54.707808 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 21237
2026-08-06T09:15:54Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2729 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:15:54 dist-test-slave-mvvj krb5kdc[21741](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:15:54 dist-test-slave-mvvj krb5kdc[21741](info): set up 2 sockets
Aug 06 09:15:54 dist-test-slave-mvvj krb5kdc[21741](info): commencing operation
krb5kdc: starting...
W20260806 09:15:55.849807 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.097s user 0.001s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:15:56 dist-test-slave-mvvj krb5kdc[21741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007756, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:15:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:15:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:15:56.130358 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:42271
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:34205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:42271
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:15:56.492434 21754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:56.492797 21754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:56.492894 21754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:56.500896 21754 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:15:56.501037 21754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:56.501085 21754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:56.501137 21754 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:15:56.501183 21754 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:15:56.511897 21754 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:34205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:42271
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:42271
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:56.513343 21754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:56.515014 21754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:56.529626 21762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:56.529536 21759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:56.529507 21760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:56.530491 21754 server_base.cc:1034] running on GCE node
I20260806 09:15:56.531400 21754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:56.533197 21754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:56.534559 21754 hybrid_clock.cc:648] HybridClock initialized: now 1786007756534407 us; error 92 us; skew 500 ppm
I20260806 09:15:56.535014 21754 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:56 dist-test-slave-mvvj krb5kdc[21741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007756, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:56.545186 21754 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:15:56.547274 21754 webserver.cc:460] Webserver started at http://127.10.255.126:36243/ using document root <none> and password file <none>
I20260806 09:15:56.548242 21754 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:56.548424 21754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:56.548805 21754 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:56.552767 21754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "7b50881a63ff422fa5fb538352b219ca"
format_stamp: "Formatted at 2026-08-06 09:15:56 on dist-test-slave-mvvj"
server_key: "906a9f983733435659a9a065d549fe01"
server_key_iv: "4f50ab0afbe7c2934c22693aa031a8de"
server_key_version: "encryptionkey@0"
I20260806 09:15:56.553812 21754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "7b50881a63ff422fa5fb538352b219ca"
format_stamp: "Formatted at 2026-08-06 09:15:56 on dist-test-slave-mvvj"
server_key: "906a9f983733435659a9a065d549fe01"
server_key_iv: "4f50ab0afbe7c2934c22693aa031a8de"
server_key_version: "encryptionkey@0"
I20260806 09:15:56.560562 21754 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 09:15:56.564910 21769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:56.566766 21754 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260806 09:15:56.567101 21754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "7b50881a63ff422fa5fb538352b219ca"
format_stamp: "Formatted at 2026-08-06 09:15:56 on dist-test-slave-mvvj"
server_key: "906a9f983733435659a9a065d549fe01"
server_key_iv: "4f50ab0afbe7c2934c22693aa031a8de"
server_key_version: "encryptionkey@0"
I20260806 09:15:56.567385 21754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:56.601804 21754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:56.607126 21754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:56.607530 21754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:56.629293 21754 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:42271
I20260806 09:15:56.629326 21821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:42271 every 8 connection(s)
I20260806 09:15:56.630908 21754 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:15:56.635372 21822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:56.638550 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 21754
I20260806 09:15:56.638859 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:15:56.639554 11261 external_mini_cluster.cc:1428] Setting key ba40b5b21d19697c73838a4fff63d42b
I20260806 09:15:56.649386 21822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b50881a63ff422fa5fb538352b219ca: Bootstrap starting.
I20260806 09:15:56.654349 21822 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b50881a63ff422fa5fb538352b219ca: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:56.655967 21822 log.cc:824] T 00000000000000000000000000000000 P 7b50881a63ff422fa5fb538352b219ca: Log is configured to *not* fsync() on all Append() calls
Aug 06 09:15:56 dist-test-slave-mvvj krb5kdc[21741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007756, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:15:56.659698 21822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b50881a63ff422fa5fb538352b219ca: No bootstrap required, opened a new log
I20260806 09:15:56.667964 21825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:56.642071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36726 (local address 127.10.255.126:42271)
0806 09:15:56.643028 (+ 957us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:56.643047 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:56.643104 (+ 57us) server_negotiation.cc:407] Connection header received
0806 09:15:56.644987 (+ 1883us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:56.645018 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:56.645520 (+ 502us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:56.646019 (+ 499us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:56.647961 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:56.649717 (+ 1756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:56.651933 (+ 2216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:56.653471 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:56.653725 (+ 254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:56.658787 (+ 5062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:56.658796 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:56.658814 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:56.658860 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:56.662806 (+ 3946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:56.663798 (+ 992us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:56.663807 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:56.663815 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:56.664097 (+ 282us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:56.664557 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:56.664567 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:56.664569 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:56.665248 (+ 679us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:56.665658 (+ 410us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:56.666167 (+ 509us) server_negotiation.cc:299] Negotiation successful
0806 09:15:56.666697 (+ 530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":693,"thread_start_us":438,"threads_started":1}
I20260806 09:15:56.668522 21822 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b50881a63ff422fa5fb538352b219ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b50881a63ff422fa5fb538352b219ca" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42271 } }
I20260806 09:15:56.668978 21822 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b50881a63ff422fa5fb538352b219ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:56.669102 21822 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b50881a63ff422fa5fb538352b219ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b50881a63ff422fa5fb538352b219ca, State: Initialized, Role: FOLLOWER
I20260806 09:15:56.669903 21822 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b50881a63ff422fa5fb538352b219ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b50881a63ff422fa5fb538352b219ca" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42271 } }
I20260806 09:15:56.670212 21822 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7b50881a63ff422fa5fb538352b219ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:15:56.670358 21822 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b50881a63ff422fa5fb538352b219ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:15:56.670547 21822 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b50881a63ff422fa5fb538352b219ca [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:56.673525 21822 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b50881a63ff422fa5fb538352b219ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b50881a63ff422fa5fb538352b219ca" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42271 } }
I20260806 09:15:56.674155 21822 leader_election.cc:302] T 00000000000000000000000000000000 P 7b50881a63ff422fa5fb538352b219ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b50881a63ff422fa5fb538352b219ca; no voters:
I20260806 09:15:56.674822 21822 leader_election.cc:288] T 00000000000000000000000000000000 P 7b50881a63ff422fa5fb538352b219ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:15:56.675089 21827 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b50881a63ff422fa5fb538352b219ca [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:15:56.676653 21827 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b50881a63ff422fa5fb538352b219ca [term 1 LEADER]: Becoming Leader. State: Replica: 7b50881a63ff422fa5fb538352b219ca, State: Running, Role: LEADER
I20260806 09:15:56.677353 21827 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b50881a63ff422fa5fb538352b219ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b50881a63ff422fa5fb538352b219ca" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42271 } }
I20260806 09:15:56.677754 21822 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b50881a63ff422fa5fb538352b219ca [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:15:56.680953 21829 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b50881a63ff422fa5fb538352b219ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b50881a63ff422fa5fb538352b219ca. Latest consensus state: current_term: 1 leader_uuid: "7b50881a63ff422fa5fb538352b219ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b50881a63ff422fa5fb538352b219ca" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42271 } } }
I20260806 09:15:56.681445 21829 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b50881a63ff422fa5fb538352b219ca [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:56.682060 21828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b50881a63ff422fa5fb538352b219ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7b50881a63ff422fa5fb538352b219ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b50881a63ff422fa5fb538352b219ca" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42271 } } }
I20260806 09:15:56.682394 21828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b50881a63ff422fa5fb538352b219ca [sys.catalog]: This master's current role is: LEADER
I20260806 09:15:56.685995 21836 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:15:56.693162 21836 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:15:56.704306 21836 catalog_manager.cc:1347] Generated new cluster ID: 38a8a2433e3d42cbb267918515a4c9b2
I20260806 09:15:56.704452 21836 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:15:56.726332 21836 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:15:56.728567 21836 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:15:56.743932 21836 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b50881a63ff422fa5fb538352b219ca: Generated new TSK 0
I20260806 09:15:56.744941 21836 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.255.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
I20260806 09:15:56.822067 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42271
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:34205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:15:57.221273 21848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:57.221612 21848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:57.221784 21848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:57.229570 21848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:57.229717 21848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:57.229912 21848 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:15:57.240427 21848 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:34205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42271
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:57.241971 21848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:57.243718 21848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:57.260061 21853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:57.260319 21856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:57.260365 21854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:57.260990 21848 server_base.cc:1034] running on GCE node
I20260806 09:15:57.261797 21848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:57.263010 21848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:57.264309 21848 hybrid_clock.cc:648] HybridClock initialized: now 1786007757264222 us; error 82 us; skew 500 ppm
I20260806 09:15:57.264725 21848 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:57 dist-test-slave-mvvj krb5kdc[21741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007757, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:57.268446 21848 init.cc:377] Logged in from keytab as kudu/127.10.255.65@KRBTEST.COM (short username kudu)
I20260806 09:15:57.270332 21848 webserver.cc:460] Webserver started at http://127.10.255.65:46653/ using document root <none> and password file <none>
I20260806 09:15:57.271193 21848 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:57.271360 21848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:57.271771 21848 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:57.275451 21848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "f0d38fbd3fe04853ac2d67021921fd9f"
format_stamp: "Formatted at 2026-08-06 09:15:57 on dist-test-slave-mvvj"
server_key: "7a0b8eb36c70d212910b78cddc616b96"
server_key_iv: "2148b9ae33e0c1cb0c62cfe7dee7726f"
server_key_version: "encryptionkey@0"
I20260806 09:15:57.277216 21848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "f0d38fbd3fe04853ac2d67021921fd9f"
format_stamp: "Formatted at 2026-08-06 09:15:57 on dist-test-slave-mvvj"
server_key: "7a0b8eb36c70d212910b78cddc616b96"
server_key_iv: "2148b9ae33e0c1cb0c62cfe7dee7726f"
server_key_version: "encryptionkey@0"
I20260806 09:15:57.284474 21848 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260806 09:15:57.289059 21863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:57.290792 21848 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:15:57.291030 21848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "f0d38fbd3fe04853ac2d67021921fd9f"
format_stamp: "Formatted at 2026-08-06 09:15:57 on dist-test-slave-mvvj"
server_key: "7a0b8eb36c70d212910b78cddc616b96"
server_key_iv: "2148b9ae33e0c1cb0c62cfe7dee7726f"
server_key_version: "encryptionkey@0"
I20260806 09:15:57.291296 21848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:57.307670 21848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:57.313227 21848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:57.313611 21848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:57.314813 21848 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:15:57.316838 21848 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:57.317004 21848 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:57.317180 21848 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:57.317265 21848 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:57.356221 21848 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:36589
I20260806 09:15:57.356287 21976 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:36589 every 8 connection(s)
I20260806 09:15:57.357667 21848 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:15:57.364867 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 21848
I20260806 09:15:57.365150 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:15:57.365995 11261 external_mini_cluster.cc:1428] Setting key 5021a499465af838bb2152e7f64b41bc
Aug 06 09:15:57 dist-test-slave-mvvj krb5kdc[21741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007757, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:15:57.384150 21979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:57.360839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:47261 (local address 127.10.255.126:42271)
0806 09:15:57.361409 (+ 570us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:57.361414 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:57.362340 (+ 926us) server_negotiation.cc:407] Connection header received
0806 09:15:57.364587 (+ 2247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:57.364593 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:57.364674 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:57.364794 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:57.367170 (+ 2376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:57.368309 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:57.370195 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:57.371103 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:57.371295 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:57.375714 (+ 4419us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:57.375724 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:57.375733 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:57.375793 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:57.379617 (+ 3824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:57.380972 (+ 1355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:57.380979 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:57.380983 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:57.381171 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:57.381771 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:57.381783 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:57.381785 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:57.382166 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:57.382363 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:57.383428 (+ 1065us) server_negotiation.cc:299] Negotiation successful
0806 09:15:57.383719 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":320,"threads_started":1}
I20260806 09:15:57.385412 21980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:57.361222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42271 (local address 127.10.255.65:47261)
0806 09:15:57.362148 (+ 926us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:57.362199 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:57.364141 (+ 1942us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:57.365184 (+ 1043us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:57.365201 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:57.366086 (+ 885us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:57.366949 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:57.366971 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:57.368513 (+ 1542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:57.368518 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:57.369936 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:57.369956 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:57.371367 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:57.371373 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:57.371615 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:57.372493 (+ 878us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:57.372519 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:57.375352 (+ 2833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:57.379907 (+ 4555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:57.379922 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:57.379949 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:57.380774 (+ 825us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:57.381329 (+ 555us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:57.381341 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:57.381344 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:57.381601 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:57.382324 (+ 723us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:57.382333 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:57.382921 (+ 588us) client_negotiation.cc:769] Sending connection context
0806 09:15:57.383288 (+ 367us) client_negotiation.cc:240] Negotiation successful
0806 09:15:57.383994 (+ 706us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":649,"thread_start_us":318,"threads_started":1}
I20260806 09:15:57.387634 21977 heartbeater.cc:347] Connected to a master server at 127.10.255.126:42271
I20260806 09:15:57.388054 21977 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:57.389022 21977 heartbeater.cc:511] Master 127.10.255.126:42271 requested a full tablet report, sending...
I20260806 09:15:57.392020 21786 ts_manager.cc:194] Registered new tserver with Master: f0d38fbd3fe04853ac2d67021921fd9f (127.10.255.65:36589)
WARNING: no policy specified for kudu/127.10.255.66@KRBTEST.COM; defaulting to no policy
I20260806 09:15:57.393808 21786 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.65@KRBTEST.COM'} at 127.10.255.65:47261
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
I20260806 09:15:57.433815 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42271
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:34205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:15:57.828311 21983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:57.828665 21983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:57.828884 21983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:57.836846 21983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:57.836984 21983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:57.837189 21983 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:15:57.848268 21983 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:34205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42271
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:57.850013 21983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:57.851655 21983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:57.868871 21991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:57.868961 21989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:57.868937 21988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:57.871030 21983 server_base.cc:1034] running on GCE node
I20260806 09:15:57.872054 21983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:57.874075 21983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:57.875612 21983 hybrid_clock.cc:648] HybridClock initialized: now 1786007757875498 us; error 85 us; skew 500 ppm
I20260806 09:15:57.876415 21983 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:57 dist-test-slave-mvvj krb5kdc[21741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007757, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:57.881199 21983 init.cc:377] Logged in from keytab as kudu/127.10.255.66@KRBTEST.COM (short username kudu)
I20260806 09:15:57.883064 21983 webserver.cc:460] Webserver started at http://127.10.255.66:36153/ using document root <none> and password file <none>
I20260806 09:15:57.883929 21983 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:57.884225 21983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:57.884663 21983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:57.888939 21983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "a7b3f45a0ed340a6a2137ae09e3ce17c"
format_stamp: "Formatted at 2026-08-06 09:15:57 on dist-test-slave-mvvj"
server_key: "5aadc69bfdd0265ab3ec6df4fb9a21d3"
server_key_iv: "c8bc1d78d19add26586b61aeb6f86d97"
server_key_version: "encryptionkey@0"
I20260806 09:15:57.889956 21983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "a7b3f45a0ed340a6a2137ae09e3ce17c"
format_stamp: "Formatted at 2026-08-06 09:15:57 on dist-test-slave-mvvj"
server_key: "5aadc69bfdd0265ab3ec6df4fb9a21d3"
server_key_iv: "c8bc1d78d19add26586b61aeb6f86d97"
server_key_version: "encryptionkey@0"
I20260806 09:15:57.896831 21983 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260806 09:15:57.901046 21998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:57.902622 21983 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 09:15:57.902828 21983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "a7b3f45a0ed340a6a2137ae09e3ce17c"
format_stamp: "Formatted at 2026-08-06 09:15:57 on dist-test-slave-mvvj"
server_key: "5aadc69bfdd0265ab3ec6df4fb9a21d3"
server_key_iv: "c8bc1d78d19add26586b61aeb6f86d97"
server_key_version: "encryptionkey@0"
I20260806 09:15:57.903123 21983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:57.947757 21983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:57.952662 21983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:57.953068 21983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:57.954135 21983 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:15:57.955717 21983 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:57.955835 21983 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:57.956027 21983 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:57.956079 21983 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:57.993971 21983 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:37381
I20260806 09:15:57.994019 22110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:37381 every 8 connection(s)
I20260806 09:15:57.995573 21983 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:15:58.004721 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 21983
I20260806 09:15:58.004995 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:15:58.005477 11261 external_mini_cluster.cc:1428] Setting key 7087ecb1d7fa0c7099c647ded1b00bf9
Aug 06 09:15:58 dist-test-slave-mvvj krb5kdc[21741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007757, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:15:58.022505 22113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:57.998735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:37777 (local address 127.10.255.126:42271)
0806 09:15:57.999448 (+ 713us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:57.999455 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:58.001055 (+ 1600us) server_negotiation.cc:407] Connection header received
0806 09:15:58.003126 (+ 2071us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:58.003131 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:58.003215 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:58.003328 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:58.005619 (+ 2291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.006666 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.008943 (+ 2277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.009811 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.010107 (+ 296us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:58.014548 (+ 4441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:58.014558 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:58.014566 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:58.014624 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:58.018183 (+ 3559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:58.019510 (+ 1327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:58.019516 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:58.019518 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:58.019690 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:58.020362 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:58.020367 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:58.020370 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:58.020739 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:58.021130 (+ 391us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:58.021986 (+ 856us) server_negotiation.cc:299] Negotiation successful
0806 09:15:58.022202 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":353,"threads_started":1}
I20260806 09:15:58.024087 22114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:57.999606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42271 (local address 127.10.255.66:37777)
0806 09:15:58.000794 (+ 1188us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:58.000861 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:58.002766 (+ 1905us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:58.003697 (+ 931us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:58.003707 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:58.004496 (+ 789us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:58.005352 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:58.005378 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.006937 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.006944 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:58.008737 (+ 1793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:58.008761 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.010131 (+ 1370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.010138 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:58.010405 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:58.011265 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:58.011292 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:58.014170 (+ 2878us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:58.018436 (+ 4266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:58.018451 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:58.018476 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:58.019272 (+ 796us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:58.019854 (+ 582us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:58.019861 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:58.019867 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:58.020174 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:58.020919 (+ 745us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:58.020932 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:58.021450 (+ 518us) client_negotiation.cc:769] Sending connection context
0806 09:15:58.021783 (+ 333us) client_negotiation.cc:240] Negotiation successful
0806 09:15:58.022443 (+ 660us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":853,"thread_start_us":639,"threads_started":1}
I20260806 09:15:58.025961 22111 heartbeater.cc:347] Connected to a master server at 127.10.255.126:42271
I20260806 09:15:58.026360 22111 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:58.027305 22111 heartbeater.cc:511] Master 127.10.255.126:42271 requested a full tablet report, sending...
I20260806 09:15:58.029325 21786 ts_manager.cc:194] Registered new tserver with Master: a7b3f45a0ed340a6a2137ae09e3ce17c (127.10.255.66:37381)
I20260806 09:15:58.030702 21786 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.66@KRBTEST.COM'} at 127.10.255.66:37777
WARNING: no policy specified for kudu/127.10.255.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
I20260806 09:15:58.069340 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42271
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:34205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:15:58.397814 21977 heartbeater.cc:503] Master 127.10.255.126:42271 was elected leader, sending a full tablet report...
W20260806 09:15:58.441956 22117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:15:58.442305 22117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:15:58.442479 22117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:15:58.450573 22117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:15:58.450717 22117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:15:58.450911 22117 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:15:58.464972 22117 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:34205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42271
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:15:58.466802 22117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:15:58.468750 22117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:15:58.488451 22123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:58.488452 22125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:15:58.488770 22122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:15:58.489818 22117 server_base.cc:1034] running on GCE node
I20260806 09:15:58.490698 22117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:15:58.491948 22117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:15:58.493227 22117 hybrid_clock.cc:648] HybridClock initialized: now 1786007758493148 us; error 50 us; skew 500 ppm
I20260806 09:15:58.493623 22117 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:15:58 dist-test-slave-mvvj krb5kdc[21741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007758, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:15:58.497923 22117 init.cc:377] Logged in from keytab as kudu/127.10.255.67@KRBTEST.COM (short username kudu)
I20260806 09:15:58.499786 22117 webserver.cc:460] Webserver started at http://127.10.255.67:39433/ using document root <none> and password file <none>
I20260806 09:15:58.500674 22117 fs_manager.cc:359] Metadata directory not provided
I20260806 09:15:58.500823 22117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:15:58.501178 22117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:15:58.504580 22117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "eb04957bdf2246f9908e911e170c4dd9"
format_stamp: "Formatted at 2026-08-06 09:15:58 on dist-test-slave-mvvj"
server_key: "198b1545398b5f45f68f118e3e1b5d0b"
server_key_iv: "8c49bcf35876f1d73c44a5b8ce38f38e"
server_key_version: "encryptionkey@0"
I20260806 09:15:58.505450 22117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "eb04957bdf2246f9908e911e170c4dd9"
format_stamp: "Formatted at 2026-08-06 09:15:58 on dist-test-slave-mvvj"
server_key: "198b1545398b5f45f68f118e3e1b5d0b"
server_key_iv: "8c49bcf35876f1d73c44a5b8ce38f38e"
server_key_version: "encryptionkey@0"
I20260806 09:15:58.511659 22117 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260806 09:15:58.516073 22132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:58.517704 22117 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:15:58.517917 22117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "eb04957bdf2246f9908e911e170c4dd9"
format_stamp: "Formatted at 2026-08-06 09:15:58 on dist-test-slave-mvvj"
server_key: "198b1545398b5f45f68f118e3e1b5d0b"
server_key_iv: "8c49bcf35876f1d73c44a5b8ce38f38e"
server_key_version: "encryptionkey@0"
I20260806 09:15:58.518178 22117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:15:58.551223 22117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:15:58.556264 22117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:15:58.556707 22117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:15:58.557847 22117 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:15:58.559326 22117 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:15:58.559405 22117 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:58.559514 22117 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:15:58.559571 22117 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:15:58.597486 22117 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:36895
I20260806 09:15:58.597633 22248 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:36895 every 8 connection(s)
I20260806 09:15:58.598915 22117 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:15:58.599361 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 22117
I20260806 09:15:58.599601 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:15:58.600252 11261 external_mini_cluster.cc:1428] Setting key 33a13f6f13a1756fdca53ba414317721
Aug 06 09:15:58 dist-test-slave-mvvj krb5kdc[21741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007758, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:15:58.627791 22251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:58.602169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:38219 (local address 127.10.255.126:42271)
0806 09:15:58.602752 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:58.602758 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:58.604669 (+ 1911us) server_negotiation.cc:407] Connection header received
0806 09:15:58.607323 (+ 2654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:58.607329 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:58.607452 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:58.607625 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:58.610924 (+ 3299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.612097 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.614589 (+ 2492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.615218 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.615393 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:58.620657 (+ 5264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:58.620663 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:58.620667 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:58.620710 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:58.623926 (+ 3216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:58.624919 (+ 993us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:58.624924 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:58.624927 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:58.625079 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:58.625614 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:58.625618 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:58.625621 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:58.625934 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:58.626073 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:58.626946 (+ 873us) server_negotiation.cc:299] Negotiation successful
0806 09:15:58.627160 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":293,"threads_started":1}
I20260806 09:15:58.628726 22252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:58.602937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42271 (local address 127.10.255.67:38219)
0806 09:15:58.603882 (+ 945us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:58.603945 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:58.606833 (+ 2888us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:58.608025 (+ 1192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:58.608043 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:58.609552 (+ 1509us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:15:58.610585 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:58.610622 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.612353 (+ 1731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.612359 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:58.614128 (+ 1769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:58.614153 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.615775 (+ 1622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.615790 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:58.616222 (+ 432us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:58.617251 (+ 1029us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:15:58.617291 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:15:58.620330 (+ 3039us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:15:58.624142 (+ 3812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:58.624151 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:58.624166 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:58.624728 (+ 562us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:58.625225 (+ 497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:15:58.625229 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:15:58.625232 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:15:58.625450 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:15:58.626115 (+ 665us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:15:58.626123 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:15:58.626514 (+ 391us) client_negotiation.cc:769] Sending connection context
0806 09:15:58.626804 (+ 290us) client_negotiation.cc:240] Negotiation successful
0806 09:15:58.627281 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":354,"threads_started":1}
I20260806 09:15:58.630527 22249 heartbeater.cc:347] Connected to a master server at 127.10.255.126:42271
I20260806 09:15:58.630869 22249 heartbeater.cc:464] Registering TS with master...
I20260806 09:15:58.631740 22249 heartbeater.cc:511] Master 127.10.255.126:42271 requested a full tablet report, sending...
I20260806 09:15:58.633541 21785 ts_manager.cc:194] Registered new tserver with Master: eb04957bdf2246f9908e911e170c4dd9 (127.10.255.67:36895)
I20260806 09:15:58.634915 21785 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.67@KRBTEST.COM'} at 127.10.255.67:38219
I20260806 09:15:58.644307 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 09:15:58.665733 22251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:58.649628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36738 (local address 127.10.255.126:42271)
0806 09:15:58.649926 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:58.649933 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:58.650293 (+ 360us) server_negotiation.cc:407] Connection header received
0806 09:15:58.650425 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:58.650430 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:58.650587 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:58.650689 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:58.653055 (+ 2366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.653949 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.655378 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.656041 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.656222 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:58.659238 (+ 3016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:58.659246 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:58.659252 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:58.659310 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:58.662650 (+ 3340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:58.663509 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:58.663513 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:58.663516 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:58.663711 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:58.664248 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:58.664251 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:58.664253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:58.664625 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:58.664822 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:58.665192 (+ 370us) server_negotiation.cc:299] Negotiation successful
0806 09:15:58.665398 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260806 09:15:58.670619 21785 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36738:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:15:58.678279 21785 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:15:58.711202 22264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:58.692869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:37381 (local address 127.0.0.1:38544)
0806 09:15:58.694697 (+ 1828us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:58.694774 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:58.695038 (+ 264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:58.697293 (+ 2255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:58.697301 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:58.697342 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:58.697984 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:58.698005 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.701147 (+ 3142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.701158 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:58.705293 (+ 4135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:58.705329 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.709233 (+ 3904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.709248 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:58.709669 (+ 421us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:58.709767 (+ 98us) client_negotiation.cc:769] Sending connection context
0806 09:15:58.709994 (+ 227us) client_negotiation.cc:240] Negotiation successful
0806 09:15:58.710382 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1433,"thread_start_us":3211,"threads_started":1}
I20260806 09:15:58.713135 22263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:58.693162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38544 (local address 127.10.255.66:37381)
0806 09:15:58.695987 (+ 2825us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:58.696001 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:58.696037 (+ 36us) server_negotiation.cc:407] Connection header received
0806 09:15:58.696166 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:58.696178 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:58.696666 (+ 488us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:58.696946 (+ 280us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:58.698320 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.700890 (+ 2570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.705735 (+ 4845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.708353 (+ 2618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.708615 (+ 262us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:58.708960 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:58.712557 (+ 3597us) server_negotiation.cc:299] Negotiation successful
0806 09:15:58.712794 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2586,"thread_start_us":2471,"threads_started":1}
I20260806 09:15:58.722959 22264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:58.696989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:36589 (local address 127.0.0.1:44898)
0806 09:15:58.712071 (+ 15082us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:58.712104 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:58.712293 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:58.713515 (+ 1222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:58.713521 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:58.713558 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:58.713790 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:58.713806 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.715982 (+ 2176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.715990 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:58.718002 (+ 2012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:58.718033 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.721874 (+ 3841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.721883 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:58.722198 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:58.722250 (+ 52us) client_negotiation.cc:769] Sending connection context
0806 09:15:58.722401 (+ 151us) client_negotiation.cc:240] Negotiation successful
0806 09:15:58.722611 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14805,"thread_start_us":17787,"threads_started":1}
I20260806 09:15:58.722560 22046 tablet_service.cc:1467] Processing CreateTablet for tablet 57774b2548b842cd9f883674e7dc467c (DEFAULT_TABLE table=test-table [id=dd264e9801514dbfbc3e4d536b01a7ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:15:58.724768 22267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:58.697127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44898 (local address 127.10.255.65:36589)
0806 09:15:58.712717 (+ 15590us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:58.712728 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:58.712760 (+ 32us) server_negotiation.cc:407] Connection header received
0806 09:15:58.712883 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:58.712893 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:58.713219 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:58.713478 (+ 259us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:58.714056 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.715740 (+ 1684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.718292 (+ 2552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.721554 (+ 3262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.723576 (+ 2022us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:58.724085 (+ 509us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:58.724205 (+ 120us) server_negotiation.cc:299] Negotiation successful
0806 09:15:58.724426 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15375,"thread_start_us":16585,"threads_started":1}
I20260806 09:15:58.725132 22046 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57774b2548b842cd9f883674e7dc467c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:58.725478 22262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:58.693614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:36895 (local address 127.0.0.1:45192)
0806 09:15:58.696405 (+ 2791us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:58.696428 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:58.696573 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:58.715311 (+ 18738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:58.715317 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:58.715348 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:58.715862 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:58.715884 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.718340 (+ 2456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.718348 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:58.721446 (+ 3098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:58.721476 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.724411 (+ 2935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.724421 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:58.724779 (+ 358us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:58.724817 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 09:15:58.724936 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 09:15:58.725109 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2636,"thread_start_us":1245,"threads_started":1}
I20260806 09:15:58.725883 22265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:58.694450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45192 (local address 127.10.255.67:36895)
0806 09:15:58.713278 (+ 18828us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:58.713291 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:58.713340 (+ 49us) server_negotiation.cc:407] Connection header received
0806 09:15:58.713473 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:58.713485 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:58.714400 (+ 915us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:58.716108 (+ 1708us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:58.716435 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.718122 (+ 1687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.721808 (+ 3686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.724120 (+ 2312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.724289 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:58.724513 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:58.725317 (+ 804us) server_negotiation.cc:299] Negotiation successful
0806 09:15:58.725501 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18490,"thread_start_us":19976,"threads_started":1}
I20260806 09:15:58.729480 21911 tablet_service.cc:1467] Processing CreateTablet for tablet 57774b2548b842cd9f883674e7dc467c (DEFAULT_TABLE table=test-table [id=dd264e9801514dbfbc3e4d536b01a7ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:15:58.731456 21911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57774b2548b842cd9f883674e7dc467c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:58.730429 22182 tablet_service.cc:1467] Processing CreateTablet for tablet 57774b2548b842cd9f883674e7dc467c (DEFAULT_TABLE table=test-table [id=dd264e9801514dbfbc3e4d536b01a7ab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:15:58.732728 22182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57774b2548b842cd9f883674e7dc467c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:15:58.740877 22268 tablet_bootstrap.cc:492] T 57774b2548b842cd9f883674e7dc467c P a7b3f45a0ed340a6a2137ae09e3ce17c: Bootstrap starting.
I20260806 09:15:58.744539 22268 tablet_bootstrap.cc:654] T 57774b2548b842cd9f883674e7dc467c P a7b3f45a0ed340a6a2137ae09e3ce17c: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:58.745868 22268 log.cc:824] T 57774b2548b842cd9f883674e7dc467c P a7b3f45a0ed340a6a2137ae09e3ce17c: Log is configured to *not* fsync() on all Append() calls
I20260806 09:15:58.749104 22270 tablet_bootstrap.cc:492] T 57774b2548b842cd9f883674e7dc467c P f0d38fbd3fe04853ac2d67021921fd9f: Bootstrap starting.
I20260806 09:15:58.749742 22268 tablet_bootstrap.cc:492] T 57774b2548b842cd9f883674e7dc467c P a7b3f45a0ed340a6a2137ae09e3ce17c: No bootstrap required, opened a new log
I20260806 09:15:58.750172 22268 ts_tablet_manager.cc:1397] T 57774b2548b842cd9f883674e7dc467c P a7b3f45a0ed340a6a2137ae09e3ce17c: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.006s
I20260806 09:15:58.751560 22271 tablet_bootstrap.cc:492] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9: Bootstrap starting.
I20260806 09:15:58.754937 22271 tablet_bootstrap.cc:654] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:58.755111 22270 tablet_bootstrap.cc:654] T 57774b2548b842cd9f883674e7dc467c P f0d38fbd3fe04853ac2d67021921fd9f: Neither blocks nor log segments found. Creating new log.
I20260806 09:15:58.756304 22271 log.cc:824] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9: Log is configured to *not* fsync() on all Append() calls
I20260806 09:15:58.756508 22270 log.cc:824] T 57774b2548b842cd9f883674e7dc467c P f0d38fbd3fe04853ac2d67021921fd9f: Log is configured to *not* fsync() on all Append() calls
I20260806 09:15:58.760092 22270 tablet_bootstrap.cc:492] T 57774b2548b842cd9f883674e7dc467c P f0d38fbd3fe04853ac2d67021921fd9f: No bootstrap required, opened a new log
I20260806 09:15:58.760182 22271 tablet_bootstrap.cc:492] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9: No bootstrap required, opened a new log
I20260806 09:15:58.760464 22270 ts_tablet_manager.cc:1397] T 57774b2548b842cd9f883674e7dc467c P f0d38fbd3fe04853ac2d67021921fd9f: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.000s
I20260806 09:15:58.760476 22271 ts_tablet_manager.cc:1397] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260806 09:15:58.762084 22268 raft_consensus.cc:348] T 57774b2548b842cd9f883674e7dc467c P a7b3f45a0ed340a6a2137ae09e3ce17c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b3f45a0ed340a6a2137ae09e3ce17c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37381 } } peers { permanent_uuid: "f0d38fbd3fe04853ac2d67021921fd9f" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 36589 } } peers { permanent_uuid: "eb04957bdf2246f9908e911e170c4dd9" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 36895 } }
I20260806 09:15:58.762614 22268 raft_consensus.cc:374] T 57774b2548b842cd9f883674e7dc467c P a7b3f45a0ed340a6a2137ae09e3ce17c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:58.762754 22268 raft_consensus.cc:729] T 57774b2548b842cd9f883674e7dc467c P a7b3f45a0ed340a6a2137ae09e3ce17c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7b3f45a0ed340a6a2137ae09e3ce17c, State: Initialized, Role: FOLLOWER
I20260806 09:15:58.763507 22268 consensus_queue.cc:260] T 57774b2548b842cd9f883674e7dc467c P a7b3f45a0ed340a6a2137ae09e3ce17c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b3f45a0ed340a6a2137ae09e3ce17c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37381 } } peers { permanent_uuid: "f0d38fbd3fe04853ac2d67021921fd9f" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 36589 } } peers { permanent_uuid: "eb04957bdf2246f9908e911e170c4dd9" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 36895 } }
I20260806 09:15:58.764863 22111 heartbeater.cc:503] Master 127.10.255.126:42271 was elected leader, sending a full tablet report...
I20260806 09:15:58.765686 22268 ts_tablet_manager.cc:1428] T 57774b2548b842cd9f883674e7dc467c P a7b3f45a0ed340a6a2137ae09e3ce17c: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260806 09:15:58.769917 22270 raft_consensus.cc:348] T 57774b2548b842cd9f883674e7dc467c P f0d38fbd3fe04853ac2d67021921fd9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b3f45a0ed340a6a2137ae09e3ce17c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37381 } } peers { permanent_uuid: "f0d38fbd3fe04853ac2d67021921fd9f" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 36589 } } peers { permanent_uuid: "eb04957bdf2246f9908e911e170c4dd9" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 36895 } }
I20260806 09:15:58.770486 22270 raft_consensus.cc:374] T 57774b2548b842cd9f883674e7dc467c P f0d38fbd3fe04853ac2d67021921fd9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:58.770606 22270 raft_consensus.cc:729] T 57774b2548b842cd9f883674e7dc467c P f0d38fbd3fe04853ac2d67021921fd9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0d38fbd3fe04853ac2d67021921fd9f, State: Initialized, Role: FOLLOWER
I20260806 09:15:58.771353 22270 consensus_queue.cc:260] T 57774b2548b842cd9f883674e7dc467c P f0d38fbd3fe04853ac2d67021921fd9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b3f45a0ed340a6a2137ae09e3ce17c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37381 } } peers { permanent_uuid: "f0d38fbd3fe04853ac2d67021921fd9f" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 36589 } } peers { permanent_uuid: "eb04957bdf2246f9908e911e170c4dd9" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 36895 } }
I20260806 09:15:58.773101 22271 raft_consensus.cc:348] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b3f45a0ed340a6a2137ae09e3ce17c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37381 } } peers { permanent_uuid: "f0d38fbd3fe04853ac2d67021921fd9f" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 36589 } } peers { permanent_uuid: "eb04957bdf2246f9908e911e170c4dd9" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 36895 } }
I20260806 09:15:58.773495 22270 ts_tablet_manager.cc:1428] T 57774b2548b842cd9f883674e7dc467c P f0d38fbd3fe04853ac2d67021921fd9f: Time spent starting tablet: real 0.013s user 0.004s sys 0.008s
I20260806 09:15:58.773615 22271 raft_consensus.cc:374] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:15:58.773732 22271 raft_consensus.cc:729] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb04957bdf2246f9908e911e170c4dd9, State: Initialized, Role: FOLLOWER
I20260806 09:15:58.774330 22271 consensus_queue.cc:260] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b3f45a0ed340a6a2137ae09e3ce17c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37381 } } peers { permanent_uuid: "f0d38fbd3fe04853ac2d67021921fd9f" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 36589 } } peers { permanent_uuid: "eb04957bdf2246f9908e911e170c4dd9" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 36895 } }
I20260806 09:15:58.775566 22249 heartbeater.cc:503] Master 127.10.255.126:42271 was elected leader, sending a full tablet report...
I20260806 09:15:58.776273 22271 ts_tablet_manager.cc:1428] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9: Time spent starting tablet: real 0.016s user 0.014s sys 0.000s
W20260806 09:15:58.851130 22250 tablet.cc:2369] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 09:15:58.860785 21978 tablet.cc:2369] T 57774b2548b842cd9f883674e7dc467c P f0d38fbd3fe04853ac2d67021921fd9f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:15:58.982393 22276 raft_consensus.cc:482] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:15:58.982808 22276 raft_consensus.cc:504] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b3f45a0ed340a6a2137ae09e3ce17c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37381 } } peers { permanent_uuid: "f0d38fbd3fe04853ac2d67021921fd9f" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 36589 } } peers { permanent_uuid: "eb04957bdf2246f9908e911e170c4dd9" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 36895 } }
I20260806 09:15:58.984850 22276 leader_election.cc:288] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7b3f45a0ed340a6a2137ae09e3ce17c (127.10.255.66:37381), f0d38fbd3fe04853ac2d67021921fd9f (127.10.255.65:36589)
I20260806 09:15:58.992913 22263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:58.985307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:46549 (local address 127.10.255.66:37381)
0806 09:15:58.985539 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:58.985546 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:58.985569 (+ 23us) server_negotiation.cc:407] Connection header received
0806 09:15:58.985662 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:58.985668 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:58.985762 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:58.985868 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:58.986689 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.987862 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.990389 (+ 2527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.991964 (+ 1575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.992158 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:58.992245 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:58.992530 (+ 285us) server_negotiation.cc:299] Negotiation successful
0806 09:15:58.992670 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 09:15:58.992995 22252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:58.985114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:37381 (local address 127.10.255.67:46549)
0806 09:15:58.985325 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:58.985343 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:58.985535 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:58.986128 (+ 593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:58.986133 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:58.986162 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:58.986399 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:58.986414 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.988027 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.988032 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:58.990047 (+ 2015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:58.990065 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.992164 (+ 2099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.992169 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:58.992320 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:58.992346 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 09:15:58.992479 (+ 133us) client_negotiation.cc:240] Negotiation successful
0806 09:15:58.992657 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":30}
I20260806 09:15:58.993306 22267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:58.985771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:51255 (local address 127.10.255.65:36589)
0806 09:15:58.986021 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:58.986027 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:58.986456 (+ 429us) server_negotiation.cc:407] Connection header received
0806 09:15:58.986684 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:58.986690 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:58.986784 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:58.986902 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:15:58.987442 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.988434 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.990875 (+ 2441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.992328 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.992491 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:58.992563 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:58.992909 (+ 346us) server_negotiation.cc:299] Negotiation successful
0806 09:15:58.993059 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260806 09:15:58.993983 22277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:58.985547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:36589 (local address 127.10.255.67:51255)
0806 09:15:58.986282 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0806 09:15:58.986302 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 09:15:58.986431 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:15:58.986934 (+ 503us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:15:58.986938 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:15:58.986960 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:15:58.987276 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:58.987284 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.988607 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.988613 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:58.990626 (+ 2013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:15:58.990640 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:15:58.992558 (+ 1918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:15:58.992564 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:15:58.992725 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:58.992757 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 09:15:58.992860 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 09:15:58.993358 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"mutex_wait_us":1,"thread_start_us":373,"threads_started":1}
I20260806 09:15:58.994410 22066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57774b2548b842cd9f883674e7dc467c" candidate_uuid: "eb04957bdf2246f9908e911e170c4dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7b3f45a0ed340a6a2137ae09e3ce17c" is_pre_election: true
I20260806 09:15:58.995132 22066 raft_consensus.cc:2454] T 57774b2548b842cd9f883674e7dc467c P a7b3f45a0ed340a6a2137ae09e3ce17c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb04957bdf2246f9908e911e170c4dd9 in term 0.
I20260806 09:15:58.995226 21931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57774b2548b842cd9f883674e7dc467c" candidate_uuid: "eb04957bdf2246f9908e911e170c4dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0d38fbd3fe04853ac2d67021921fd9f" is_pre_election: true
I20260806 09:15:58.995790 21931 raft_consensus.cc:2454] T 57774b2548b842cd9f883674e7dc467c P f0d38fbd3fe04853ac2d67021921fd9f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb04957bdf2246f9908e911e170c4dd9 in term 0.
I20260806 09:15:58.996069 22137 leader_election.cc:302] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a7b3f45a0ed340a6a2137ae09e3ce17c, eb04957bdf2246f9908e911e170c4dd9; no voters:
I20260806 09:15:58.996578 22276 raft_consensus.cc:2781] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:15:58.996758 22276 raft_consensus.cc:482] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:15:58.996863 22276 raft_consensus.cc:3037] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9 [term 0 FOLLOWER]: Advancing to term 1
W20260806 09:15:58.998142 22112 tablet.cc:2369] T 57774b2548b842cd9f883674e7dc467c P a7b3f45a0ed340a6a2137ae09e3ce17c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:15:59.000274 22276 raft_consensus.cc:504] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b3f45a0ed340a6a2137ae09e3ce17c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37381 } } peers { permanent_uuid: "f0d38fbd3fe04853ac2d67021921fd9f" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 36589 } } peers { permanent_uuid: "eb04957bdf2246f9908e911e170c4dd9" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 36895 } }
I20260806 09:15:59.001192 22276 leader_election.cc:288] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9 [CANDIDATE]: Term 1 election: Requested vote from peers a7b3f45a0ed340a6a2137ae09e3ce17c (127.10.255.66:37381), f0d38fbd3fe04853ac2d67021921fd9f (127.10.255.65:36589)
I20260806 09:15:59.001880 22066 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57774b2548b842cd9f883674e7dc467c" candidate_uuid: "eb04957bdf2246f9908e911e170c4dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7b3f45a0ed340a6a2137ae09e3ce17c"
I20260806 09:15:59.002097 21931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "57774b2548b842cd9f883674e7dc467c" candidate_uuid: "eb04957bdf2246f9908e911e170c4dd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0d38fbd3fe04853ac2d67021921fd9f"
I20260806 09:15:59.002162 22066 raft_consensus.cc:3037] T 57774b2548b842cd9f883674e7dc467c P a7b3f45a0ed340a6a2137ae09e3ce17c [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:59.002382 21931 raft_consensus.cc:3037] T 57774b2548b842cd9f883674e7dc467c P f0d38fbd3fe04853ac2d67021921fd9f [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:15:59.006978 22066 raft_consensus.cc:2454] T 57774b2548b842cd9f883674e7dc467c P a7b3f45a0ed340a6a2137ae09e3ce17c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb04957bdf2246f9908e911e170c4dd9 in term 1.
I20260806 09:15:59.006973 21931 raft_consensus.cc:2454] T 57774b2548b842cd9f883674e7dc467c P f0d38fbd3fe04853ac2d67021921fd9f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb04957bdf2246f9908e911e170c4dd9 in term 1.
I20260806 09:15:59.007613 22137 leader_election.cc:302] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eb04957bdf2246f9908e911e170c4dd9, f0d38fbd3fe04853ac2d67021921fd9f; no voters:
I20260806 09:15:59.008059 22276 raft_consensus.cc:2781] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:15:59.008975 22276 raft_consensus.cc:686] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9 [term 1 LEADER]: Becoming Leader. State: Replica: eb04957bdf2246f9908e911e170c4dd9, State: Running, Role: LEADER
I20260806 09:15:59.009667 22276 consensus_queue.cc:237] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b3f45a0ed340a6a2137ae09e3ce17c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37381 } } peers { permanent_uuid: "f0d38fbd3fe04853ac2d67021921fd9f" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 36589 } } peers { permanent_uuid: "eb04957bdf2246f9908e911e170c4dd9" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 36895 } }
I20260806 09:15:59.016029 21786 catalog_manager.cc:5495] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb04957bdf2246f9908e911e170c4dd9 (127.10.255.67). New cstate: current_term: 1 leader_uuid: "eb04957bdf2246f9908e911e170c4dd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7b3f45a0ed340a6a2137ae09e3ce17c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37381 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0d38fbd3fe04853ac2d67021921fd9f" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 36589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb04957bdf2246f9908e911e170c4dd9" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 36895 } health_report { overall_health: HEALTHY } } }
I20260806 09:15:59.085043 22265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:59.078890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45202 (local address 127.10.255.67:36895)
0806 09:15:59.079084 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:59.079091 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:59.079134 (+ 43us) server_negotiation.cc:407] Connection header received
0806 09:15:59.079423 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:59.079427 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:59.079514 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:59.079692 (+ 178us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:15:59.080139 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:59.081063 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:59.082565 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:59.083009 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:59.083172 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:59.083741 (+ 569us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:15:59.084398 (+ 657us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:15:59.084591 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:59.084653 (+ 62us) server_negotiation.cc:299] Negotiation successful
0806 09:15:59.084749 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260806 09:15:59.094213 21931 raft_consensus.cc:1261] T 57774b2548b842cd9f883674e7dc467c P f0d38fbd3fe04853ac2d67021921fd9f [term 1 FOLLOWER]: Refusing update from remote peer eb04957bdf2246f9908e911e170c4dd9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:15:59.094214 22066 raft_consensus.cc:1261] T 57774b2548b842cd9f883674e7dc467c P a7b3f45a0ed340a6a2137ae09e3ce17c [term 1 FOLLOWER]: Refusing update from remote peer eb04957bdf2246f9908e911e170c4dd9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:15:59.095551 22276 consensus_queue.cc:1035] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a7b3f45a0ed340a6a2137ae09e3ce17c" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 37381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:15:59.095928 22278 consensus_queue.cc:1035] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0d38fbd3fe04853ac2d67021921fd9f" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 36589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:15:59.110507 22282 mvcc.cc:205] Tried to move back new op lower bound from 7315487781238054912 to 7315487780910268416. Current Snapshot: MvccSnapshot[applied={T|T < 7315487781238054912}]
I20260806 09:15:59.129280 21786 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36738:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:15:59.129660 21786 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36738:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:15:59.136118 21786 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7b50881a63ff422fa5fb538352b219ca: Sending DeleteTablet for 3 replicas of tablet 57774b2548b842cd9f883674e7dc467c
I20260806 09:15:59.137632 22046 tablet_service.cc:1514] Processing DeleteTablet for tablet 57774b2548b842cd9f883674e7dc467c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:15:59 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:38544
I20260806 09:15:59.137647 22182 tablet_service.cc:1514] Processing DeleteTablet for tablet 57774b2548b842cd9f883674e7dc467c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:15:59 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:45192
I20260806 09:15:59.137679 21911 tablet_service.cc:1514] Processing DeleteTablet for tablet 57774b2548b842cd9f883674e7dc467c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:15:59 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:44898
I20260806 09:15:59.140555 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 21848
I20260806 09:15:59.149220 22293 tablet_replica.cc:330] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9: stopping tablet replica
I20260806 09:15:59.150151 22293 raft_consensus.cc:2229] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9 [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:15:59.151528 22293 raft_consensus.cc:2258] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:15:59.155385 22293 ts_tablet_manager.cc:1905] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:15:59.157274 22291 tablet_replica.cc:330] T 57774b2548b842cd9f883674e7dc467c P a7b3f45a0ed340a6a2137ae09e3ce17c: stopping tablet replica
I20260806 09:15:59.157811 22291 raft_consensus.cc:2229] T 57774b2548b842cd9f883674e7dc467c P a7b3f45a0ed340a6a2137ae09e3ce17c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:15:59.156599 22292 tablet_replica.cc:330] T 57774b2548b842cd9f883674e7dc467c P f0d38fbd3fe04853ac2d67021921fd9f: stopping tablet replica
I20260806 09:15:59.158401 22291 raft_consensus.cc:2258] T 57774b2548b842cd9f883674e7dc467c P a7b3f45a0ed340a6a2137ae09e3ce17c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:15:59.158710 22292 raft_consensus.cc:2229] T 57774b2548b842cd9f883674e7dc467c P f0d38fbd3fe04853ac2d67021921fd9f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:15:59.159338 22292 raft_consensus.cc:2258] T 57774b2548b842cd9f883674e7dc467c P f0d38fbd3fe04853ac2d67021921fd9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:15:59.162097 22292 ts_tablet_manager.cc:1905] T 57774b2548b842cd9f883674e7dc467c P f0d38fbd3fe04853ac2d67021921fd9f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:15:59.163054 22291 ts_tablet_manager.cc:1905] T 57774b2548b842cd9f883674e7dc467c P a7b3f45a0ed340a6a2137ae09e3ce17c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:15:59.166996 22293 ts_tablet_manager.cc:1918] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:15:59.167296 22293 log.cc:1196] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/57774b2548b842cd9f883674e7dc467c
I20260806 09:15:59.167996 22293 ts_tablet_manager.cc:1939] T 57774b2548b842cd9f883674e7dc467c P eb04957bdf2246f9908e911e170c4dd9: Deleting consensus metadata
I20260806 09:15:59.170328 21770 catalog_manager.cc:4841] TS eb04957bdf2246f9908e911e170c4dd9 (127.10.255.67:36895): tablet 57774b2548b842cd9f883674e7dc467c (table test-table [id=dd264e9801514dbfbc3e4d536b01a7ab]) successfully deleted
I20260806 09:15:59.171798 22292 ts_tablet_manager.cc:1918] T 57774b2548b842cd9f883674e7dc467c P f0d38fbd3fe04853ac2d67021921fd9f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:15:59.172180 22292 log.cc:1196] T 57774b2548b842cd9f883674e7dc467c P f0d38fbd3fe04853ac2d67021921fd9f: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-0/wal/wals/57774b2548b842cd9f883674e7dc467c
I20260806 09:15:59.172906 22292 ts_tablet_manager.cc:1939] T 57774b2548b842cd9f883674e7dc467c P f0d38fbd3fe04853ac2d67021921fd9f: Deleting consensus metadata
Aug 06 09:15:59 dist-test-slave-mvvj krb5kdc[21741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007756, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.65@KRBTEST.COM
I20260806 09:15:59.174902 22291 ts_tablet_manager.cc:1918] T 57774b2548b842cd9f883674e7dc467c P a7b3f45a0ed340a6a2137ae09e3ce17c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:15:59.175134 22291 log.cc:1196] T 57774b2548b842cd9f883674e7dc467c P a7b3f45a0ed340a6a2137ae09e3ce17c: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/57774b2548b842cd9f883674e7dc467c
I20260806 09:15:59.175700 22291 ts_tablet_manager.cc:1939] T 57774b2548b842cd9f883674e7dc467c P a7b3f45a0ed340a6a2137ae09e3ce17c: Deleting consensus metadata
I20260806 09:15:59.176405 21773 catalog_manager.cc:4841] TS f0d38fbd3fe04853ac2d67021921fd9f (127.10.255.65:36589): tablet 57774b2548b842cd9f883674e7dc467c (table test-table [id=dd264e9801514dbfbc3e4d536b01a7ab]) successfully deleted
I20260806 09:15:59.177644 21773 catalog_manager.cc:4841] TS a7b3f45a0ed340a6a2137ae09e3ce17c (127.10.255.66:37381): tablet 57774b2548b842cd9f883674e7dc467c (table test-table [id=dd264e9801514dbfbc3e4d536b01a7ab]) successfully deleted
I20260806 09:15:59.183979 22267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:59.142270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44912 (local address 127.10.255.65:36589)
0806 09:15:59.142475 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:59.142483 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:59.146287 (+ 3804us) server_negotiation.cc:407] Connection header received
0806 09:15:59.146651 (+ 364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:59.146657 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:59.146760 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:59.146881 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:59.156325 (+ 9444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:59.157734 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:59.168061 (+ 10327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:59.168837 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:59.168987 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:59.175244 (+ 6257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:59.175259 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:59.175280 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:59.175330 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:59.179868 (+ 4538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:59.181076 (+ 1208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:59.181114 (+ 38us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:59.181117 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:59.181328 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:59.181824 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:59.181830 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:59.181834 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:59.182351 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:59.182704 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:59.183191 (+ 487us) server_negotiation.cc:299] Negotiation successful
0806 09:15:59.183465 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 09:15:59.184881 21972 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:59.281836 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 21848
I20260806 09:15:59.301734 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 21983
Aug 06 09:15:59 dist-test-slave-mvvj krb5kdc[21741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007756, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.66@KRBTEST.COM
I20260806 09:15:59.323315 22263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:59.302724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38558 (local address 127.10.255.66:37381)
0806 09:15:59.302958 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:59.302965 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:59.303000 (+ 35us) server_negotiation.cc:407] Connection header received
0806 09:15:59.303080 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:59.303086 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:59.303177 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:59.303306 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:59.304927 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:59.306294 (+ 1367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:59.308292 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:59.309033 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:59.309192 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:59.314340 (+ 5148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:59.314367 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:59.314393 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:59.314472 (+ 79us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:59.319000 (+ 4528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:59.320276 (+ 1276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:59.320288 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:59.320293 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:59.320499 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:59.321170 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:59.321177 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:59.321182 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:59.321791 (+ 609us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:59.322135 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:59.322623 (+ 488us) server_negotiation.cc:299] Negotiation successful
0806 09:15:59.322898 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 09:15:59.324244 22106 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:59.444875 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 21983
I20260806 09:15:59.467401 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 22117
Aug 06 09:15:59 dist-test-slave-mvvj krb5kdc[21741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007756, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.67@KRBTEST.COM
I20260806 09:15:59.488680 22265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:15:59.468466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45214 (local address 127.10.255.67:36895)
0806 09:15:59.468660 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0806 09:15:59.468664 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:15:59.468689 (+ 25us) server_negotiation.cc:407] Connection header received
0806 09:15:59.468912 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:15:59.468916 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:15:59.468995 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:15:59.469110 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:15:59.471040 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:59.472229 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:59.474397 (+ 2168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:15:59.474917 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:15:59.475036 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:15:59.481487 (+ 6451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:15:59.481562 (+ 75us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:15:59.481583 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:15:59.481639 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:15:59.485261 (+ 3622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:59.486210 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:59.486219 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:59.486222 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:59.486411 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:15:59.486861 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:15:59.486867 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:15:59.486880 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:15:59.487301 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:15:59.487695 (+ 394us) server_negotiation.cc:1035] Waiting for connection context
0806 09:15:59.488018 (+ 323us) server_negotiation.cc:299] Negotiation successful
0806 09:15:59.488281 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 09:15:59.489449 22244 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:59.621848 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 22117
I20260806 09:15:59.649677 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 21754
I20260806 09:15:59.650969 21817 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:15:59.769132 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 21754
2026-08-06T09:15:59Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (5058 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:15:59 dist-test-slave-mvvj krb5kdc[22301](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:15:59 dist-test-slave-mvvj krb5kdc[22301](info): set up 2 sockets
Aug 06 09:15:59 dist-test-slave-mvvj krb5kdc[22301](info): commencing operation
krb5kdc: starting...
W20260806 09:16:00.924199 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.002s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:16:01 dist-test-slave-mvvj krb5kdc[22301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007761, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:16:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:16:01Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.10.255.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.10.255.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.10.255.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/rangeradmin_127.10.255.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.10.255.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/rangeradmin_127.10.255.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.10.255.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.10.255.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.10.255.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/rangerlookup_127.10.255.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.10.255.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/rangerlookup_127.10.255.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.255.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.10.255.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.255.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/HTTP_127.10.255.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.255.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/HTTP_127.10.255.84@KRBTEST.COM.keytab.
I20260806 09:16:01.336555 11261 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task5qcP_A/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/postgres -l logfile start
2026-08-06 09:16:04.804 UTC [22332] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 09:16:04.804 UTC [22332] LOG: listening on IPv4 address "127.10.255.84", port 57203
2026-08-06 09:16:04.814 UTC [22332] LOG: listening on Unix socket "/tmp/.s.PGSQL.57203"
2026-08-06 09:16:04.846 UTC [22335] LOG: database system was shut down at 2026-08-06 09:16:02 UTC
2026-08-06 09:16:04.854 UTC [22332] LOG: database system is ready to accept connections
I20260806 09:16:05.879276 11261 mini_postgres.cc:96] Postgres bound to 57203
2026-08-06 09:16:05.902 UTC [22343] FATAL: database "slave" does not exist
127.10.255.84:57203 - accepting connections
I20260806 09:16:05.903774 11261 mini_ranger.cc:161] Starting Ranger...
I20260806 09:16:05.937641 11261 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 09:16:06.656793 11261 mini_ranger.cc:87] Created ranger Postgres database
I20260806 09:16:06.656955 11261 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ranger-admin
2026-08-06 09:16:07,013 [I] DB FLAVOR :POSTGRES
2026-08-06 09:16:07,014 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 09:16:07,014 [I] Checking connection..
2026-08-06 09:16:07,014 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:57203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 09:16:07,300 [I] Checking connection passed.
2026-08-06 09:16:07,300 [I] --------- Verifying version history table ---------
2026-08-06 09:16:07,300 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:57203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 09:16:07,589 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 09:16:07,589 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:57203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 09:16:07,902 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 09:16:07,902 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 09:16:07,903 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:57203/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 09:16:08.182 UTC [22407] WARNING: there is no transaction in progress
2026-08-06 09:16:08,190 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 09:16:08,190 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:57203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 09:16:08,469 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 09:16:08,469 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 09:16:08,470 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:57203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 09:16:08,763 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:57203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 09:16:09,039 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:57203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-mvvj.c.gcp-upstream.internal','N') ;"
2026-08-06 09:16:09,291 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:57203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 09:16:09,562 [I] Table x_portal_user does not exist in database ranger
2026-08-06 09:16:09,562 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:57203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 09:16:09,832 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 09:16:09,832 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:57203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 09:16:10,113 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:57203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 09:16:10,367 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 09:16:10,368 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:57203/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 09:16:11.630 UTC [22516] WARNING: there is no transaction in progress
2026-08-06 09:16:11.651 UTC [22516] WARNING: there is no transaction in progress
2026-08-06 09:16:11.674 UTC [22516] WARNING: there is no transaction in progress
2026-08-06 09:16:11.696 UTC [22516] WARNING: there is no transaction in progress
2026-08-06 09:16:11.720 UTC [22516] WARNING: there is no transaction in progress
2026-08-06 09:16:11.747 UTC [22516] WARNING: there is no transaction in progress
2026-08-06 09:16:11.831 UTC [22516] WARNING: there is no transaction in progress
2026-08-06 09:16:11.841 UTC [22516] WARNING: there is no transaction in progress
2026-08-06 09:16:11.863 UTC [22516] WARNING: there is no transaction in progress
2026-08-06 09:16:11.877 UTC [22516] WARNING: there is no transaction in progress
2026-08-06 09:16:11.891 UTC [22516] WARNING: there is no transaction in progress
2026-08-06 09:16:11.909 UTC [22516] WARNING: there is no transaction in progress
2026-08-06 09:16:11.923 UTC [22516] WARNING: there is no transaction in progress
2026-08-06 09:16:11.933 UTC [22516] WARNING: there is no transaction in progress
2026-08-06 09:16:11.947 UTC [22516] WARNING: there is no transaction in progress
2026-08-06 09:16:11.957 UTC [22516] WARNING: there is no transaction in progress
2026-08-06 09:16:12,978 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 09:16:12,979 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:57203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 09:16:13,240 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 09:16:13,241 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:57203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 09:16:13,532 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 09:16:13,533 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:57203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 09:16:13,796 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 09:16:13,796 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:57203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 09:16:14,089 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:57203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 09:16:14,366 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:57203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-mvvj.c.gcp-upstream.internal';"
2026-08-06 09:16:14,633 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 09:16:14,633 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:57203/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 09:16:14,915 [I] DB_PATCHES have already been applied
I20260806 09:16:14.921828 11261 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ranger-admin:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task5qcP_A/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 09:16:14.921969 11261 mini_ranger.cc:193] Using host: 127.10.255.84
I20260806 09:16:14.940585 11261 mini_ranger.cc:227] Ranger admin URL: http://127.10.255.84:40815
Aug 06, 2026 9:16:15 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 9:16:15 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 9:16:15 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 9:16:15 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 9:16:15 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 9:16:15 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 9:16:15 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 09:16:16.149765 11261 mini_ranger.cc:160] Time spent starting Ranger: real 10.246s user 0.000s sys 0.049s
Aug 06, 2026 9:16:40 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 9:16:40 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 06, 2026 9:16:40 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 9:16:40 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 9:16:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 9:16:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 9:16:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 9:16:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 9:16:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 9:16:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 9:16:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 9:16:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 9:16:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 9:16:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 9:16:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 9:16:40 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 9:16:40 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 9:16:41 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 09:16:42.282891 11261 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.10.255.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.10.255.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.10.255.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/rangerkms_127.10.255.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.10.255.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/rangerkms_127.10.255.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.255.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.10.255.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.255.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/HTTP_127.10.255.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.255.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/HTTP_127.10.255.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 09:16:42 dist-test-slave-mvvj krb5kdc[22301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007802, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 09:16:42.499203 11261 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 09:16:42.530882 11261 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 09:16:43.526743 11261 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 09:16:43.526927 11261 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ranger-kms
I20260806 09:16:43.527065 11261 mini_ranger_kms.cc:227] Using postgres at 127.10.255.84:57203
2026-08-06 09:16:44,622 [I] DB FLAVOR :POSTGRES
2026-08-06 09:16:44,622 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 09:16:44,622 [I] Checking connection
2026-08-06 09:16:44,622 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:57203/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 09:16:44,911 [I] connection success
2026-08-06 09:16:44,911 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 09:16:44,911 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 09:16:44,911 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:57203/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 09:16:45,165 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 09:16:45,166 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 09:16:45,166 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 09:16:45,166 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:57203/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 09:16:45,442 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 09:16:46.034994 11261 mini_ranger_kms.cc:310] Created kms service
I20260806 09:16:46.265151 11261 mini_ranger_kms.cc:326] Created kudu user
I20260806 09:16:46.321214 11261 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 09:16:46 dist-test-slave-mvvj krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007802, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.10.255.84@KRBTEST.COM
I20260806 09:16:46.752854 11261 mini_ranger_kms.cc:384] Added ranger policy
I20260806 09:16:46.754573 11261 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ranger-kms:/tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 09:16:46.754654 11261 mini_ranger_kms.cc:240] Using host: 127.10.255.84
I20260806 09:16:46.779459 11261 mini_ranger_kms.cc:276] Ranger KMS PID: 22698
I20260806 09:16:46.779677 11261 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.10.255.84:42211
Aug 06, 2026 9:16:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 9:16:47 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 9:16:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 9:16:47 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 9:16:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 9:16:48 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260806 09:16:49.164904 11261 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.666s user 0.173s sys 0.505s
I20260806 09:16:49.165228 11261 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 09:16:49.165447 11261 mini_ranger_kms.cc:401] 127.10.255.84:42211/kms/v1/keys
Aug 06 09:16:49 dist-test-slave-mvvj krb5kdc[22301](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786007809, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.255.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 06 09:16:49 dist-test-slave-mvvj krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007809, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.255.84@KRBTEST.COM for HTTP/127.10.255.84@KRBTEST.COM
Aug 06 09:16:50 dist-test-slave-mvvj krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007809, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.255.84@KRBTEST.COM for HTTP/127.10.255.84@KRBTEST.COM
Aug 06 09:16:52 dist-test-slave-mvvj krb5kdc[22301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007812, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:16:53.022137 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:44609
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:44609
--ranger_config_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.255.84:42211/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:16:53.469972 22749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:16:53.470374 22749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:16:53.470549 22749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:16:53.478806 22749 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:16:53.478994 22749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:16:53.479100 22749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:16:53.479206 22749 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:16:53.479290 22749 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:16:53.492132 22749 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/master-0/wal
--ranger_kms_url=127.10.255.84:42211/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:44609
--ranger_config_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:44609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:16:53.493672 22749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:16:53.495157 22749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:16:53.510654 22754 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:16:53.510591 22755 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:16:53.512202 22757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:16:53.513180 22749 server_base.cc:1034] running on GCE node
I20260806 09:16:53.514411 22749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:16:53.516605 22749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:16:53.517906 22749 hybrid_clock.cc:648] HybridClock initialized: now 1786007813517832 us; error 59 us; skew 500 ppm
I20260806 09:16:53.518507 22749 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:16:53 dist-test-slave-mvvj krb5kdc[22301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007813, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:16:53.527824 22749 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:16:53.529963 22749 webserver.cc:460] Webserver started at http://127.10.255.126:44451/ using document root <none> and password file <none>
I20260806 09:16:53.530759 22749 fs_manager.cc:359] Metadata directory not provided
I20260806 09:16:53.530875 22749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:16:53.531278 22749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 09:16:53 dist-test-slave-mvvj krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007813, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for HTTP/127.10.255.84@KRBTEST.COM
I20260806 09:16:53.592316 22749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "e68789a240c14ad48010c19b39462cb4"
format_stamp: "Formatted at 2026-08-06 09:16:53 on dist-test-slave-mvvj"
server_key: "c47ba80bf1179a7d64f04245f64fe943"
server_key_iv: "c173f744501539c0552744b21774dae4"
server_key_version: "kuduclusterkey@0"
I20260806 09:16:53.593324 22749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "e68789a240c14ad48010c19b39462cb4"
format_stamp: "Formatted at 2026-08-06 09:16:53 on dist-test-slave-mvvj"
server_key: "c47ba80bf1179a7d64f04245f64fe943"
server_key_iv: "c173f744501539c0552744b21774dae4"
server_key_version: "kuduclusterkey@0"
I20260806 09:16:53.601157 22749 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260806 09:16:53.622023 22764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:16:53.623950 22749 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260806 09:16:53.624197 22749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "e68789a240c14ad48010c19b39462cb4"
format_stamp: "Formatted at 2026-08-06 09:16:53 on dist-test-slave-mvvj"
server_key: "c47ba80bf1179a7d64f04245f64fe943"
server_key_iv: "c173f744501539c0552744b21774dae4"
server_key_version: "kuduclusterkey@0"
I20260806 09:16:53.624464 22749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:16:53.643437 22749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:16:53.648854 22749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:16:53.649371 22749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:16:53.676657 22749 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:44609
I20260806 09:16:53.676703 22815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:44609 every 8 connection(s)
I20260806 09:16:53.678331 22749 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:16:53.683889 22816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:16:53.685216 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 22749
I20260806 09:16:53.685477 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:16:53.686182 11261 external_mini_cluster.cc:1428] Setting key ee518221db3db0574eda686fdc65c369
I20260806 09:16:53.700672 22816 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e68789a240c14ad48010c19b39462cb4: Bootstrap starting.
I20260806 09:16:53.705430 22816 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e68789a240c14ad48010c19b39462cb4: Neither blocks nor log segments found. Creating new log.
I20260806 09:16:53.706904 22816 log.cc:824] T 00000000000000000000000000000000 P e68789a240c14ad48010c19b39462cb4: Log is configured to *not* fsync() on all Append() calls
I20260806 09:16:53.714598 22816 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e68789a240c14ad48010c19b39462cb4: No bootstrap required, opened a new log
Aug 06 09:16:53 dist-test-slave-mvvj krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007812, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:16:53.725208 22816 raft_consensus.cc:348] T 00000000000000000000000000000000 P e68789a240c14ad48010c19b39462cb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e68789a240c14ad48010c19b39462cb4" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 44609 } }
I20260806 09:16:53.725708 22816 raft_consensus.cc:374] T 00000000000000000000000000000000 P e68789a240c14ad48010c19b39462cb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:16:53.725853 22816 raft_consensus.cc:729] T 00000000000000000000000000000000 P e68789a240c14ad48010c19b39462cb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e68789a240c14ad48010c19b39462cb4, State: Initialized, Role: FOLLOWER
I20260806 09:16:53.726680 22816 consensus_queue.cc:260] T 00000000000000000000000000000000 P e68789a240c14ad48010c19b39462cb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e68789a240c14ad48010c19b39462cb4" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 44609 } }
I20260806 09:16:53.727063 22816 raft_consensus.cc:388] T 00000000000000000000000000000000 P e68789a240c14ad48010c19b39462cb4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:16:53.727262 22816 raft_consensus.cc:482] T 00000000000000000000000000000000 P e68789a240c14ad48010c19b39462cb4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:16:53.727499 22816 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e68789a240c14ad48010c19b39462cb4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:16:53.729691 22819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:16:53.688780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43244 (local address 127.10.255.126:44609)
0806 09:16:53.700481 (+ 11701us) server_negotiation.cc:206] Beginning negotiation
0806 09:16:53.700502 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 09:16:53.700560 (+ 58us) server_negotiation.cc:407] Connection header received
0806 09:16:53.703418 (+ 2858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:16:53.703454 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:16:53.704079 (+ 625us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:16:53.704583 (+ 504us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:16:53.706325 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:53.708917 (+ 2592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:53.711009 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:53.712305 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:53.712562 (+ 257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:16:53.717817 (+ 5255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:16:53.717834 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:16:53.717859 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:16:53.717948 (+ 89us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:16:53.723001 (+ 5053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:16:53.724189 (+ 1188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:16:53.724199 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:16:53.724210 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:16:53.724440 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:16:53.724951 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:16:53.724956 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:16:53.724959 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:16:53.725764 (+ 805us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:16:53.726067 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0806 09:16:53.727586 (+ 1519us) server_negotiation.cc:299] Negotiation successful
0806 09:16:53.728115 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11383,"thread_start_us":11080,"threads_started":1}
I20260806 09:16:53.731122 22816 raft_consensus.cc:504] T 00000000000000000000000000000000 P e68789a240c14ad48010c19b39462cb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e68789a240c14ad48010c19b39462cb4" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 44609 } }
I20260806 09:16:53.731743 22816 leader_election.cc:302] T 00000000000000000000000000000000 P e68789a240c14ad48010c19b39462cb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e68789a240c14ad48010c19b39462cb4; no voters:
I20260806 09:16:53.732581 22816 leader_election.cc:288] T 00000000000000000000000000000000 P e68789a240c14ad48010c19b39462cb4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:16:53.732748 22821 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e68789a240c14ad48010c19b39462cb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:16:53.743351 22816 sys_catalog.cc:564] T 00000000000000000000000000000000 P e68789a240c14ad48010c19b39462cb4 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:16:53.745339 22821 raft_consensus.cc:686] T 00000000000000000000000000000000 P e68789a240c14ad48010c19b39462cb4 [term 1 LEADER]: Becoming Leader. State: Replica: e68789a240c14ad48010c19b39462cb4, State: Running, Role: LEADER
I20260806 09:16:53.746297 22821 consensus_queue.cc:237] T 00000000000000000000000000000000 P e68789a240c14ad48010c19b39462cb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e68789a240c14ad48010c19b39462cb4" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 44609 } }
I20260806 09:16:53.751951 22822 sys_catalog.cc:455] T 00000000000000000000000000000000 P e68789a240c14ad48010c19b39462cb4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e68789a240c14ad48010c19b39462cb4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e68789a240c14ad48010c19b39462cb4" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 44609 } } }
I20260806 09:16:53.751937 22823 sys_catalog.cc:455] T 00000000000000000000000000000000 P e68789a240c14ad48010c19b39462cb4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e68789a240c14ad48010c19b39462cb4. Latest consensus state: current_term: 1 leader_uuid: "e68789a240c14ad48010c19b39462cb4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e68789a240c14ad48010c19b39462cb4" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 44609 } } }
I20260806 09:16:53.752699 22823 sys_catalog.cc:458] T 00000000000000000000000000000000 P e68789a240c14ad48010c19b39462cb4 [sys.catalog]: This master's current role is: LEADER
I20260806 09:16:53.752734 22822 sys_catalog.cc:458] T 00000000000000000000000000000000 P e68789a240c14ad48010c19b39462cb4 [sys.catalog]: This master's current role is: LEADER
I20260806 09:16:53.754999 22827 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:16:53.763345 22827 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:16:53.786551 22827 catalog_manager.cc:1347] Generated new cluster ID: 6b135b9bb9ab4910aa6baeb036d8989c
I20260806 09:16:53.786839 22827 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:16:53.818271 22827 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:16:53.821221 22827 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:16:53.824448 22816 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 09:16:53.836197 22827 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e68789a240c14ad48010c19b39462cb4: Generated new TSK 0
I20260806 09:16:53.837918 22827 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.255.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
I20260806 09:16:54.737473 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.255.84:42211/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:44609
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 09:16:55 dist-test-slave-mvvj krb5kdc[22301](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786007815, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260806 09:16:55.230786 22861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:16:55.231180 22861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:16:55.231369 22861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:16:55.242534 22861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:16:55.242797 22861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:16:55.243011 22861 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:16:55.254084 22861 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.10.255.84:42211/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:44609
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:16:55.255596 22861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:16:55.257004 22861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:16:55.276230 22871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:16:55.278064 22872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:16:55.286787 22875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:16:55.287389 22861 server_base.cc:1034] running on GCE node
I20260806 09:16:55.288278 22861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:16:55.289615 22861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:16:55.293234 22861 hybrid_clock.cc:648] HybridClock initialized: now 1786007815292565 us; error 528 us; skew 500 ppm
I20260806 09:16:55.293733 22861 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:16:55 dist-test-slave-mvvj krb5kdc[22301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007815, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:16:55.297495 22861 init.cc:377] Logged in from keytab as kudu/127.10.255.65@KRBTEST.COM (short username kudu)
I20260806 09:16:55.301365 22861 webserver.cc:460] Webserver started at http://127.10.255.65:41845/ using document root <none> and password file <none>
I20260806 09:16:55.302392 22861 fs_manager.cc:359] Metadata directory not provided
I20260806 09:16:55.302590 22861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:16:55.303013 22861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 09:16:55 dist-test-slave-mvvj krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007815, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for HTTP/127.10.255.84@KRBTEST.COM
I20260806 09:16:55.331382 22861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "c158a53f51d94c5980aeb5faccb6c785"
format_stamp: "Formatted at 2026-08-06 09:16:55 on dist-test-slave-mvvj"
server_key: "0ab29da13be76e1cbbecefd83aa53474"
server_key_iv: "3e2a4827aec7488554e0945d229a1ea6"
server_key_version: "kuduclusterkey@0"
I20260806 09:16:55.335073 22861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "c158a53f51d94c5980aeb5faccb6c785"
format_stamp: "Formatted at 2026-08-06 09:16:55 on dist-test-slave-mvvj"
server_key: "0ab29da13be76e1cbbecefd83aa53474"
server_key_iv: "3e2a4827aec7488554e0945d229a1ea6"
server_key_version: "kuduclusterkey@0"
I20260806 09:16:55.345000 22861 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.005s sys 0.003s
I20260806 09:16:55.365718 22881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:16:55.368064 22861 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.002s
I20260806 09:16:55.368322 22861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "c158a53f51d94c5980aeb5faccb6c785"
format_stamp: "Formatted at 2026-08-06 09:16:55 on dist-test-slave-mvvj"
server_key: "0ab29da13be76e1cbbecefd83aa53474"
server_key_iv: "3e2a4827aec7488554e0945d229a1ea6"
server_key_version: "kuduclusterkey@0"
I20260806 09:16:55.368708 22861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:16:55.398471 22861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:16:55.404305 22861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:16:55.404783 22861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:16:55.412326 22861 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:16:55.417256 22861 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:16:55.417392 22861 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:16:55.417557 22861 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:16:55.417637 22861 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:16:55.530439 22861 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:35499
I20260806 09:16:55.530470 22995 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:35499 every 8 connection(s)
I20260806 09:16:55.532616 22861 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:16:55.540205 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 22861
I20260806 09:16:55.540505 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:16:55.541594 11261 external_mini_cluster.cc:1428] Setting key 2098b78b11cd443691c6c5f2108f1e5e
Aug 06 09:16:55 dist-test-slave-mvvj krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007815, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.255.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.66@KRBTEST.COM" created.
I20260806 09:16:55.602451 22999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:16:55.537771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:49031 (local address 127.10.255.126:44609)
0806 09:16:55.566369 (+ 28598us) server_negotiation.cc:206] Beginning negotiation
0806 09:16:55.566379 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:16:55.571896 (+ 5517us) server_negotiation.cc:407] Connection header received
0806 09:16:55.571990 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:16:55.571995 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:16:55.572163 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:16:55.572268 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:16:55.576828 (+ 4560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:55.578422 (+ 1594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:55.582312 (+ 3890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:55.583782 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:55.583993 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:16:55.592056 (+ 8063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:16:55.592067 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:16:55.592073 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:16:55.592154 (+ 81us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:16:55.596926 (+ 4772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:16:55.598446 (+ 1520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:16:55.598455 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:16:55.598466 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:16:55.598732 (+ 266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:16:55.599632 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:16:55.599642 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:16:55.599648 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:16:55.600171 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:16:55.600314 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 09:16:55.601526 (+ 1212us) server_negotiation.cc:299] Negotiation successful
0806 09:16:55.601857 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28410,"thread_start_us":28603,"threads_started":1}
Aug 06 09:16:55 dist-test-slave-mvvj krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007815, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for HTTP/127.10.255.84@KRBTEST.COM
I20260806 09:16:55.605607 22998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:16:55.537020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:44609 (local address 127.10.255.65:49031)
0806 09:16:55.567603 (+ 30583us) negotiation.cc:107] Waiting for socket to connect
0806 09:16:55.567685 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0806 09:16:55.571414 (+ 3729us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:16:55.573963 (+ 2549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:16:55.573976 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:16:55.574959 (+ 983us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:16:55.576487 (+ 1528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:16:55.576519 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:16:55.578741 (+ 2222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:16:55.578750 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:16:55.582053 (+ 3303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:16:55.582082 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:16:55.584590 (+ 2508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:16:55.584605 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:16:55.585170 (+ 565us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:16:55.586284 (+ 1114us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:16:55.586329 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:16:55.591459 (+ 5130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:16:55.597213 (+ 5754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:16:55.597228 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:16:55.597254 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:16:55.598232 (+ 978us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:16:55.598936 (+ 704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:16:55.598944 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:16:55.598951 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:16:55.599471 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:16:55.600461 (+ 990us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:16:55.600473 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:16:55.601030 (+ 557us) client_negotiation.cc:769] Sending connection context
0806 09:16:55.603118 (+ 2088us) client_negotiation.cc:240] Negotiation successful
0806 09:16:55.603949 (+ 831us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30115,"thread_start_us":35329,"threads_started":1}
I20260806 09:16:55.609091 22996 heartbeater.cc:347] Connected to a master server at 127.10.255.126:44609
I20260806 09:16:55.609580 22996 heartbeater.cc:464] Registering TS with master...
I20260806 09:16:55.610918 22996 heartbeater.cc:511] Master 127.10.255.126:44609 requested a full tablet report, sending...
I20260806 09:16:55.615492 22781 ts_manager.cc:194] Registered new tserver with Master: c158a53f51d94c5980aeb5faccb6c785 (127.10.255.65:35499)
I20260806 09:16:55.618355 22781 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.65@KRBTEST.COM'} at 127.10.255.65:49031
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
W20260806 09:16:55.647738 11261 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.10.255.66: real 0.103s user 0.001s sys 0.020s
I20260806 09:16:55.648947 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.255.84:42211/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:44609
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 09:16:55 dist-test-slave-mvvj krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007815, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for HTTP/127.10.255.84@KRBTEST.COM
W20260806 09:16:56.194953 23002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:16:56.195535 23002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:16:56.195783 23002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:16:56.209275 23002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:16:56.209548 23002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:16:56.209836 23002 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:16:56.227576 23002 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.10.255.84:42211/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:44609
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:16:56.229736 23002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:16:56.231889 23002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:16:56.270977 23010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:16:56.278309 23011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:16:56.291145 23002 server_base.cc:1034] running on GCE node
W20260806 09:16:56.291424 23015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:16:56.292398 23002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:16:56.294541 23002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:16:56.295928 23002 hybrid_clock.cc:648] HybridClock initialized: now 1786007816295827 us; error 74 us; skew 500 ppm
I20260806 09:16:56.296474 23002 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:16:56 dist-test-slave-mvvj krb5kdc[22301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007816, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:16:56.301470 23002 init.cc:377] Logged in from keytab as kudu/127.10.255.66@KRBTEST.COM (short username kudu)
I20260806 09:16:56.304036 23002 webserver.cc:460] Webserver started at http://127.10.255.66:38965/ using document root <none> and password file <none>
I20260806 09:16:56.305169 23002 fs_manager.cc:359] Metadata directory not provided
I20260806 09:16:56.305357 23002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:16:56.305805 23002 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 09:16:56 dist-test-slave-mvvj krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007816, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for HTTP/127.10.255.84@KRBTEST.COM
I20260806 09:16:56.328424 23002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "f3aa60467cbf47b3b32cef3bb0640720"
format_stamp: "Formatted at 2026-08-06 09:16:56 on dist-test-slave-mvvj"
server_key: "945af21fba8538d9609a3b22fc67a39f"
server_key_iv: "9d71c4f97ebe6547481e06aa5086f8e9"
server_key_version: "kuduclusterkey@0"
I20260806 09:16:56.329685 23002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "f3aa60467cbf47b3b32cef3bb0640720"
format_stamp: "Formatted at 2026-08-06 09:16:56 on dist-test-slave-mvvj"
server_key: "945af21fba8538d9609a3b22fc67a39f"
server_key_iv: "9d71c4f97ebe6547481e06aa5086f8e9"
server_key_version: "kuduclusterkey@0"
I20260806 09:16:56.338475 23002 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.008s sys 0.000s
I20260806 09:16:56.378348 23027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:16:56.380618 23002 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.003s sys 0.005s
I20260806 09:16:56.380865 23002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "f3aa60467cbf47b3b32cef3bb0640720"
format_stamp: "Formatted at 2026-08-06 09:16:56 on dist-test-slave-mvvj"
server_key: "945af21fba8538d9609a3b22fc67a39f"
server_key_iv: "9d71c4f97ebe6547481e06aa5086f8e9"
server_key_version: "kuduclusterkey@0"
I20260806 09:16:56.381174 23002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:16:56.454859 23002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:16:56.461917 23002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:16:56.462486 23002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:16:56.476387 23002 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:16:56.482641 23002 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:16:56.482821 23002 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:16:56.483062 23002 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:16:56.483166 23002 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:16:56.576964 23002 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:41153
I20260806 09:16:56.577133 23141 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:41153 every 8 connection(s)
I20260806 09:16:56.579232 23002 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:16:56.581344 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 23002
I20260806 09:16:56.581560 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:16:56.582226 11261 external_mini_cluster.cc:1428] Setting key be70d83590af12f34ab01108d64d89b5
Aug 06 09:16:56 dist-test-slave-mvvj krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007816, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:16:56.617252 23144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:16:56.584137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:35635 (local address 127.10.255.126:44609)
0806 09:16:56.588778 (+ 4641us) server_negotiation.cc:206] Beginning negotiation
0806 09:16:56.588785 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:16:56.588811 (+ 26us) server_negotiation.cc:407] Connection header received
0806 09:16:56.592043 (+ 3232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:16:56.592061 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:16:56.592177 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:16:56.592314 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:16:56.594623 (+ 2309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:56.595775 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:56.598313 (+ 2538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:56.598876 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:56.599063 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:16:56.605696 (+ 6633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:16:56.605706 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:16:56.605715 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:16:56.605793 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:16:56.611254 (+ 5461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:16:56.612719 (+ 1465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:16:56.612729 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:16:56.612736 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:16:56.613019 (+ 283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:16:56.613974 (+ 955us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:16:56.613982 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:16:56.613988 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:16:56.614637 (+ 649us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:16:56.614822 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0806 09:16:56.616274 (+ 1452us) server_negotiation.cc:299] Negotiation successful
0806 09:16:56.616603 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4391,"thread_start_us":4186,"threads_started":1}
I20260806 09:16:56.618600 23145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:16:56.585271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:44609 (local address 127.10.255.66:35635)
0806 09:16:56.587324 (+ 2053us) negotiation.cc:107] Waiting for socket to connect
0806 09:16:56.587404 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0806 09:16:56.591474 (+ 4070us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:16:56.592722 (+ 1248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:16:56.592734 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:16:56.593353 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:16:56.594370 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:16:56.594395 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:16:56.596054 (+ 1659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:16:56.596065 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:16:56.598074 (+ 2009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:16:56.598127 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:16:56.599278 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:16:56.599290 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:16:56.599631 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:16:56.600715 (+ 1084us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:16:56.600742 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:16:56.605264 (+ 4522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:16:56.611514 (+ 6250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:16:56.611528 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:16:56.611551 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:16:56.612498 (+ 947us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:16:56.613201 (+ 703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:16:56.613207 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:16:56.613211 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:16:56.613776 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:16:56.614837 (+ 1061us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:16:56.614847 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:16:56.615559 (+ 712us) client_negotiation.cc:769] Sending connection context
0806 09:16:56.616001 (+ 442us) client_negotiation.cc:240] Negotiation successful
0806 09:16:56.616723 (+ 722us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1559,"thread_start_us":974,"threads_started":1}
I20260806 09:16:56.621030 23142 heartbeater.cc:347] Connected to a master server at 127.10.255.126:44609
I20260806 09:16:56.621585 23142 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.10.255.67@KRBTEST.COM; defaulting to no policy
I20260806 09:16:56.623045 23142 heartbeater.cc:511] Master 127.10.255.126:44609 requested a full tablet report, sending...
I20260806 09:16:56.624760 22996 heartbeater.cc:503] Master 127.10.255.126:44609 was elected leader, sending a full tablet report...
I20260806 09:16:56.625476 22781 ts_manager.cc:194] Registered new tserver with Master: f3aa60467cbf47b3b32cef3bb0640720 (127.10.255.66:41153)
I20260806 09:16:56.626585 22781 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.66@KRBTEST.COM'} at 127.10.255.66:35635
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
I20260806 09:16:56.660384 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.255.84:42211/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:44609
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43947
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:16:57.365947 23148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:16:57.366346 23148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:16:57.366605 23148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:16:57.377242 23148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:16:57.377466 23148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:16:57.377764 23148 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:16:57.392886 23148 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43947
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.10.255.84:42211/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:44609
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:16:57.394779 23148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:16:57.396589 23148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:16:57.418843 23153 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:16:57.419370 23154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:16:57.419389 23156 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:16:57.420956 23148 server_base.cc:1034] running on GCE node
I20260806 09:16:57.421895 23148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:16:57.423259 23148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:16:57.424677 23148 hybrid_clock.cc:648] HybridClock initialized: now 1786007817424540 us; error 61 us; skew 500 ppm
I20260806 09:16:57.425135 23148 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:16:57 dist-test-slave-mvvj krb5kdc[22301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007817, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:16:57.430737 23148 init.cc:377] Logged in from keytab as kudu/127.10.255.67@KRBTEST.COM (short username kudu)
I20260806 09:16:57.433398 23148 webserver.cc:460] Webserver started at http://127.10.255.67:43523/ using document root <none> and password file <none>
I20260806 09:16:57.434785 23148 fs_manager.cc:359] Metadata directory not provided
I20260806 09:16:57.435070 23148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:16:57.435730 23148 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 09:16:57 dist-test-slave-mvvj krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007817, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for HTTP/127.10.255.84@KRBTEST.COM
I20260806 09:16:57.457350 23148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "5ad61144021c47ecac64c18790f429ef"
format_stamp: "Formatted at 2026-08-06 09:16:57 on dist-test-slave-mvvj"
server_key: "6e1ef600e8f8d700342c3bd2b5542bd4"
server_key_iv: "494b40347363fc25b636397a836f799b"
server_key_version: "kuduclusterkey@0"
I20260806 09:16:57.459118 23148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "5ad61144021c47ecac64c18790f429ef"
format_stamp: "Formatted at 2026-08-06 09:16:57 on dist-test-slave-mvvj"
server_key: "6e1ef600e8f8d700342c3bd2b5542bd4"
server_key_iv: "494b40347363fc25b636397a836f799b"
server_key_version: "kuduclusterkey@0"
I20260806 09:16:57.469368 23148 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.006s sys 0.006s
I20260806 09:16:57.490384 23163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:16:57.492388 23148 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260806 09:16:57.492630 23148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "5ad61144021c47ecac64c18790f429ef"
format_stamp: "Formatted at 2026-08-06 09:16:57 on dist-test-slave-mvvj"
server_key: "6e1ef600e8f8d700342c3bd2b5542bd4"
server_key_iv: "494b40347363fc25b636397a836f799b"
server_key_version: "kuduclusterkey@0"
I20260806 09:16:57.492854 23148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:16:57.510632 23148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:16:57.517094 23148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:16:57.517731 23148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:16:57.519639 23148 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:16:57.522042 23148 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:16:57.522194 23148 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:16:57.522488 23148 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:16:57.522671 23148 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:16:57.612727 23148 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:44255
I20260806 09:16:57.612809 23276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:44255 every 8 connection(s)
I20260806 09:16:57.614557 23148 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:16:57.621662 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 23148
I20260806 09:16:57.621883 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:16:57.622432 11261 external_mini_cluster.cc:1428] Setting key 4434dc2ac2d2fd2a1e0611f89f7e01fe
I20260806 09:16:57.630748 23142 heartbeater.cc:503] Master 127.10.255.126:44609 was elected leader, sending a full tablet report...
Aug 06 09:16:57 dist-test-slave-mvvj krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007817, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:16:57.649710 23279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:16:57.618600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:46015 (local address 127.10.255.126:44609)
0806 09:16:57.619290 (+ 690us) server_negotiation.cc:206] Beginning negotiation
0806 09:16:57.619296 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:16:57.620955 (+ 1659us) server_negotiation.cc:407] Connection header received
0806 09:16:57.623822 (+ 2867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:16:57.623828 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:16:57.624006 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:16:57.624168 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:16:57.626795 (+ 2627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.628334 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.630998 (+ 2664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.632073 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.632218 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:16:57.638455 (+ 6237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:16:57.638463 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:16:57.638468 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:16:57.638558 (+ 90us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:16:57.644439 (+ 5881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:16:57.645630 (+ 1191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:16:57.645642 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:16:57.645647 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:16:57.645844 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:16:57.646706 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:16:57.646714 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:16:57.646719 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:16:57.647361 (+ 642us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:16:57.647551 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0806 09:16:57.648565 (+ 1014us) server_negotiation.cc:299] Negotiation successful
0806 09:16:57.648982 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":576,"thread_start_us":450,"threads_started":1}
I20260806 09:16:57.650630 23280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:16:57.619339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:44609 (local address 127.10.255.67:46015)
0806 09:16:57.620762 (+ 1423us) negotiation.cc:107] Waiting for socket to connect
0806 09:16:57.620808 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 09:16:57.623515 (+ 2707us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:16:57.624534 (+ 1019us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:16:57.624547 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:16:57.625442 (+ 895us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:16:57.626568 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:16:57.626612 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.628512 (+ 1900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.628517 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:16:57.630744 (+ 2227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:16:57.630774 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.632365 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.632377 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:16:57.632861 (+ 484us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:16:57.633824 (+ 963us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:16:57.633852 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:16:57.637776 (+ 3924us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:16:57.644679 (+ 6903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:16:57.644690 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:16:57.644708 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:16:57.645463 (+ 755us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:16:57.646084 (+ 621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:16:57.646088 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:16:57.646091 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:16:57.646470 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:16:57.647563 (+ 1093us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:16:57.647571 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:16:57.648101 (+ 530us) client_negotiation.cc:769] Sending connection context
0806 09:16:57.648405 (+ 304us) client_negotiation.cc:240] Negotiation successful
0806 09:16:57.649038 (+ 633us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1081,"thread_start_us":753,"threads_started":1}
I20260806 09:16:57.652869 23277 heartbeater.cc:347] Connected to a master server at 127.10.255.126:44609
I20260806 09:16:57.653278 23277 heartbeater.cc:464] Registering TS with master...
I20260806 09:16:57.654428 23277 heartbeater.cc:511] Master 127.10.255.126:44609 requested a full tablet report, sending...
I20260806 09:16:57.656518 22780 ts_manager.cc:194] Registered new tserver with Master: 5ad61144021c47ecac64c18790f429ef (127.10.255.67:44255)
I20260806 09:16:57.657783 22780 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.67@KRBTEST.COM'} at 127.10.255.67:46015
I20260806 09:16:57.667389 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 09:16:57.696795 23279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:16:57.674981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50798 (local address 127.10.255.126:44609)
0806 09:16:57.675373 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0806 09:16:57.675383 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:16:57.676040 (+ 657us) server_negotiation.cc:407] Connection header received
0806 09:16:57.676408 (+ 368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:16:57.676413 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:16:57.676628 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:16:57.676759 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:16:57.679562 (+ 2803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.680597 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.682835 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.683642 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.683859 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:16:57.688301 (+ 4442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:16:57.688308 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:16:57.688312 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:16:57.688358 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:16:57.692318 (+ 3960us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:16:57.693556 (+ 1238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:16:57.693562 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:16:57.693564 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:16:57.693798 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:16:57.694571 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:16:57.694579 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:16:57.694584 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:16:57.695055 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:16:57.695419 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0806 09:16:57.695942 (+ 523us) server_negotiation.cc:299] Negotiation successful
0806 09:16:57.696277 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137}
I20260806 09:16:57.703056 22780 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50798:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:16:57.715363 22780 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:16:57.771265 23291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:16:57.736281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54666 (local address 127.10.255.66:41153)
0806 09:16:57.754394 (+ 18113us) server_negotiation.cc:206] Beginning negotiation
0806 09:16:57.754400 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:16:57.757528 (+ 3128us) server_negotiation.cc:407] Connection header received
0806 09:16:57.757870 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:16:57.757889 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:16:57.758239 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:16:57.758532 (+ 293us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:16:57.759935 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.762238 (+ 2303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.767376 (+ 5138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.769128 (+ 1752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.769286 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:16:57.769626 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0806 09:16:57.770468 (+ 842us) server_negotiation.cc:299] Negotiation successful
0806 09:16:57.770681 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17963,"thread_start_us":17815,"threads_started":1}
I20260806 09:16:57.772099 23294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:16:57.736384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43920 (local address 127.10.255.65:35499)
0806 09:16:57.752799 (+ 16415us) server_negotiation.cc:206] Beginning negotiation
0806 09:16:57.752811 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 09:16:57.756347 (+ 3536us) server_negotiation.cc:407] Connection header received
0806 09:16:57.758835 (+ 2488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:16:57.758857 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:16:57.759157 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:16:57.759407 (+ 250us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:16:57.761486 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.763251 (+ 1765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.767295 (+ 4044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.769659 (+ 2364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.769849 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:16:57.771254 (+ 1405us) server_negotiation.cc:1035] Waiting for connection context
0806 09:16:57.771384 (+ 130us) server_negotiation.cc:299] Negotiation successful
0806 09:16:57.771608 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16167,"thread_start_us":15860,"threads_started":1}
I20260806 09:16:57.772668 23290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:16:57.735601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:41153 (local address 127.0.0.1:54666)
0806 09:16:57.757371 (+ 21770us) negotiation.cc:107] Waiting for socket to connect
0806 09:16:57.757390 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 09:16:57.757563 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:16:57.758511 (+ 948us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:16:57.758516 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:16:57.758544 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:16:57.759679 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:16:57.759693 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.762484 (+ 2791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.762490 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:16:57.767119 (+ 4629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:16:57.767137 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.769879 (+ 2742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.769887 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:16:57.770172 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:16:57.770257 (+ 85us) client_negotiation.cc:769] Sending connection context
0806 09:16:57.770414 (+ 157us) client_negotiation.cc:240] Negotiation successful
0806 09:16:57.770652 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21528,"mutex_wait_us":150,"thread_start_us":21245,"threads_started":1}
I20260806 09:16:57.773077 23292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:16:57.735223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:35499 (local address 127.0.0.1:43920)
0806 09:16:57.756204 (+ 20981us) negotiation.cc:107] Waiting for socket to connect
0806 09:16:57.756223 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 09:16:57.758399 (+ 2176us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x61200002c7a8. stack: 00007fab36a4266e 00007fab36a42430 00007fab35ac95ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007fab36a380fd 00007fab36a37d1e 00007fab499453cd 00007fab4994536c 00007fab49911b3b 00007fab3d447536 00007fab3d445d9e 00007fab3d4cddca 00007fab3d4cbf68 00007fab3d4ff82f
0806 09:16:57.758437 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:16:57.760036 (+ 1599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:16:57.760041 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:16:57.760078 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:16:57.761134 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:16:57.761151 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.763562 (+ 2411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.763568 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:16:57.767042 (+ 3474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:16:57.767063 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.770326 (+ 3263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.770332 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:16:57.770628 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:16:57.770661 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 09:16:57.770762 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 09:16:57.770973 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20203,"mutex_wait_us":43,"spinlock_wait_cycles":2864384,"thread_start_us":19738,"threads_started":1}
I20260806 09:16:57.773790 23293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:16:57.736170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49194 (local address 127.10.255.67:44255)
0806 09:16:57.752958 (+ 16788us) server_negotiation.cc:206] Beginning negotiation
0806 09:16:57.752970 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 09:16:57.756132 (+ 3162us) server_negotiation.cc:407] Connection header received
0806 09:16:57.757016 (+ 884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:16:57.757035 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:16:57.757415 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:16:57.757690 (+ 275us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:16:57.759594 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.762054 (+ 2460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.767830 (+ 5776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.770233 (+ 2403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.770509 (+ 276us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:16:57.770829 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0806 09:16:57.772781 (+ 1952us) server_negotiation.cc:299] Negotiation successful
0806 09:16:57.773048 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15406,"thread_start_us":16515,"threads_started":1}
I20260806 09:16:57.777751 23075 tablet_service.cc:1467] Processing CreateTablet for tablet 2462136af48f4987b803cfdc0593c7c2 (DEFAULT_TABLE table=test-table [id=683a5ce2bbd34b53b712eadf39c38bdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:16:57.777751 22930 tablet_service.cc:1467] Processing CreateTablet for tablet 2462136af48f4987b803cfdc0593c7c2 (DEFAULT_TABLE table=test-table [id=683a5ce2bbd34b53b712eadf39c38bdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:16:57.779371 23075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2462136af48f4987b803cfdc0593c7c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:16:57.779417 22930 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2462136af48f4987b803cfdc0593c7c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:16:57.783187 23295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:16:57.735406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:44255 (local address 127.0.0.1:49194)
0806 09:16:57.755899 (+ 20493us) negotiation.cc:107] Waiting for socket to connect
0806 09:16:57.755964 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0806 09:16:57.756650 (+ 686us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:16:57.757742 (+ 1092us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:16:57.757751 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:16:57.757787 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:16:57.759097 (+ 1310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:16:57.759152 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.762214 (+ 3062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.762221 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:16:57.767557 (+ 5336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:16:57.767584 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.771165 (+ 3581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.771181 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:16:57.772551 (+ 1370us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:16:57.772579 (+ 28us) client_negotiation.cc:769] Sending connection context
0806 09:16:57.772711 (+ 132us) client_negotiation.cc:240] Negotiation successful
0806 09:16:57.781816 (+ 9105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20231,"mutex_wait_us":112,"thread_start_us":18410,"threads_started":1}
I20260806 09:16:57.788452 23211 tablet_service.cc:1467] Processing CreateTablet for tablet 2462136af48f4987b803cfdc0593c7c2 (DEFAULT_TABLE table=test-table [id=683a5ce2bbd34b53b712eadf39c38bdd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:16:57.790865 23211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2462136af48f4987b803cfdc0593c7c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:16:57.798897 23296 tablet_bootstrap.cc:492] T 2462136af48f4987b803cfdc0593c7c2 P c158a53f51d94c5980aeb5faccb6c785: Bootstrap starting.
I20260806 09:16:57.805992 23296 tablet_bootstrap.cc:654] T 2462136af48f4987b803cfdc0593c7c2 P c158a53f51d94c5980aeb5faccb6c785: Neither blocks nor log segments found. Creating new log.
I20260806 09:16:57.806706 23297 tablet_bootstrap.cc:492] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720: Bootstrap starting.
I20260806 09:16:57.808936 23296 log.cc:824] T 2462136af48f4987b803cfdc0593c7c2 P c158a53f51d94c5980aeb5faccb6c785: Log is configured to *not* fsync() on all Append() calls
I20260806 09:16:57.812305 23297 tablet_bootstrap.cc:654] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720: Neither blocks nor log segments found. Creating new log.
I20260806 09:16:57.814667 23297 log.cc:824] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720: Log is configured to *not* fsync() on all Append() calls
I20260806 09:16:57.815691 23296 tablet_bootstrap.cc:492] T 2462136af48f4987b803cfdc0593c7c2 P c158a53f51d94c5980aeb5faccb6c785: No bootstrap required, opened a new log
I20260806 09:16:57.816255 23296 ts_tablet_manager.cc:1397] T 2462136af48f4987b803cfdc0593c7c2 P c158a53f51d94c5980aeb5faccb6c785: Time spent bootstrapping tablet: real 0.018s user 0.011s sys 0.004s
I20260806 09:16:57.816293 23299 tablet_bootstrap.cc:492] T 2462136af48f4987b803cfdc0593c7c2 P 5ad61144021c47ecac64c18790f429ef: Bootstrap starting.
I20260806 09:16:57.822047 23299 tablet_bootstrap.cc:654] T 2462136af48f4987b803cfdc0593c7c2 P 5ad61144021c47ecac64c18790f429ef: Neither blocks nor log segments found. Creating new log.
I20260806 09:16:57.822147 23297 tablet_bootstrap.cc:492] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720: No bootstrap required, opened a new log
I20260806 09:16:57.822631 23297 ts_tablet_manager.cc:1397] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.008s
I20260806 09:16:57.823969 23299 log.cc:824] T 2462136af48f4987b803cfdc0593c7c2 P 5ad61144021c47ecac64c18790f429ef: Log is configured to *not* fsync() on all Append() calls
I20260806 09:16:57.829591 23299 tablet_bootstrap.cc:492] T 2462136af48f4987b803cfdc0593c7c2 P 5ad61144021c47ecac64c18790f429ef: No bootstrap required, opened a new log
I20260806 09:16:57.830029 23299 ts_tablet_manager.cc:1397] T 2462136af48f4987b803cfdc0593c7c2 P 5ad61144021c47ecac64c18790f429ef: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.009s
I20260806 09:16:57.832948 23296 raft_consensus.cc:348] T 2462136af48f4987b803cfdc0593c7c2 P c158a53f51d94c5980aeb5faccb6c785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad61144021c47ecac64c18790f429ef" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 44255 } } peers { permanent_uuid: "c158a53f51d94c5980aeb5faccb6c785" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35499 } } peers { permanent_uuid: "f3aa60467cbf47b3b32cef3bb0640720" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 41153 } }
I20260806 09:16:57.833906 23296 raft_consensus.cc:374] T 2462136af48f4987b803cfdc0593c7c2 P c158a53f51d94c5980aeb5faccb6c785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:16:57.834110 23296 raft_consensus.cc:729] T 2462136af48f4987b803cfdc0593c7c2 P c158a53f51d94c5980aeb5faccb6c785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c158a53f51d94c5980aeb5faccb6c785, State: Initialized, Role: FOLLOWER
I20260806 09:16:57.835132 23296 consensus_queue.cc:260] T 2462136af48f4987b803cfdc0593c7c2 P c158a53f51d94c5980aeb5faccb6c785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad61144021c47ecac64c18790f429ef" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 44255 } } peers { permanent_uuid: "c158a53f51d94c5980aeb5faccb6c785" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35499 } } peers { permanent_uuid: "f3aa60467cbf47b3b32cef3bb0640720" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 41153 } }
I20260806 09:16:57.838505 23296 ts_tablet_manager.cc:1428] T 2462136af48f4987b803cfdc0593c7c2 P c158a53f51d94c5980aeb5faccb6c785: Time spent starting tablet: real 0.022s user 0.013s sys 0.008s
I20260806 09:16:57.839751 23297 raft_consensus.cc:348] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad61144021c47ecac64c18790f429ef" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 44255 } } peers { permanent_uuid: "c158a53f51d94c5980aeb5faccb6c785" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35499 } } peers { permanent_uuid: "f3aa60467cbf47b3b32cef3bb0640720" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 41153 } }
I20260806 09:16:57.840616 23297 raft_consensus.cc:374] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:16:57.840773 23297 raft_consensus.cc:729] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3aa60467cbf47b3b32cef3bb0640720, State: Initialized, Role: FOLLOWER
I20260806 09:16:57.841523 23297 consensus_queue.cc:260] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad61144021c47ecac64c18790f429ef" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 44255 } } peers { permanent_uuid: "c158a53f51d94c5980aeb5faccb6c785" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35499 } } peers { permanent_uuid: "f3aa60467cbf47b3b32cef3bb0640720" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 41153 } }
I20260806 09:16:57.844249 23297 ts_tablet_manager.cc:1428] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720: Time spent starting tablet: real 0.021s user 0.019s sys 0.005s
I20260806 09:16:57.845296 23299 raft_consensus.cc:348] T 2462136af48f4987b803cfdc0593c7c2 P 5ad61144021c47ecac64c18790f429ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad61144021c47ecac64c18790f429ef" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 44255 } } peers { permanent_uuid: "c158a53f51d94c5980aeb5faccb6c785" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35499 } } peers { permanent_uuid: "f3aa60467cbf47b3b32cef3bb0640720" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 41153 } }
I20260806 09:16:57.845928 23299 raft_consensus.cc:374] T 2462136af48f4987b803cfdc0593c7c2 P 5ad61144021c47ecac64c18790f429ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:16:57.846117 23299 raft_consensus.cc:729] T 2462136af48f4987b803cfdc0593c7c2 P 5ad61144021c47ecac64c18790f429ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ad61144021c47ecac64c18790f429ef, State: Initialized, Role: FOLLOWER
I20260806 09:16:57.847091 23299 consensus_queue.cc:260] T 2462136af48f4987b803cfdc0593c7c2 P 5ad61144021c47ecac64c18790f429ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad61144021c47ecac64c18790f429ef" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 44255 } } peers { permanent_uuid: "c158a53f51d94c5980aeb5faccb6c785" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35499 } } peers { permanent_uuid: "f3aa60467cbf47b3b32cef3bb0640720" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 41153 } }
I20260806 09:16:57.849255 23277 heartbeater.cc:503] Master 127.10.255.126:44609 was elected leader, sending a full tablet report...
I20260806 09:16:57.849956 23299 ts_tablet_manager.cc:1428] T 2462136af48f4987b803cfdc0593c7c2 P 5ad61144021c47ecac64c18790f429ef: Time spent starting tablet: real 0.020s user 0.013s sys 0.007s
I20260806 09:16:57.866045 23303 raft_consensus.cc:482] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:16:57.866485 23303 raft_consensus.cc:504] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad61144021c47ecac64c18790f429ef" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 44255 } } peers { permanent_uuid: "c158a53f51d94c5980aeb5faccb6c785" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35499 } } peers { permanent_uuid: "f3aa60467cbf47b3b32cef3bb0640720" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 41153 } }
W20260806 09:16:57.867365 23278 tablet.cc:2369] T 2462136af48f4987b803cfdc0593c7c2 P 5ad61144021c47ecac64c18790f429ef: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:16:57.869145 23303 leader_election.cc:288] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ad61144021c47ecac64c18790f429ef (127.10.255.67:44255), c158a53f51d94c5980aeb5faccb6c785 (127.10.255.65:35499)
I20260806 09:16:57.881356 23294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:16:57.870193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:46629 (local address 127.10.255.65:35499)
0806 09:16:57.870664 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0806 09:16:57.870673 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:16:57.872903 (+ 2230us) server_negotiation.cc:407] Connection header received
0806 09:16:57.873215 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:16:57.873220 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:16:57.873285 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:16:57.873391 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:16:57.874499 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.875621 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.878706 (+ 3085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.879977 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.880231 (+ 254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:16:57.880351 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 09:16:57.880813 (+ 462us) server_negotiation.cc:299] Negotiation successful
0806 09:16:57.880978 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139}
I20260806 09:16:57.881578 23305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:16:57.870728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:35499 (local address 127.10.255.66:46629)
0806 09:16:57.872754 (+ 2026us) negotiation.cc:107] Waiting for socket to connect
0806 09:16:57.872773 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 09:16:57.873028 (+ 255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:16:57.873409 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:16:57.873422 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:16:57.873447 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:16:57.874321 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:16:57.874335 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.875773 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.875780 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:16:57.878484 (+ 2704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:16:57.878499 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.880337 (+ 1838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.880345 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:16:57.880556 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:16:57.880583 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 09:16:57.880715 (+ 132us) client_negotiation.cc:240] Negotiation successful
0806 09:16:57.880879 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1847,"mutex_wait_us":21,"thread_start_us":1410,"threads_started":1}
I20260806 09:16:57.881744 23293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:16:57.869505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:47011 (local address 127.10.255.67:44255)
0806 09:16:57.869855 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0806 09:16:57.869864 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:16:57.872994 (+ 3130us) server_negotiation.cc:407] Connection header received
0806 09:16:57.873250 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:16:57.873256 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:16:57.873336 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:16:57.873440 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:16:57.874907 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.876105 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.879167 (+ 3062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.880494 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.880746 (+ 252us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:16:57.880876 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0806 09:16:57.881276 (+ 400us) server_negotiation.cc:299] Negotiation successful
0806 09:16:57.881410 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260806 09:16:57.882755 23306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:16:57.870774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:44255 (local address 127.10.255.66:47011)
0806 09:16:57.872842 (+ 2068us) negotiation.cc:107] Waiting for socket to connect
0806 09:16:57.872859 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 09:16:57.873087 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:16:57.873455 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:16:57.873460 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:16:57.873493 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:16:57.874649 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:16:57.874662 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.876291 (+ 1629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.876297 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:16:57.878950 (+ 2653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:16:57.878965 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.880885 (+ 1920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.880896 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:16:57.881094 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:16:57.881122 (+ 28us) client_negotiation.cc:769] Sending connection context
0806 09:16:57.881240 (+ 118us) client_negotiation.cc:240] Negotiation successful
0806 09:16:57.881383 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1926,"mutex_wait_us":20,"spinlock_wait_cycles":1792,"thread_start_us":1365,"threads_started":1}
I20260806 09:16:57.883422 22951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2462136af48f4987b803cfdc0593c7c2" candidate_uuid: "f3aa60467cbf47b3b32cef3bb0640720" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c158a53f51d94c5980aeb5faccb6c785" is_pre_election: true
I20260806 09:16:57.884442 22951 raft_consensus.cc:2454] T 2462136af48f4987b803cfdc0593c7c2 P c158a53f51d94c5980aeb5faccb6c785 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3aa60467cbf47b3b32cef3bb0640720 in term 0.
I20260806 09:16:57.884364 23232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2462136af48f4987b803cfdc0593c7c2" candidate_uuid: "f3aa60467cbf47b3b32cef3bb0640720" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad61144021c47ecac64c18790f429ef" is_pre_election: true
I20260806 09:16:57.885159 23232 raft_consensus.cc:2454] T 2462136af48f4987b803cfdc0593c7c2 P 5ad61144021c47ecac64c18790f429ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3aa60467cbf47b3b32cef3bb0640720 in term 0.
I20260806 09:16:57.885493 23029 leader_election.cc:302] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c158a53f51d94c5980aeb5faccb6c785, f3aa60467cbf47b3b32cef3bb0640720; no voters:
I20260806 09:16:57.886130 23303 raft_consensus.cc:2781] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:16:57.886409 23303 raft_consensus.cc:482] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:16:57.886592 23303 raft_consensus.cc:3037] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:16:57.890185 23303 raft_consensus.cc:504] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad61144021c47ecac64c18790f429ef" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 44255 } } peers { permanent_uuid: "c158a53f51d94c5980aeb5faccb6c785" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35499 } } peers { permanent_uuid: "f3aa60467cbf47b3b32cef3bb0640720" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 41153 } }
I20260806 09:16:57.891299 23303 leader_election.cc:288] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720 [CANDIDATE]: Term 1 election: Requested vote from peers 5ad61144021c47ecac64c18790f429ef (127.10.255.67:44255), c158a53f51d94c5980aeb5faccb6c785 (127.10.255.65:35499)
I20260806 09:16:57.892027 23232 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2462136af48f4987b803cfdc0593c7c2" candidate_uuid: "f3aa60467cbf47b3b32cef3bb0640720" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ad61144021c47ecac64c18790f429ef"
I20260806 09:16:57.892176 22951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2462136af48f4987b803cfdc0593c7c2" candidate_uuid: "f3aa60467cbf47b3b32cef3bb0640720" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c158a53f51d94c5980aeb5faccb6c785"
I20260806 09:16:57.892382 23232 raft_consensus.cc:3037] T 2462136af48f4987b803cfdc0593c7c2 P 5ad61144021c47ecac64c18790f429ef [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:16:57.892503 22951 raft_consensus.cc:3037] T 2462136af48f4987b803cfdc0593c7c2 P c158a53f51d94c5980aeb5faccb6c785 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:16:57.895696 22951 raft_consensus.cc:2454] T 2462136af48f4987b803cfdc0593c7c2 P c158a53f51d94c5980aeb5faccb6c785 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3aa60467cbf47b3b32cef3bb0640720 in term 1.
I20260806 09:16:57.895749 23232 raft_consensus.cc:2454] T 2462136af48f4987b803cfdc0593c7c2 P 5ad61144021c47ecac64c18790f429ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3aa60467cbf47b3b32cef3bb0640720 in term 1.
I20260806 09:16:57.896354 23029 leader_election.cc:302] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c158a53f51d94c5980aeb5faccb6c785, f3aa60467cbf47b3b32cef3bb0640720; no voters:
I20260806 09:16:57.896835 23303 raft_consensus.cc:2781] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:16:57.898425 23303 raft_consensus.cc:686] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720 [term 1 LEADER]: Becoming Leader. State: Replica: f3aa60467cbf47b3b32cef3bb0640720, State: Running, Role: LEADER
I20260806 09:16:57.899286 23303 consensus_queue.cc:237] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad61144021c47ecac64c18790f429ef" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 44255 } } peers { permanent_uuid: "c158a53f51d94c5980aeb5faccb6c785" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35499 } } peers { permanent_uuid: "f3aa60467cbf47b3b32cef3bb0640720" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 41153 } }
I20260806 09:16:57.906613 22779 catalog_manager.cc:5495] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720 reported cstate change: term changed from 0 to 1, leader changed from <none> to f3aa60467cbf47b3b32cef3bb0640720 (127.10.255.66). New cstate: current_term: 1 leader_uuid: "f3aa60467cbf47b3b32cef3bb0640720" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ad61144021c47ecac64c18790f429ef" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 44255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c158a53f51d94c5980aeb5faccb6c785" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3aa60467cbf47b3b32cef3bb0640720" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 41153 } health_report { overall_health: HEALTHY } } }
I20260806 09:16:57.937537 23291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:16:57.930288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54680 (local address 127.10.255.66:41153)
0806 09:16:57.930534 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0806 09:16:57.930539 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:16:57.930555 (+ 16us) server_negotiation.cc:407] Connection header received
0806 09:16:57.930650 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:16:57.930655 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:16:57.930749 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:16:57.930918 (+ 169us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:16:57.931475 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.932668 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.934561 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:57.935152 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:57.935306 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:16:57.936067 (+ 761us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:16:57.936707 (+ 640us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:16:57.936881 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0806 09:16:57.937014 (+ 133us) server_negotiation.cc:299] Negotiation successful
0806 09:16:57.937106 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 09:16:57.950253 22951 raft_consensus.cc:1261] T 2462136af48f4987b803cfdc0593c7c2 P c158a53f51d94c5980aeb5faccb6c785 [term 1 FOLLOWER]: Refusing update from remote peer f3aa60467cbf47b3b32cef3bb0640720: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:16:57.950290 23232 raft_consensus.cc:1261] T 2462136af48f4987b803cfdc0593c7c2 P 5ad61144021c47ecac64c18790f429ef [term 1 FOLLOWER]: Refusing update from remote peer f3aa60467cbf47b3b32cef3bb0640720: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:16:57.951582 23307 consensus_queue.cc:1035] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ad61144021c47ecac64c18790f429ef" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 44255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260806 09:16:57.952404 23303 consensus_queue.cc:1035] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c158a53f51d94c5980aeb5faccb6c785" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:16:57.969839 23310 mvcc.cc:205] Tried to move back new op lower bound from 7315488022310309888 to 7315488022121058304. Current Snapshot: MvccSnapshot[applied={T|T < 7315488022310309888}]
I20260806 09:16:57.992700 22779 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50798:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:16:57.993144 22779 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50798:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:16:57.998528 22779 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e68789a240c14ad48010c19b39462cb4: Sending DeleteTablet for 3 replicas of tablet 2462136af48f4987b803cfdc0593c7c2
I20260806 09:16:58.000195 23211 tablet_service.cc:1514] Processing DeleteTablet for tablet 2462136af48f4987b803cfdc0593c7c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:16:57 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:49194
I20260806 09:16:58.000541 22930 tablet_service.cc:1514] Processing DeleteTablet for tablet 2462136af48f4987b803cfdc0593c7c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:16:57 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:43920
I20260806 09:16:58.000469 23075 tablet_service.cc:1514] Processing DeleteTablet for tablet 2462136af48f4987b803cfdc0593c7c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:16:57 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:54666
I20260806 09:16:58.002686 23320 tablet_replica.cc:330] T 2462136af48f4987b803cfdc0593c7c2 P 5ad61144021c47ecac64c18790f429ef: stopping tablet replica
I20260806 09:16:58.003331 23320 raft_consensus.cc:2229] T 2462136af48f4987b803cfdc0593c7c2 P 5ad61144021c47ecac64c18790f429ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:16:58.004007 23320 raft_consensus.cc:2258] T 2462136af48f4987b803cfdc0593c7c2 P 5ad61144021c47ecac64c18790f429ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:16:58.005206 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 22861
I20260806 09:16:58.006475 23320 ts_tablet_manager.cc:1905] T 2462136af48f4987b803cfdc0593c7c2 P 5ad61144021c47ecac64c18790f429ef: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:16:58.010537 23322 tablet_replica.cc:330] T 2462136af48f4987b803cfdc0593c7c2 P c158a53f51d94c5980aeb5faccb6c785: stopping tablet replica
I20260806 09:16:58.011061 23322 raft_consensus.cc:2229] T 2462136af48f4987b803cfdc0593c7c2 P c158a53f51d94c5980aeb5faccb6c785 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:16:58.011801 23322 raft_consensus.cc:2258] T 2462136af48f4987b803cfdc0593c7c2 P c158a53f51d94c5980aeb5faccb6c785 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:16:58.014518 23320 ts_tablet_manager.cc:1918] T 2462136af48f4987b803cfdc0593c7c2 P 5ad61144021c47ecac64c18790f429ef: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:16:58.014849 23320 log.cc:1196] T 2462136af48f4987b803cfdc0593c7c2 P 5ad61144021c47ecac64c18790f429ef: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/2462136af48f4987b803cfdc0593c7c2
I20260806 09:16:58.014972 23322 ts_tablet_manager.cc:1905] T 2462136af48f4987b803cfdc0593c7c2 P c158a53f51d94c5980aeb5faccb6c785: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:16:58.015409 23320 ts_tablet_manager.cc:1939] T 2462136af48f4987b803cfdc0593c7c2 P 5ad61144021c47ecac64c18790f429ef: Deleting consensus metadata
I20260806 09:16:58.017740 22768 catalog_manager.cc:4841] TS 5ad61144021c47ecac64c18790f429ef (127.10.255.67:44255): tablet 2462136af48f4987b803cfdc0593c7c2 (table test-table [id=683a5ce2bbd34b53b712eadf39c38bdd]) successfully deleted
I20260806 09:16:58.024905 23321 tablet_replica.cc:330] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720: stopping tablet replica
I20260806 09:16:58.025475 23321 raft_consensus.cc:2229] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720 [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:16:58.026697 23321 raft_consensus.cc:2258] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:16:58.028146 23322 ts_tablet_manager.cc:1918] T 2462136af48f4987b803cfdc0593c7c2 P c158a53f51d94c5980aeb5faccb6c785: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:16:58.028501 23322 log.cc:1196] T 2462136af48f4987b803cfdc0593c7c2 P c158a53f51d94c5980aeb5faccb6c785: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-0/wal/wals/2462136af48f4987b803cfdc0593c7c2
I20260806 09:16:58.029170 23321 ts_tablet_manager.cc:1905] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:16:58.029358 23322 ts_tablet_manager.cc:1939] T 2462136af48f4987b803cfdc0593c7c2 P c158a53f51d94c5980aeb5faccb6c785: Deleting consensus metadata
I20260806 09:16:58.032119 22766 catalog_manager.cc:4841] TS c158a53f51d94c5980aeb5faccb6c785 (127.10.255.65:35499): tablet 2462136af48f4987b803cfdc0593c7c2 (table test-table [id=683a5ce2bbd34b53b712eadf39c38bdd]) successfully deleted
Aug 06 09:16:58 dist-test-slave-mvvj krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007812, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.65@KRBTEST.COM
I20260806 09:16:58.040076 23321 ts_tablet_manager.cc:1918] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:16:58.040460 23321 log.cc:1196] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/2462136af48f4987b803cfdc0593c7c2
I20260806 09:16:58.041396 23321 ts_tablet_manager.cc:1939] T 2462136af48f4987b803cfdc0593c7c2 P f3aa60467cbf47b3b32cef3bb0640720: Deleting consensus metadata
I20260806 09:16:58.043574 22767 catalog_manager.cc:4841] TS f3aa60467cbf47b3b32cef3bb0640720 (127.10.255.66:41153): tablet 2462136af48f4987b803cfdc0593c7c2 (table test-table [id=683a5ce2bbd34b53b712eadf39c38bdd]) successfully deleted
I20260806 09:16:58.048780 23294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:16:58.006869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43936 (local address 127.10.255.65:35499)
0806 09:16:58.007135 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0806 09:16:58.007144 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:16:58.019640 (+ 12496us) server_negotiation.cc:407] Connection header received
0806 09:16:58.019952 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:16:58.019961 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:16:58.020064 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:16:58.020216 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:16:58.023600 (+ 3384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:58.025311 (+ 1711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:58.028859 (+ 3548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:58.029533 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:58.029667 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:16:58.037900 (+ 8233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:16:58.037926 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:16:58.037949 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:16:58.038007 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:16:58.044434 (+ 6427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:16:58.045532 (+ 1098us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:16:58.045543 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:16:58.045547 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:16:58.045715 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:16:58.046260 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:16:58.046266 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:16:58.046270 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:16:58.046940 (+ 670us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:16:58.047439 (+ 499us) server_negotiation.cc:1035] Waiting for connection context
0806 09:16:58.047679 (+ 240us) server_negotiation.cc:299] Negotiation successful
0806 09:16:58.048159 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 09:16:58.049983 22991 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:16:58.151006 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 22861
I20260806 09:16:58.171021 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 23002
Aug 06 09:16:58 dist-test-slave-mvvj krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007812, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.66@KRBTEST.COM
I20260806 09:16:58.189075 23291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:16:58.171870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54684 (local address 127.10.255.66:41153)
0806 09:16:58.172057 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0806 09:16:58.172065 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:16:58.172088 (+ 23us) server_negotiation.cc:407] Connection header received
0806 09:16:58.172311 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:16:58.172318 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:16:58.172403 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:16:58.172522 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:16:58.173903 (+ 1381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:58.174762 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:58.176221 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:58.177007 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:58.177177 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:16:58.181922 (+ 4745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:16:58.181935 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:16:58.181951 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:16:58.181989 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:16:58.185460 (+ 3471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:16:58.186299 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:16:58.186307 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:16:58.186310 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:16:58.186594 (+ 284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:16:58.187020 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:16:58.187025 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:16:58.187027 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:16:58.187415 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:16:58.187964 (+ 549us) server_negotiation.cc:1035] Waiting for connection context
0806 09:16:58.188232 (+ 268us) server_negotiation.cc:299] Negotiation successful
0806 09:16:58.188579 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 09:16:58.189934 23137 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:16:58.309186 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 23002
I20260806 09:16:58.332369 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 23148
Aug 06 09:16:58 dist-test-slave-mvvj krb5kdc[22301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007812, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.67@KRBTEST.COM
I20260806 09:16:58.349359 23293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:16:58.333121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49202 (local address 127.10.255.67:44255)
0806 09:16:58.333294 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 09:16:58.333299 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:16:58.333336 (+ 37us) server_negotiation.cc:407] Connection header received
0806 09:16:58.333549 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:16:58.333553 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:16:58.333624 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:16:58.333714 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:16:58.335088 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:58.335903 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:58.337348 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:16:58.337810 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:16:58.337933 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:16:58.342583 (+ 4650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:16:58.342603 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:16:58.342620 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:16:58.342665 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:16:58.346365 (+ 3700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:16:58.347159 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:16:58.347167 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:16:58.347170 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:16:58.347302 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:16:58.347734 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:16:58.347739 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:16:58.347741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:16:58.348268 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:16:58.348579 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0806 09:16:58.348898 (+ 319us) server_negotiation.cc:299] Negotiation successful
0806 09:16:58.349098 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 09:16:58.350407 23272 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:16:58.445338 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 23148
I20260806 09:16:58.463600 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 22749
I20260806 09:16:58.464972 22811 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:16:58.583945 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 22749
I20260806 09:16:58.608901 11261 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 09:16:58.956003 11261 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 09:16:58.956318 11261 mini_ranger.cc:66] Stopping Ranger...
I20260806 09:16:59.303649 11261 mini_ranger.cc:68] Stopped Ranger
2026-08-06 09:16:59.304 UTC [22332] LOG: received smart shutdown request
2026-08-06 09:16:59.309 UTC [22332] LOG: background worker "logical replication launcher" (PID 22341) exited with exit code 1
2026-08-06 09:16:59.309 UTC [22336] LOG: shutting down
2026-08-06 09:16:59.532 UTC [22332] LOG: database system is shut down
2026-08-06T09:16:59Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (59908 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:16:59 dist-test-slave-mvvj krb5kdc[23336](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:16:59 dist-test-slave-mvvj krb5kdc[23336](info): set up 2 sockets
Aug 06 09:16:59 dist-test-slave-mvvj krb5kdc[23336](info): commencing operation
krb5kdc: starting...
W20260806 09:17:00.830716 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.003s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:17:01 dist-test-slave-mvvj krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007821, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:17:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:17:01Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.10.255.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.10.255.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.10.255.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/rangeradmin_127.10.255.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.10.255.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/rangeradmin_127.10.255.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.10.255.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.10.255.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.10.255.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/rangerlookup_127.10.255.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.10.255.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/rangerlookup_127.10.255.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.255.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.10.255.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.255.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/HTTP_127.10.255.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.255.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/HTTP_127.10.255.84@KRBTEST.COM.keytab.
I20260806 09:17:01.220640 11261 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-task5qcP_A/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/postgres -l logfile start
2026-08-06 09:17:04.290 UTC [23366] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 09:17:04.290 UTC [23366] LOG: listening on IPv4 address "127.10.255.84", port 55053
2026-08-06 09:17:04.294 UTC [23366] LOG: listening on Unix socket "/tmp/.s.PGSQL.55053"
2026-08-06 09:17:04.321 UTC [23370] LOG: database system was shut down at 2026-08-06 09:17:02 UTC
2026-08-06 09:17:04.325 UTC [23366] LOG: database system is ready to accept connections
I20260806 09:17:05.346719 11261 mini_postgres.cc:96] Postgres bound to 55053
2026-08-06 09:17:05.367 UTC [23378] FATAL: database "slave" does not exist
127.10.255.84:55053 - accepting connections
I20260806 09:17:05.368772 11261 mini_ranger.cc:161] Starting Ranger...
I20260806 09:17:05.401234 11261 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 09:17:06.038002 11261 mini_ranger.cc:87] Created ranger Postgres database
I20260806 09:17:06.038151 11261 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ranger-admin
2026-08-06 09:17:06,348 [I] DB FLAVOR :POSTGRES
2026-08-06 09:17:06,348 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 09:17:06,348 [I] Checking connection..
2026-08-06 09:17:06,349 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:55053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 09:17:06,642 [I] Checking connection passed.
2026-08-06 09:17:06,642 [I] --------- Verifying version history table ---------
2026-08-06 09:17:06,642 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:55053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 09:17:06,911 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 09:17:06,912 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:55053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 09:17:07,177 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 09:17:07,177 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 09:17:07,177 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:55053/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 09:17:07.430 UTC [23442] WARNING: there is no transaction in progress
2026-08-06 09:17:07,438 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 09:17:07,439 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:55053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 09:17:07,726 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 09:17:07,727 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 09:17:07,727 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:55053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 09:17:07,981 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:55053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 09:17:08,259 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:55053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-mvvj.c.gcp-upstream.internal','N') ;"
2026-08-06 09:17:08,512 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:55053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 09:17:08,778 [I] Table x_portal_user does not exist in database ranger
2026-08-06 09:17:08,778 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:55053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 09:17:09,065 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 09:17:09,066 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:55053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 09:17:09,337 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:55053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 09:17:09,623 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 09:17:09,623 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:55053/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 09:17:10.845 UTC [23551] WARNING: there is no transaction in progress
2026-08-06 09:17:10.866 UTC [23551] WARNING: there is no transaction in progress
2026-08-06 09:17:10.887 UTC [23551] WARNING: there is no transaction in progress
2026-08-06 09:17:10.906 UTC [23551] WARNING: there is no transaction in progress
2026-08-06 09:17:10.930 UTC [23551] WARNING: there is no transaction in progress
2026-08-06 09:17:10.953 UTC [23551] WARNING: there is no transaction in progress
2026-08-06 09:17:11.024 UTC [23551] WARNING: there is no transaction in progress
2026-08-06 09:17:11.033 UTC [23551] WARNING: there is no transaction in progress
2026-08-06 09:17:11.052 UTC [23551] WARNING: there is no transaction in progress
2026-08-06 09:17:11.065 UTC [23551] WARNING: there is no transaction in progress
2026-08-06 09:17:11.077 UTC [23551] WARNING: there is no transaction in progress
2026-08-06 09:17:11.094 UTC [23551] WARNING: there is no transaction in progress
2026-08-06 09:17:11.106 UTC [23551] WARNING: there is no transaction in progress
2026-08-06 09:17:11.116 UTC [23551] WARNING: there is no transaction in progress
2026-08-06 09:17:11.127 UTC [23551] WARNING: there is no transaction in progress
2026-08-06 09:17:11.137 UTC [23551] WARNING: there is no transaction in progress
2026-08-06 09:17:12,038 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 09:17:12,038 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:55053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 09:17:12,296 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 09:17:12,296 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:55053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 09:17:12,561 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 09:17:12,561 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:55053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 09:17:12,845 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 09:17:12,845 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:55053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 09:17:13,102 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:55053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 09:17:13,372 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:55053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-mvvj.c.gcp-upstream.internal';"
2026-08-06 09:17:13,646 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 09:17:13,647 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:55053/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 09:17:13,918 [I] DB_PATCHES have already been applied
I20260806 09:17:13.926095 11261 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ranger-admin:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-task5qcP_A/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 09:17:13.926244 11261 mini_ranger.cc:193] Using host: 127.10.255.84
I20260806 09:17:13.944780 11261 mini_ranger.cc:227] Ranger admin URL: http://127.10.255.84:60161
Aug 06, 2026 9:17:14 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 9:17:14 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 9:17:14 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 9:17:14 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 9:17:14 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 9:17:14 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 9:17:14 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 09:17:15.120379 11261 mini_ranger.cc:160] Time spent starting Ranger: real 9.752s user 0.002s sys 0.047s
Aug 06, 2026 9:17:38 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 9:17:38 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 06, 2026 9:17:38 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 9:17:38 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 9:17:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 9:17:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 9:17:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 9:17:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 9:17:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 9:17:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 9:17:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 9:17:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 9:17:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 9:17:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 9:17:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 9:17:38 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 9:17:38 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 9:17:39 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 09:17:40.193080 11261 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.10.255.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.10.255.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.10.255.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/rangerkms_127.10.255.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.10.255.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/rangerkms_127.10.255.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.255.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.10.255.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.255.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/HTTP_127.10.255.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.255.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/HTTP_127.10.255.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 09:17:40 dist-test-slave-mvvj krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007860, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 09:17:40.402853 11261 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 09:17:40.431361 11261 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 09:17:41.537626 11261 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 09:17:41.537734 11261 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ranger-kms
I20260806 09:17:41.537767 11261 mini_ranger_kms.cc:227] Using postgres at 127.10.255.84:55053
2026-08-06 09:17:41,949 [I] DB FLAVOR :POSTGRES
2026-08-06 09:17:41,950 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 09:17:41,950 [I] Checking connection
2026-08-06 09:17:41,950 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:55053/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 09:17:42,231 [I] connection success
2026-08-06 09:17:42,231 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 09:17:42,231 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 09:17:42,231 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:55053/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 09:17:42,528 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 09:17:42,528 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 09:17:42,529 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 09:17:42,529 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.255.84:55053/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 09:17:42,849 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 09:17:43.443884 11261 mini_ranger_kms.cc:310] Created kms service
I20260806 09:17:43.627154 11261 mini_ranger_kms.cc:326] Created kudu user
I20260806 09:17:43.682531 11261 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 09:17:43 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007860, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.10.255.84@KRBTEST.COM
I20260806 09:17:44.123427 11261 mini_ranger_kms.cc:384] Added ranger policy
I20260806 09:17:44.123775 11261 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ranger-kms:/tmp/dist-test-task5qcP_A/build/asan/bin/postgresql.jar:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-task5qcP_A/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 09:17:44.123816 11261 mini_ranger_kms.cc:240] Using host: 127.10.255.84
I20260806 09:17:44.146250 11261 mini_ranger_kms.cc:276] Ranger KMS PID: 23734
I20260806 09:17:44.146430 11261 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.10.255.84:36479
Aug 06, 2026 9:17:45 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 9:17:45 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 9:17:45 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 9:17:45 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 9:17:45 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 9:17:45 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260806 09:17:46.694657 11261 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.292s user 0.069s sys 0.364s
I20260806 09:17:46.694962 11261 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 09:17:46.695187 11261 mini_ranger_kms.cc:401] 127.10.255.84:36479/kms/v1/keys
Aug 06 09:17:46 dist-test-slave-mvvj krb5kdc[23336](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786007866, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.255.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 06 09:17:47 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007866, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.255.84@KRBTEST.COM for HTTP/127.10.255.84@KRBTEST.COM
Aug 06 09:17:47 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007866, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.255.84@KRBTEST.COM for HTTP/127.10.255.84@KRBTEST.COM
Aug 06 09:17:50 dist-test-slave-mvvj krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:17:50.252903 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:46817
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:45233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:46817
--ranger_config_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.255.84:36479/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:17:50.627324 23785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:17:50.627714 23785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:17:50.627812 23785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:17:50.635577 23785 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:17:50.635768 23785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:17:50.635901 23785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:17:50.636010 23785 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:17:50.636093 23785 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:17:50.647593 23785 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:45233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/wal
--ranger_kms_url=127.10.255.84:36479/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:46817
--ranger_config_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:46817
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:17:50.649122 23785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:17:50.650628 23785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:17:50.664218 23790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:17:50.664179 23792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:17:50.664143 23794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:17:50.665191 23785 server_base.cc:1034] running on GCE node
I20260806 09:17:50.666142 23785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:17:50.667809 23785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:17:50.669147 23785 hybrid_clock.cc:648] HybridClock initialized: now 1786007870669096 us; error 43 us; skew 500 ppm
I20260806 09:17:50.669613 23785 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:17:50 dist-test-slave-mvvj krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007870, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:17:50.673552 23785 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:17:50.675310 23785 webserver.cc:460] Webserver started at http://127.10.255.126:36885/ using document root <none> and password file <none>
I20260806 09:17:50.676162 23785 fs_manager.cc:359] Metadata directory not provided
I20260806 09:17:50.676319 23785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:17:50.676667 23785 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 09:17:50 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007870, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for HTTP/127.10.255.84@KRBTEST.COM
I20260806 09:17:50.744918 23785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "3e7d277dafe14df2bf41274df5e85e73"
format_stamp: "Formatted at 2026-08-06 09:17:50 on dist-test-slave-mvvj"
server_key: "5fb998ca29da4d1fa2508c291a5dc923"
server_key_iv: "0bb68e60ab8c005384b24e987ff39222"
server_key_version: "kuduclusterkey@0"
I20260806 09:17:50.746008 23785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "3e7d277dafe14df2bf41274df5e85e73"
format_stamp: "Formatted at 2026-08-06 09:17:50 on dist-test-slave-mvvj"
server_key: "5fb998ca29da4d1fa2508c291a5dc923"
server_key_iv: "0bb68e60ab8c005384b24e987ff39222"
server_key_version: "kuduclusterkey@0"
I20260806 09:17:50.752702 23785 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260806 09:17:50.771102 23801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:17:50.772809 23785 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:17:50.773051 23785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "3e7d277dafe14df2bf41274df5e85e73"
format_stamp: "Formatted at 2026-08-06 09:17:50 on dist-test-slave-mvvj"
server_key: "5fb998ca29da4d1fa2508c291a5dc923"
server_key_iv: "0bb68e60ab8c005384b24e987ff39222"
server_key_version: "kuduclusterkey@0"
I20260806 09:17:50.773309 23785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:17:50.796465 23785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:17:50.801298 23785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:17:50.801684 23785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:17:50.823333 23785 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:46817
I20260806 09:17:50.823387 23852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:46817 every 8 connection(s)
I20260806 09:17:50.824949 23785 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:17:50.829193 23853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:17:50.832310 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 23785
I20260806 09:17:50.832543 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:17:50.833288 11261 external_mini_cluster.cc:1428] Setting key 7593b2e003f06735887aa6033077e309
I20260806 09:17:50.842038 23853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73: Bootstrap starting.
I20260806 09:17:50.846854 23853 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73: Neither blocks nor log segments found. Creating new log.
I20260806 09:17:50.848495 23853 log.cc:824] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73: Log is configured to *not* fsync() on all Append() calls
Aug 06 09:17:50 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:17:50.852079 23853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73: No bootstrap required, opened a new log
I20260806 09:17:50.859645 23856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:50.835459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57804 (local address 127.10.255.126:46817)
0806 09:17:50.836397 (+ 938us) server_negotiation.cc:206] Beginning negotiation
0806 09:17:50.836410 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 09:17:50.836454 (+ 44us) server_negotiation.cc:407] Connection header received
0806 09:17:50.838297 (+ 1843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:17:50.838321 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:17:50.838862 (+ 541us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:17:50.839321 (+ 459us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:17:50.840792 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:50.842134 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:50.844555 (+ 2421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:50.845338 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:50.845531 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:50.850693 (+ 5162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:17:50.850701 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:17:50.850718 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:17:50.850761 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:17:50.854197 (+ 3436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:50.855420 (+ 1223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:50.855429 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:50.855440 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:50.855655 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:50.856173 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:50.856177 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:50.856179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:50.856880 (+ 701us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:17:50.857337 (+ 457us) server_negotiation.cc:1035] Waiting for connection context
0806 09:17:50.857841 (+ 504us) server_negotiation.cc:299] Negotiation successful
0806 09:17:50.858364 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":699,"thread_start_us":448,"threads_started":1}
I20260806 09:17:50.862123 23853 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7d277dafe14df2bf41274df5e85e73" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 46817 } }
I20260806 09:17:50.862633 23853 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:17:50.862761 23853 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e7d277dafe14df2bf41274df5e85e73, State: Initialized, Role: FOLLOWER
I20260806 09:17:50.863478 23853 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7d277dafe14df2bf41274df5e85e73" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 46817 } }
I20260806 09:17:50.863783 23853 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:17:50.863987 23853 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:17:50.864142 23853 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:17:50.866529 23853 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7d277dafe14df2bf41274df5e85e73" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 46817 } }
I20260806 09:17:50.867138 23853 leader_election.cc:302] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e7d277dafe14df2bf41274df5e85e73; no voters:
I20260806 09:17:50.867870 23853 leader_election.cc:288] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:17:50.868217 23858 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:17:50.870832 23853 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:17:50.872200 23858 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [term 1 LEADER]: Becoming Leader. State: Replica: 3e7d277dafe14df2bf41274df5e85e73, State: Running, Role: LEADER
I20260806 09:17:50.873054 23858 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7d277dafe14df2bf41274df5e85e73" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 46817 } }
I20260806 09:17:50.877529 23860 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e7d277dafe14df2bf41274df5e85e73. Latest consensus state: current_term: 1 leader_uuid: "3e7d277dafe14df2bf41274df5e85e73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7d277dafe14df2bf41274df5e85e73" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 46817 } } }
I20260806 09:17:50.878052 23860 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [sys.catalog]: This master's current role is: LEADER
I20260806 09:17:50.877497 23859 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3e7d277dafe14df2bf41274df5e85e73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7d277dafe14df2bf41274df5e85e73" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 46817 } } }
I20260806 09:17:50.878875 23859 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [sys.catalog]: This master's current role is: LEADER
I20260806 09:17:50.881240 23870 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:17:50.887636 23870 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:17:50.888568 23853 ranger_client.cc:318] Using new properties file: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 09:17:50.911852 23870 catalog_manager.cc:1347] Generated new cluster ID: 15f89b3ce4d3424c9b6027c4a58153f1
I20260806 09:17:50.912181 23870 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:17:50.934913 23870 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:17:50.936648 23870 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:17:50.944839 23870 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73: Generated new TSK 0
I20260806 09:17:50.945909 23870 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.255.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
I20260806 09:17:51.837208 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.255.84:36479/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:46817
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:45233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 09:17:52 dist-test-slave-mvvj krb5kdc[23336](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786007872, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260806 09:17:52.313409 23899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:17:52.313843 23899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:17:52.314091 23899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:17:52.326825 23899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:17:52.327000 23899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:17:52.327257 23899 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:17:52.343731 23899 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:45233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.10.255.84:36479/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:46817
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:17:52.345799 23899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:17:52.347868 23899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:17:52.369088 23909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:17:52.370385 23910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:17:52.373917 23912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:17:52.374393 23899 server_base.cc:1034] running on GCE node
I20260806 09:17:52.375252 23899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:17:52.376530 23899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:17:52.377782 23899 hybrid_clock.cc:648] HybridClock initialized: now 1786007872377724 us; error 49 us; skew 500 ppm
I20260806 09:17:52.378190 23899 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:17:52 dist-test-slave-mvvj krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007872, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:17:52.381896 23899 init.cc:377] Logged in from keytab as kudu/127.10.255.65@KRBTEST.COM (short username kudu)
I20260806 09:17:52.383780 23899 webserver.cc:460] Webserver started at http://127.10.255.65:42577/ using document root <none> and password file <none>
I20260806 09:17:52.384693 23899 fs_manager.cc:359] Metadata directory not provided
I20260806 09:17:52.384836 23899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:17:52.385206 23899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 09:17:52 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007872, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for HTTP/127.10.255.84@KRBTEST.COM
I20260806 09:17:52.407935 23899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "094e9e60830c4728ac4c952eb95ef736"
format_stamp: "Formatted at 2026-08-06 09:17:52 on dist-test-slave-mvvj"
server_key: "056c3941a1d953dfb339e413a08c37eb"
server_key_iv: "206a88e4bce9a12f36b8868bd0bebb4c"
server_key_version: "kuduclusterkey@0"
I20260806 09:17:52.409431 23899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "094e9e60830c4728ac4c952eb95ef736"
format_stamp: "Formatted at 2026-08-06 09:17:52 on dist-test-slave-mvvj"
server_key: "056c3941a1d953dfb339e413a08c37eb"
server_key_iv: "206a88e4bce9a12f36b8868bd0bebb4c"
server_key_version: "kuduclusterkey@0"
I20260806 09:17:52.435775 23899 fs_manager.cc:691] Time spent creating directory manager: real 0.026s user 0.004s sys 0.020s
I20260806 09:17:52.471686 23919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:17:52.475630 23899 fs_manager.cc:725] Time spent opening block manager: real 0.017s user 0.007s sys 0.005s
I20260806 09:17:52.475971 23899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "094e9e60830c4728ac4c952eb95ef736"
format_stamp: "Formatted at 2026-08-06 09:17:52 on dist-test-slave-mvvj"
server_key: "056c3941a1d953dfb339e413a08c37eb"
server_key_iv: "206a88e4bce9a12f36b8868bd0bebb4c"
server_key_version: "kuduclusterkey@0"
I20260806 09:17:52.476372 23899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:17:52.531613 23899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:17:52.538031 23899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:17:52.538576 23899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:17:52.541427 23899 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:17:52.544999 23899 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:17:52.545353 23899 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260806 09:17:52.545599 23899 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:17:52.545754 23899 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 09:17:52 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007872, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for HTTP/127.10.255.84@KRBTEST.COM
I20260806 09:17:52.673043 23899 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:43745
I20260806 09:17:52.673485 24033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:43745 every 8 connection(s)
I20260806 09:17:52.675102 23899 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:17:52.679423 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 23899
I20260806 09:17:52.679685 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:17:52.680516 11261 external_mini_cluster.cc:1428] Setting key 2f46136b8bf379f59913ce398aa61dc1
Aug 06 09:17:52 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007872, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.255.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.66@KRBTEST.COM" created.
I20260806 09:17:52.752408 24037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:52.679358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:46817 (local address 127.10.255.65:40791)
0806 09:17:52.692694 (+ 13336us) negotiation.cc:107] Waiting for socket to connect
0806 09:17:52.692777 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0806 09:17:52.696271 (+ 3494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:17:52.708740 (+ 12469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:17:52.708757 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:17:52.709596 (+ 839us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:17:52.710581 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:17:52.710613 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:17:52.720928 (+ 10315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:17:52.720937 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:17:52.723369 (+ 2432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:17:52.723412 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:17:52.724777 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:17:52.724787 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:17:52.725117 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:52.726078 (+ 961us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:17:52.726115 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:17:52.729172 (+ 3057us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:17:52.736406 (+ 7234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:17:52.736420 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:17:52.736445 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:17:52.737236 (+ 791us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:17:52.737871 (+ 635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:17:52.737876 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:17:52.737880 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:17:52.738254 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:17:52.739145 (+ 891us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:17:52.739156 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:17:52.739727 (+ 571us) client_negotiation.cc:769] Sending connection context
0806 09:17:52.740144 (+ 417us) client_negotiation.cc:240] Negotiation successful
0806 09:17:52.740866 (+ 722us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12928,"thread_start_us":12621,"threads_started":1}
I20260806 09:17:52.755026 24038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:52.680094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:40791 (local address 127.10.255.126:46817)
0806 09:17:52.707804 (+ 27710us) server_negotiation.cc:206] Beginning negotiation
0806 09:17:52.707812 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:17:52.707867 (+ 55us) server_negotiation.cc:407] Connection header received
0806 09:17:52.707964 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:17:52.707973 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:17:52.708115 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:17:52.708280 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:17:52.719354 (+ 11074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:52.720601 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:52.723733 (+ 3132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:52.724431 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:52.729598 (+ 5167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:52.729946 (+ 348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:17:52.729953 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:17:52.729958 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:17:52.729997 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:17:52.736117 (+ 6120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:52.737490 (+ 1373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:52.737497 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:52.737502 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:52.737706 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:52.738477 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:52.738483 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:52.738487 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:52.738944 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:17:52.754080 (+ 15136us) server_negotiation.cc:1035] Waiting for connection context
0806 09:17:52.754303 (+ 223us) server_negotiation.cc:299] Negotiation successful
0806 09:17:52.754606 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27513,"thread_start_us":28340,"threads_started":1}
I20260806 09:17:52.757524 24034 heartbeater.cc:347] Connected to a master server at 127.10.255.126:46817
I20260806 09:17:52.757897 24034 heartbeater.cc:464] Registering TS with master...
I20260806 09:17:52.759002 24034 heartbeater.cc:511] Master 127.10.255.126:46817 requested a full tablet report, sending...
I20260806 09:17:52.762547 23818 ts_manager.cc:194] Registered new tserver with Master: 094e9e60830c4728ac4c952eb95ef736 (127.10.255.65:43745)
I20260806 09:17:52.764988 23818 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.65@KRBTEST.COM'} at 127.10.255.65:40791
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
W20260806 09:17:52.799602 11261 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.10.255.66: real 0.116s user 0.004s sys 0.018s
I20260806 09:17:52.800709 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.255.84:36479/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:46817
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:45233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 09:17:53 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007872, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for HTTP/127.10.255.84@KRBTEST.COM
W20260806 09:17:53.347388 24041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:17:53.347968 24041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:17:53.348173 24041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:17:53.360581 24041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:17:53.360822 24041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:17:53.361088 24041 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:17:53.377970 24041 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:45233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.10.255.84:36479/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:46817
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:17:53.379606 24041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:17:53.381626 24041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:17:53.400130 24050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:17:53.400249 24051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:17:53.406817 24053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:17:53.407064 24041 server_base.cc:1034] running on GCE node
I20260806 09:17:53.407904 24041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:17:53.409181 24041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:17:53.410660 24041 hybrid_clock.cc:648] HybridClock initialized: now 1786007873410627 us; error 86 us; skew 500 ppm
I20260806 09:17:53.411135 24041 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:17:53 dist-test-slave-mvvj krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007873, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:17:53.414695 24041 init.cc:377] Logged in from keytab as kudu/127.10.255.66@KRBTEST.COM (short username kudu)
I20260806 09:17:53.416800 24041 webserver.cc:460] Webserver started at http://127.10.255.66:37175/ using document root <none> and password file <none>
I20260806 09:17:53.417631 24041 fs_manager.cc:359] Metadata directory not provided
I20260806 09:17:53.417775 24041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:17:53.418136 24041 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 09:17:53 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007873, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for HTTP/127.10.255.84@KRBTEST.COM
I20260806 09:17:53.438225 24041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "a3856ff92acd400b93145422605f86e8"
format_stamp: "Formatted at 2026-08-06 09:17:53 on dist-test-slave-mvvj"
server_key: "6f4ec6bae7f64f4e385dc16ff5fadb15"
server_key_iv: "77333004dfc6db6fd9d14169840a2f19"
server_key_version: "kuduclusterkey@0"
I20260806 09:17:53.439713 24041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "a3856ff92acd400b93145422605f86e8"
format_stamp: "Formatted at 2026-08-06 09:17:53 on dist-test-slave-mvvj"
server_key: "6f4ec6bae7f64f4e385dc16ff5fadb15"
server_key_iv: "77333004dfc6db6fd9d14169840a2f19"
server_key_version: "kuduclusterkey@0"
I20260806 09:17:53.448113 24041 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.006s sys 0.001s
I20260806 09:17:53.468732 24065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:17:53.470541 24041 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:17:53.470811 24041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "a3856ff92acd400b93145422605f86e8"
format_stamp: "Formatted at 2026-08-06 09:17:53 on dist-test-slave-mvvj"
server_key: "6f4ec6bae7f64f4e385dc16ff5fadb15"
server_key_iv: "77333004dfc6db6fd9d14169840a2f19"
server_key_version: "kuduclusterkey@0"
I20260806 09:17:53.471092 24041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:17:53.487147 24041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:17:53.491804 24041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:17:53.492216 24041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:17:53.493397 24041 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:17:53.495021 24041 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:17:53.495131 24041 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:17:53.495301 24041 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:17:53.495379 24041 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:17:53.532460 24041 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:32809
I20260806 09:17:53.532513 24179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:32809 every 8 connection(s)
I20260806 09:17:53.533859 24041 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:17:53.534694 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 24041
I20260806 09:17:53.534880 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:17:53.535530 11261 external_mini_cluster.cc:1428] Setting key 4564ec90cddc65641277eb45dfd0f13f
Aug 06 09:17:53 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007873, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:17:53.559299 24182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:53.537542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:54449 (local address 127.10.255.126:46817)
0806 09:17:53.538312 (+ 770us) server_negotiation.cc:206] Beginning negotiation
0806 09:17:53.538317 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:17:53.539565 (+ 1248us) server_negotiation.cc:407] Connection header received
0806 09:17:53.541801 (+ 2236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:17:53.541807 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:17:53.541932 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:17:53.542071 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:17:53.543793 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:53.544642 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:53.546394 (+ 1752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:53.546879 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:53.547034 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:53.551183 (+ 4149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:17:53.551194 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:17:53.551202 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:17:53.551255 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:17:53.555350 (+ 4095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:53.556416 (+ 1066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:53.556425 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:53.556431 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:53.556608 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:53.557050 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:53.557058 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:53.557064 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:53.557528 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:17:53.557705 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0806 09:17:53.558517 (+ 812us) server_negotiation.cc:299] Negotiation successful
0806 09:17:53.558828 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":622,"thread_start_us":471,"threads_started":1}
I20260806 09:17:53.560210 24183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:53.538346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:46817 (local address 127.10.255.66:54449)
0806 09:17:53.539341 (+ 995us) negotiation.cc:107] Waiting for socket to connect
0806 09:17:53.539399 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 09:17:53.541411 (+ 2012us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:17:53.542375 (+ 964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:17:53.542389 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:17:53.542897 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:17:53.543559 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:17:53.543579 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:17:53.544826 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:17:53.544839 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:17:53.546200 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:17:53.546215 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:17:53.547175 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:17:53.547181 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:17:53.547430 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:53.548288 (+ 858us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:17:53.548313 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:17:53.550888 (+ 2575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:17:53.555586 (+ 4698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:17:53.555596 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:17:53.555614 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:17:53.556257 (+ 643us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:17:53.556730 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:17:53.556734 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:17:53.556736 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:17:53.556924 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:17:53.557676 (+ 752us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:17:53.557683 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:17:53.558025 (+ 342us) client_negotiation.cc:769] Sending connection context
0806 09:17:53.558276 (+ 251us) client_negotiation.cc:240] Negotiation successful
0806 09:17:53.558878 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":696,"thread_start_us":445,"threads_started":1}
I20260806 09:17:53.562377 24180 heartbeater.cc:347] Connected to a master server at 127.10.255.126:46817
I20260806 09:17:53.562788 24180 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.10.255.67@KRBTEST.COM; defaulting to no policy
I20260806 09:17:53.563647 24180 heartbeater.cc:511] Master 127.10.255.126:46817 requested a full tablet report, sending...
I20260806 09:17:53.565476 23818 ts_manager.cc:194] Registered new tserver with Master: a3856ff92acd400b93145422605f86e8 (127.10.255.66:32809)
I20260806 09:17:53.566447 23818 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.66@KRBTEST.COM'} at 127.10.255.66:54449
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
I20260806 09:17:53.600270 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.255.84:36479/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:46817
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:45233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:17:53.769425 24034 heartbeater.cc:503] Master 127.10.255.126:46817 was elected leader, sending a full tablet report...
W20260806 09:17:53.981065 24186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:17:53.981554 24186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:17:53.981823 24186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:17:53.993978 24186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:17:53.994277 24186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:17:53.994552 24186 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:17:54.009414 24186 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:45233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.10.255.84:36479/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:46817
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:17:54.011271 24186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:17:54.012976 24186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:17:54.035493 24191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:17:54.035939 24192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:17:54.036362 24194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:17:54.038219 24186 server_base.cc:1034] running on GCE node
I20260806 09:17:54.039196 24186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:17:54.040644 24186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:17:54.041989 24186 hybrid_clock.cc:648] HybridClock initialized: now 1786007874041841 us; error 68 us; skew 500 ppm
I20260806 09:17:54.042451 24186 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:17:54 dist-test-slave-mvvj krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007874, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:17:54.047479 24186 init.cc:377] Logged in from keytab as kudu/127.10.255.67@KRBTEST.COM (short username kudu)
I20260806 09:17:54.049541 24186 webserver.cc:460] Webserver started at http://127.10.255.67:33863/ using document root <none> and password file <none>
I20260806 09:17:54.050529 24186 fs_manager.cc:359] Metadata directory not provided
I20260806 09:17:54.050719 24186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:17:54.051170 24186 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 09:17:54 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007874, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for HTTP/127.10.255.84@KRBTEST.COM
I20260806 09:17:54.070597 24186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "53a1116b35c44704b190131f7b717a44"
format_stamp: "Formatted at 2026-08-06 09:17:54 on dist-test-slave-mvvj"
server_key: "a13791b956c5bd9872cb5163b292e3ce"
server_key_iv: "5aaeda5d7da5c8c7eec3ab96249c09af"
server_key_version: "kuduclusterkey@0"
I20260806 09:17:54.072359 24186 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "53a1116b35c44704b190131f7b717a44"
format_stamp: "Formatted at 2026-08-06 09:17:54 on dist-test-slave-mvvj"
server_key: "a13791b956c5bd9872cb5163b292e3ce"
server_key_iv: "5aaeda5d7da5c8c7eec3ab96249c09af"
server_key_version: "kuduclusterkey@0"
I20260806 09:17:54.081962 24186 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.004s sys 0.004s
I20260806 09:17:54.103753 24201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:17:54.106127 24186 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260806 09:17:54.106478 24186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "53a1116b35c44704b190131f7b717a44"
format_stamp: "Formatted at 2026-08-06 09:17:54 on dist-test-slave-mvvj"
server_key: "a13791b956c5bd9872cb5163b292e3ce"
server_key_iv: "5aaeda5d7da5c8c7eec3ab96249c09af"
server_key_version: "kuduclusterkey@0"
I20260806 09:17:54.106921 24186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:17:54.131157 24186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:17:54.138201 24186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:17:54.138748 24186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:17:54.140373 24186 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:17:54.142845 24186 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:17:54.143018 24186 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:17:54.143265 24186 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:17:54.143347 24186 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:17:54.237030 24186 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:37357
I20260806 09:17:54.237164 24315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:37357 every 8 connection(s)
I20260806 09:17:54.238874 24186 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:17:54.242408 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 24186
I20260806 09:17:54.242628 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:17:54.243381 11261 external_mini_cluster.cc:1428] Setting key 8b1dbb937cef97b258e17b4998b8c9e4
Aug 06 09:17:54 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007874, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:17:54.270097 24318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:54.244803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:47349 (local address 127.10.255.126:46817)
0806 09:17:54.245760 (+ 957us) server_negotiation.cc:206] Beginning negotiation
0806 09:17:54.245767 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:17:54.247454 (+ 1687us) server_negotiation.cc:407] Connection header received
0806 09:17:54.250087 (+ 2633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:17:54.250091 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:17:54.250231 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:17:54.250326 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:17:54.252648 (+ 2322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:54.253636 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:54.256142 (+ 2506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:54.257108 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:54.257238 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:54.261929 (+ 4691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:17:54.261935 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:17:54.261939 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:17:54.261978 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:17:54.265285 (+ 3307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:54.266416 (+ 1131us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:54.266422 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:54.266424 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:54.266633 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:54.267357 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:54.267362 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:54.267364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:54.267809 (+ 445us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:17:54.268214 (+ 405us) server_negotiation.cc:1035] Waiting for connection context
0806 09:17:54.269263 (+ 1049us) server_negotiation.cc:299] Negotiation successful
0806 09:17:54.269634 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":696,"thread_start_us":487,"threads_started":1}
I20260806 09:17:54.271903 24319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:54.245710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:46817 (local address 127.10.255.67:47349)
0806 09:17:54.247285 (+ 1575us) negotiation.cc:107] Waiting for socket to connect
0806 09:17:54.247345 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 09:17:54.249809 (+ 2464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:17:54.250657 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:17:54.250668 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:17:54.251399 (+ 731us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:17:54.252419 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:17:54.252441 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:17:54.253851 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:17:54.253857 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:17:54.255898 (+ 2041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:17:54.255926 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:17:54.257479 (+ 1553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:17:54.257486 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:17:54.257817 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:54.258782 (+ 965us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:17:54.258808 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:17:54.261631 (+ 2823us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:17:54.265521 (+ 3890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:17:54.265531 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:17:54.265548 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:17:54.266198 (+ 650us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:17:54.266771 (+ 573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:17:54.266776 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:17:54.266781 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:17:54.267201 (+ 420us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:17:54.268170 (+ 969us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:17:54.268181 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:17:54.268787 (+ 606us) client_negotiation.cc:769] Sending connection context
0806 09:17:54.269131 (+ 344us) client_negotiation.cc:240] Negotiation successful
0806 09:17:54.270008 (+ 877us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1230,"thread_start_us":881,"threads_started":1}
I20260806 09:17:54.273780 24316 heartbeater.cc:347] Connected to a master server at 127.10.255.126:46817
I20260806 09:17:54.274286 24316 heartbeater.cc:464] Registering TS with master...
I20260806 09:17:54.275136 24316 heartbeater.cc:511] Master 127.10.255.126:46817 requested a full tablet report, sending...
I20260806 09:17:54.277200 23818 ts_manager.cc:194] Registered new tserver with Master: 53a1116b35c44704b190131f7b717a44 (127.10.255.67:37357)
I20260806 09:17:54.278208 23818 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.67@KRBTEST.COM'} at 127.10.255.67:47349
I20260806 09:17:54.287436 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 09:17:54.289307 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 23899
Aug 06 09:17:54 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.65@KRBTEST.COM
I20260806 09:17:54.309249 24321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:54.290557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46836 (local address 127.10.255.65:43745)
0806 09:17:54.291333 (+ 776us) server_negotiation.cc:206] Beginning negotiation
0806 09:17:54.291341 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:17:54.291367 (+ 26us) server_negotiation.cc:407] Connection header received
0806 09:17:54.291439 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:17:54.291449 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:17:54.291679 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:17:54.291913 (+ 234us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:17:54.293510 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:54.294560 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:54.296271 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:54.296928 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:54.297086 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:54.302363 (+ 5277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:17:54.302383 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:17:54.302403 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:17:54.302449 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:17:54.305765 (+ 3316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:54.306742 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:54.306751 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:54.306753 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:54.306930 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:54.307373 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:54.307377 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:54.307379 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:54.307765 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:17:54.308176 (+ 411us) server_negotiation.cc:1035] Waiting for connection context
0806 09:17:54.308517 (+ 341us) server_negotiation.cc:299] Negotiation successful
0806 09:17:54.308858 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":401,"threads_started":1}
I20260806 09:17:54.310652 24029 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:17:54.397912 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 23899
I20260806 09:17:54.416594 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 24041
Aug 06 09:17:54 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.66@KRBTEST.COM
I20260806 09:17:54.440747 24323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:54.422665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46056 (local address 127.10.255.66:32809)
0806 09:17:54.423286 (+ 621us) server_negotiation.cc:206] Beginning negotiation
0806 09:17:54.423294 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:17:54.423324 (+ 30us) server_negotiation.cc:407] Connection header received
0806 09:17:54.423392 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:17:54.423399 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:17:54.423646 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:17:54.423803 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:17:54.425206 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:54.426348 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:54.427938 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:54.428751 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:54.428873 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:54.433772 (+ 4899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:17:54.433791 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:17:54.433809 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:17:54.433869 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:17:54.437369 (+ 3500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:54.438319 (+ 950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:54.438328 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:54.438331 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:54.438507 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:54.438938 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:54.438943 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:54.438948 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:54.439340 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:17:54.439680 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0806 09:17:54.440034 (+ 354us) server_negotiation.cc:299] Negotiation successful
0806 09:17:54.440343 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":300,"threads_started":1}
I20260806 09:17:54.442061 24175 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:17:54.529541 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 24041
I20260806 09:17:54.547379 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 24186
Aug 06 09:17:54 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007870, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.67@KRBTEST.COM
I20260806 09:17:54.565629 24325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:54.548549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58854 (local address 127.10.255.67:37357)
0806 09:17:54.549263 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0806 09:17:54.549270 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:17:54.549300 (+ 30us) server_negotiation.cc:407] Connection header received
0806 09:17:54.549408 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:17:54.549415 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:17:54.549662 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:17:54.549859 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:17:54.551209 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:54.552482 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:54.553856 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:54.554438 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:54.554586 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:54.559489 (+ 4903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:17:54.559505 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:17:54.559522 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:17:54.559567 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:17:54.562564 (+ 2997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:54.563445 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:54.563453 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:54.563455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:54.563600 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:54.564032 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:54.564036 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:54.564038 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:54.564446 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:17:54.564697 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0806 09:17:54.564997 (+ 300us) server_negotiation.cc:299] Negotiation successful
0806 09:17:54.565220 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":373,"threads_started":1}
I20260806 09:17:54.567099 24311 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:17:54.656535 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 24186
I20260806 09:17:54.680404 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 23785
I20260806 09:17:54.681989 23848 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:17:54.801805 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 23785
I20260806 09:17:54.827220 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:46817
--webserver_interface=127.10.255.126
--webserver_port=36885
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:45233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:46817
--ranger_config_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.255.84:36479/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.255.84:36479/kms with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:17:55.188905 24328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:17:55.189261 24328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:17:55.189429 24328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:17:55.197211 24328 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:17:55.197347 24328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:17:55.197441 24328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:17:55.197562 24328 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:17:55.197630 24328 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:17:55.208303 24328 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:45233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.255.84:36479/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:46817
--ranger_config_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:46817
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=36885
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:17:55.209748 24328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:17:55.211184 24328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:17:55.225036 24333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:17:55.224980 24336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:17:55.224980 24334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:17:55.225929 24328 server_base.cc:1034] running on GCE node
I20260806 09:17:55.226832 24328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:17:55.228595 24328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:17:55.229840 24328 hybrid_clock.cc:648] HybridClock initialized: now 1786007875229764 us; error 66 us; skew 500 ppm
I20260806 09:17:55.230268 24328 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:17:55 dist-test-slave-mvvj krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007875, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:17:55.234248 24328 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:17:55.236304 24328 webserver.cc:460] Webserver started at http://127.10.255.126:36885/ using document root <none> and password file <none>
I20260806 09:17:55.237057 24328 fs_manager.cc:359] Metadata directory not provided
I20260806 09:17:55.237223 24328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 09:17:55 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007875, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for HTTP/127.10.255.84@KRBTEST.COM
I20260806 09:17:55.329279 24328 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.001s
I20260806 09:17:55.332878 24344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:17:55.334719 24328 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.004s
I20260806 09:17:55.334990 24328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "3e7d277dafe14df2bf41274df5e85e73"
format_stamp: "Formatted at 2026-08-06 09:17:50 on dist-test-slave-mvvj"
server_key: "5fb998ca29da4d1fa2508c291a5dc923"
server_key_iv: "0bb68e60ab8c005384b24e987ff39222"
server_key_version: "kuduclusterkey@0"
I20260806 09:17:55.336320 24328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:17:55.364173 24328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:17:55.368999 24328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:17:55.369331 24328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:17:55.390043 24328 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:46817
I20260806 09:17:55.390093 24395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:46817 every 8 connection(s)
I20260806 09:17:55.391852 24328 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:17:55.397099 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 24328
I20260806 09:17:55.398125 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.255.84:36479/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:43745
--local_ip_for_outbound_sockets=127.10.255.65
--tserver_master_addrs=127.10.255.126:46817
--webserver_port=42577
--webserver_interface=127.10.255.65
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:45233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.255.84:36479/kms with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:17:55.400437 24396 sys_catalog.cc:263] Verifying existing consensus state
I20260806 09:17:55.404338 24396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73: Bootstrap starting.
I20260806 09:17:55.435909 24396 log.cc:824] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73: Log is configured to *not* fsync() on all Append() calls
I20260806 09:17:55.448813 24396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 09:17:55.449537 24396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73: Bootstrap complete.
I20260806 09:17:55.463765 24396 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7d277dafe14df2bf41274df5e85e73" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 46817 } }
I20260806 09:17:55.465293 24396 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e7d277dafe14df2bf41274df5e85e73, State: Initialized, Role: FOLLOWER
I20260806 09:17:55.466156 24396 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7d277dafe14df2bf41274df5e85e73" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 46817 } }
I20260806 09:17:55.466470 24396 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:17:55.466593 24396 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:17:55.466782 24396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [term 1 FOLLOWER]: Advancing to term 2
I20260806 09:17:55.473968 24396 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7d277dafe14df2bf41274df5e85e73" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 46817 } }
I20260806 09:17:55.474854 24396 leader_election.cc:302] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e7d277dafe14df2bf41274df5e85e73; no voters:
I20260806 09:17:55.475587 24396 leader_election.cc:288] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 09:17:55.475802 24400 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 09:17:55.477284 24400 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [term 2 LEADER]: Becoming Leader. State: Replica: 3e7d277dafe14df2bf41274df5e85e73, State: Running, Role: LEADER
I20260806 09:17:55.478080 24396 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:17:55.477949 24400 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7d277dafe14df2bf41274df5e85e73" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 46817 } }
I20260806 09:17:55.480849 24402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e7d277dafe14df2bf41274df5e85e73. Latest consensus state: current_term: 2 leader_uuid: "3e7d277dafe14df2bf41274df5e85e73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7d277dafe14df2bf41274df5e85e73" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 46817 } } }
I20260806 09:17:55.481482 24402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [sys.catalog]: This master's current role is: LEADER
I20260806 09:17:55.481354 24401 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3e7d277dafe14df2bf41274df5e85e73" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7d277dafe14df2bf41274df5e85e73" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 46817 } } }
I20260806 09:17:55.481745 24401 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73 [sys.catalog]: This master's current role is: LEADER
I20260806 09:17:55.493979 24409 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:17:55.500763 24409 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:17:55.502700 24409 catalog_manager.cc:1259] Loaded cluster ID: 15f89b3ce4d3424c9b6027c4a58153f1
I20260806 09:17:55.502866 24409 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:17:55.507102 24409 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:17:55.508884 24409 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73: Loaded TSK: 0
I20260806 09:17:55.510651 24409 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:17:55.514276 24396 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260806 09:17:55.906536 24398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:17:55.907052 24398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:17:55.907238 24398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:17:55.921271 24398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:17:55.921443 24398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:17:55.921667 24398 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:17:55.940598 24398 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:45233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.255.84:36479/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:43745
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=42577
--tserver_master_addrs=127.10.255.126:46817
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:17:55.942726 24398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:17:55.944972 24398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:17:55.966404 24436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:17:55.968207 24435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:17:55.987073 24438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:17:55.987413 24398 server_base.cc:1034] running on GCE node
I20260806 09:17:55.988372 24398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:17:55.996631 24398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:17:55.998076 24398 hybrid_clock.cc:648] HybridClock initialized: now 1786007875997989 us; error 86 us; skew 500 ppm
I20260806 09:17:55.998605 24398 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:17:56 dist-test-slave-mvvj krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007876, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:17:56.009208 24398 init.cc:377] Logged in from keytab as kudu/127.10.255.65@KRBTEST.COM (short username kudu)
I20260806 09:17:56.018178 24398 webserver.cc:460] Webserver started at http://127.10.255.65:42577/ using document root <none> and password file <none>
I20260806 09:17:56.019505 24398 fs_manager.cc:359] Metadata directory not provided
I20260806 09:17:56.019744 24398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 09:17:56 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007876, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for HTTP/127.10.255.84@KRBTEST.COM
I20260806 09:17:56.080551 24398 fs_manager.cc:709] Time spent opening directory manager: real 0.012s user 0.006s sys 0.001s
I20260806 09:17:56.088676 24446 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:17:56.091156 24398 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.004s sys 0.003s
I20260806 09:17:56.091463 24398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "094e9e60830c4728ac4c952eb95ef736"
format_stamp: "Formatted at 2026-08-06 09:17:52 on dist-test-slave-mvvj"
server_key: "056c3941a1d953dfb339e413a08c37eb"
server_key_iv: "206a88e4bce9a12f36b8868bd0bebb4c"
server_key_version: "kuduclusterkey@0"
I20260806 09:17:56.093206 24398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:17:56.136566 24398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:17:56.143317 24398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:17:56.143746 24398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:17:56.145287 24398 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:17:56.147517 24398 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:17:56.147670 24398 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:17:56.147804 24398 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:17:56.147923 24398 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260806 09:17:56.225805 24398 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:43745
I20260806 09:17:56.225867 24562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:43745 every 8 connection(s)
I20260806 09:17:56.228070 24398 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:17:56.235697 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 24398
I20260806 09:17:56.236843 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.255.84:36479/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:32809
--local_ip_for_outbound_sockets=127.10.255.66
--tserver_master_addrs=127.10.255.126:46817
--webserver_port=37175
--webserver_interface=127.10.255.66
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:45233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.255.84:36479/kms with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 09:17:56 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007876, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:17:56.275126 24566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:56.231873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:46817 (local address 127.10.255.65:55297)
0806 09:17:56.247713 (+ 15840us) negotiation.cc:107] Waiting for socket to connect
0806 09:17:56.247776 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 09:17:56.250946 (+ 3170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:17:56.252924 (+ 1978us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:17:56.252939 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:17:56.253535 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:17:56.254132 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:17:56.254153 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:17:56.256048 (+ 1895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:17:56.256053 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:17:56.257339 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:17:56.257355 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:17:56.258980 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:17:56.258990 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:17:56.259250 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:56.260113 (+ 863us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:17:56.260140 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:17:56.262866 (+ 2726us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:17:56.269111 (+ 6245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:17:56.269123 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:17:56.269146 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:17:56.269826 (+ 680us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:17:56.270550 (+ 724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:17:56.270556 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:17:56.270560 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:17:56.270818 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:17:56.272140 (+ 1322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:17:56.272149 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:17:56.272604 (+ 455us) client_negotiation.cc:769] Sending connection context
0806 09:17:56.272955 (+ 351us) client_negotiation.cc:240] Negotiation successful
0806 09:17:56.273617 (+ 662us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15483,"thread_start_us":15265,"threads_started":1}
I20260806 09:17:56.278110 24565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:56.231792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:55297 (local address 127.10.255.126:46817)
0806 09:17:56.246986 (+ 15194us) server_negotiation.cc:206] Beginning negotiation
0806 09:17:56.247012 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0806 09:17:56.248344 (+ 1332us) server_negotiation.cc:407] Connection header received
0806 09:17:56.251704 (+ 3360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:17:56.251719 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:17:56.252327 (+ 608us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:17:56.252744 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:17:56.254370 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:56.255742 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:56.257528 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:56.258314 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:56.258591 (+ 277us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:56.263238 (+ 4647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:17:56.263249 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:17:56.263266 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:17:56.264902 (+ 1636us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:17:56.268791 (+ 3889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:56.270048 (+ 1257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:56.270066 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:56.270072 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:56.270376 (+ 304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:56.270960 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:56.270968 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:56.270976 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:56.271753 (+ 777us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:17:56.272004 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0806 09:17:56.276203 (+ 4199us) server_negotiation.cc:299] Negotiation successful
0806 09:17:56.276721 (+ 518us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14781,"thread_start_us":16407,"threads_started":1}
I20260806 09:17:56.282100 24563 heartbeater.cc:347] Connected to a master server at 127.10.255.126:46817
I20260806 09:17:56.282506 24563 heartbeater.cc:464] Registering TS with master...
I20260806 09:17:56.283382 24563 heartbeater.cc:511] Master 127.10.255.126:46817 requested a full tablet report, sending...
W20260806 09:17:56.286921 24563 heartbeater.cc:644] Failed to heartbeat to 127.10.255.126:46817 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 09:17:56.287201 24563 heartbeater.cc:464] Registering TS with master...
I20260806 09:17:56.287535 24563 heartbeater.cc:511] Master 127.10.255.126:46817 requested a full tablet report, sending...
I20260806 09:17:56.288986 24563 heartbeater.cc:464] Registering TS with master...
I20260806 09:17:56.289304 24563 heartbeater.cc:511] Master 127.10.255.126:46817 requested a full tablet report, sending...
W20260806 09:17:56.290593 24563 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 09:17:56.740060 24567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:17:56.740453 24567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:17:56.740759 24567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:17:56.750151 24567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:17:56.750324 24567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:17:56.750520 24567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:17:56.761686 24567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:45233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.255.84:36479/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:32809
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=37175
--tserver_master_addrs=127.10.255.126:46817
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:17:56.763149 24567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:17:56.764627 24567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:17:56.781445 24582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:17:56.781628 24583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:17:56.781848 24585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:17:56.785482 24567 server_base.cc:1034] running on GCE node
I20260806 09:17:56.786489 24567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:17:56.787985 24567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:17:56.789273 24567 hybrid_clock.cc:648] HybridClock initialized: now 1786007876789210 us; error 54 us; skew 500 ppm
I20260806 09:17:56.789711 24567 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:17:56 dist-test-slave-mvvj krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007876, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:17:56.801589 24567 init.cc:377] Logged in from keytab as kudu/127.10.255.66@KRBTEST.COM (short username kudu)
I20260806 09:17:56.826542 24567 webserver.cc:460] Webserver started at http://127.10.255.66:37175/ using document root <none> and password file <none>
I20260806 09:17:56.827780 24567 fs_manager.cc:359] Metadata directory not provided
I20260806 09:17:56.827996 24567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 09:17:56 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007876, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for HTTP/127.10.255.84@KRBTEST.COM
I20260806 09:17:56.886487 24567 fs_manager.cc:709] Time spent opening directory manager: real 0.019s user 0.015s sys 0.004s
I20260806 09:17:56.900646 24595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:17:56.905727 24567 fs_manager.cc:725] Time spent opening block manager: real 0.017s user 0.005s sys 0.008s
I20260806 09:17:56.906164 24567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "a3856ff92acd400b93145422605f86e8"
format_stamp: "Formatted at 2026-08-06 09:17:53 on dist-test-slave-mvvj"
server_key: "6f4ec6bae7f64f4e385dc16ff5fadb15"
server_key_iv: "77333004dfc6db6fd9d14169840a2f19"
server_key_version: "kuduclusterkey@0"
I20260806 09:17:56.907971 24567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 06 09:17:56 dist-test-slave-mvvj krb5kdc[23336](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786007876, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:17:56.967746 24567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:17:56.974145 24567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:17:56.974519 24567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:17:56.982236 24567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:17:56.991169 24567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:17:56.991343 24567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:17:56.991482 24567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:17:56.991581 24567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:17:57.120692 24567 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:32809
I20260806 09:17:57.120780 24710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:32809 every 8 connection(s)
I20260806 09:17:57.122767 24567 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:17:57.125087 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 24567
I20260806 09:17:57.126164 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.255.84:36479/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:37357
--local_ip_for_outbound_sockets=127.10.255.67
--tserver_master_addrs=127.10.255.126:46817
--webserver_port=33863
--webserver_interface=127.10.255.67
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:45233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.255.84:36479/kms with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 09:17:57 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007876, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:17:57.176789 24715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:57.136649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:38253 (local address 127.10.255.126:46817)
0806 09:17:57.138025 (+ 1376us) server_negotiation.cc:206] Beginning negotiation
0806 09:17:57.138033 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:17:57.139300 (+ 1267us) server_negotiation.cc:407] Connection header received
0806 09:17:57.142297 (+ 2997us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:17:57.142305 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:17:57.142404 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:17:57.142517 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:17:57.147409 (+ 4892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:57.148684 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:57.151624 (+ 2940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:57.152346 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:57.152478 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:57.167029 (+ 14551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:17:57.167038 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:17:57.167043 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:17:57.167097 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:17:57.172435 (+ 5338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:57.173580 (+ 1145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:57.173589 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:57.173593 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:57.173759 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:57.174280 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:57.174285 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:57.174288 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:57.174683 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:17:57.174849 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0806 09:17:57.176075 (+ 1226us) server_negotiation.cc:299] Negotiation successful
0806 09:17:57.176347 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1206,"thread_start_us":1052,"threads_started":1}
I20260806 09:17:57.179419 24714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:57.135814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:46817 (local address 127.10.255.66:38253)
0806 09:17:57.138712 (+ 2898us) negotiation.cc:107] Waiting for socket to connect
0806 09:17:57.138784 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0806 09:17:57.141728 (+ 2944us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:17:57.143042 (+ 1314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:17:57.143055 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:17:57.144400 (+ 1345us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:17:57.147069 (+ 2669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:17:57.147109 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:17:57.148973 (+ 1864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:17:57.148979 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:17:57.151361 (+ 2382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:17:57.151384 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:17:57.152943 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:17:57.152954 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:17:57.153314 (+ 360us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:57.158064 (+ 4750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:17:57.158128 (+ 64us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:17:57.166605 (+ 8477us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:17:57.172725 (+ 6120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:17:57.172738 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:17:57.172762 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:17:57.173355 (+ 593us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:17:57.173934 (+ 579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:17:57.173937 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:17:57.173940 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:17:57.174135 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:17:57.174958 (+ 823us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:17:57.174967 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:17:57.175513 (+ 546us) client_negotiation.cc:769] Sending connection context
0806 09:17:57.177137 (+ 1624us) client_negotiation.cc:240] Negotiation successful
0806 09:17:57.177842 (+ 705us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2474,"thread_start_us":2156,"threads_started":1}
I20260806 09:17:57.185177 24711 heartbeater.cc:347] Connected to a master server at 127.10.255.126:46817
I20260806 09:17:57.185621 24711 heartbeater.cc:464] Registering TS with master...
I20260806 09:17:57.186652 24711 heartbeater.cc:511] Master 127.10.255.126:46817 requested a full tablet report, sending...
I20260806 09:17:57.189235 24361 ts_manager.cc:194] Registered new tserver with Master: a3856ff92acd400b93145422605f86e8 (127.10.255.66:32809)
I20260806 09:17:57.191620 24361 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.66@KRBTEST.COM'} at 127.10.255.66:38253
I20260806 09:17:57.290791 24563 heartbeater.cc:464] Registering TS with master...
I20260806 09:17:57.291333 24563 heartbeater.cc:511] Master 127.10.255.126:46817 requested a full tablet report, sending...
I20260806 09:17:57.292812 24361 ts_manager.cc:194] Registered new tserver with Master: 094e9e60830c4728ac4c952eb95ef736 (127.10.255.65:43745)
I20260806 09:17:57.294114 24361 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.65@KRBTEST.COM'} at 127.10.255.65:55297
Aug 06 09:17:57 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007876, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for HTTP/127.10.255.84@KRBTEST.COM
W20260806 09:17:57.624065 24716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:17:57.624467 24716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:17:57.624648 24716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:17:57.632781 24716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:17:57.632911 24716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:17:57.633121 24716 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:17:57.650611 24716 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:45233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.255.84:36479/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:37357
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=33863
--tserver_master_addrs=127.10.255.126:46817
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:17:57.652279 24716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:17:57.653705 24716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:17:57.672849 24722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:17:57.673069 24721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:17:57.681659 24724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:17:57.682288 24716 server_base.cc:1034] running on GCE node
I20260806 09:17:57.683187 24716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:17:57.684697 24716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:17:57.685981 24716 hybrid_clock.cc:648] HybridClock initialized: now 1786007877685913 us; error 54 us; skew 500 ppm
I20260806 09:17:57.686422 24716 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:17:57 dist-test-slave-mvvj krb5kdc[23336](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007877, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:17:57.691097 24716 init.cc:377] Logged in from keytab as kudu/127.10.255.67@KRBTEST.COM (short username kudu)
I20260806 09:17:57.693423 24716 webserver.cc:460] Webserver started at http://127.10.255.67:33863/ using document root <none> and password file <none>
I20260806 09:17:57.694509 24716 fs_manager.cc:359] Metadata directory not provided
I20260806 09:17:57.694725 24716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 09:17:57 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007877, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for HTTP/127.10.255.84@KRBTEST.COM
I20260806 09:17:57.728475 24716 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 09:17:57.732829 24732 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:17:57.734877 24716 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:17:57.735167 24716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "53a1116b35c44704b190131f7b717a44"
format_stamp: "Formatted at 2026-08-06 09:17:54 on dist-test-slave-mvvj"
server_key: "a13791b956c5bd9872cb5163b292e3ce"
server_key_iv: "5aaeda5d7da5c8c7eec3ab96249c09af"
server_key_version: "kuduclusterkey@0"
I20260806 09:17:57.736773 24716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:17:57.761570 24716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:17:57.767459 24716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:17:57.767867 24716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:17:57.769239 24716 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:17:57.771281 24716 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:17:57.771409 24716 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:17:57.771521 24716 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:17:57.771612 24716 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 09:17:57 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007876, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for HTTP/127.10.255.84@KRBTEST.COM
I20260806 09:17:57.863469 24716 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:37357
I20260806 09:17:57.863571 24847 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:37357 every 8 connection(s)
I20260806 09:17:57.865885 24716 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:17:57.868623 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 24716
Aug 06 09:17:57 dist-test-slave-mvvj krb5kdc[23336](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007877, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:17:57.915146 24851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:57.870059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55628 (local address 127.10.255.126:46817)
0806 09:17:57.883984 (+ 13925us) server_negotiation.cc:206] Beginning negotiation
0806 09:17:57.883991 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:17:57.887771 (+ 3780us) server_negotiation.cc:407] Connection header received
0806 09:17:57.887911 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:17:57.887918 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:17:57.888003 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:17:57.888114 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:17:57.892073 (+ 3959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:57.893217 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:57.896069 (+ 2852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:57.896830 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:57.896975 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:57.901218 (+ 4243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:17:57.901226 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:17:57.901231 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:17:57.901334 (+ 103us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:17:57.906695 (+ 5361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:57.911813 (+ 5118us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:57.911821 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:57.911825 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:57.912050 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:57.913047 (+ 997us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:57.913054 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:57.913058 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:57.913487 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:17:57.913797 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0806 09:17:57.914451 (+ 654us) server_negotiation.cc:299] Negotiation successful
0806 09:17:57.914738 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":13740,"thread_start_us":13929,"threads_started":1}
I20260806 09:17:57.918740 24853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:57.884211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:35711 (local address 127.10.255.126:46817)
0806 09:17:57.886810 (+ 2599us) server_negotiation.cc:206] Beginning negotiation
0806 09:17:57.886817 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:17:57.891345 (+ 4528us) server_negotiation.cc:407] Connection header received
0806 09:17:57.893393 (+ 2048us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:17:57.893398 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:17:57.893553 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:17:57.893660 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:17:57.896699 (+ 3039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:57.898068 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:57.900812 (+ 2744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:57.901619 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:57.901728 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:57.906909 (+ 5181us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:17:57.906919 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:17:57.906925 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:17:57.906980 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:17:57.910745 (+ 3765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:57.912945 (+ 2200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:57.912952 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:57.912956 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:57.913127 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:57.915412 (+ 2285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:57.915418 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:57.915422 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:57.915875 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:17:57.916029 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0806 09:17:57.917978 (+ 1949us) server_negotiation.cc:299] Negotiation successful
0806 09:17:57.918293 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":2449,"thread_start_us":2621,"threads_started":1}
I20260806 09:17:57.921253 24852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:57.879336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:46817 (local address 127.10.255.67:35711)
0806 09:17:57.889958 (+ 10622us) negotiation.cc:107] Waiting for socket to connect
0806 09:17:57.890044 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0806 09:17:57.892903 (+ 2859us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:17:57.894647 (+ 1744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:17:57.894662 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:17:57.895384 (+ 722us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:17:57.896397 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:17:57.896429 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:17:57.898307 (+ 1878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:17:57.898313 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:17:57.900573 (+ 2260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:17:57.900595 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:17:57.902171 (+ 1576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:17:57.902179 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:17:57.902505 (+ 326us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:57.903282 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:17:57.903317 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:17:57.906507 (+ 3190us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:17:57.911592 (+ 5085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:17:57.911604 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:17:57.911627 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:17:57.912384 (+ 757us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:17:57.913295 (+ 911us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:17:57.913301 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:17:57.913305 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:17:57.913573 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:17:57.916228 (+ 2655us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:17:57.916835 (+ 607us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:17:57.917443 (+ 608us) client_negotiation.cc:769] Sending connection context
0806 09:17:57.918981 (+ 1538us) client_negotiation.cc:240] Negotiation successful
0806 09:17:57.919715 (+ 734us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10217,"thread_start_us":13891,"threads_started":1}
I20260806 09:17:57.922991 24848 heartbeater.cc:347] Connected to a master server at 127.10.255.126:46817
I20260806 09:17:57.923381 24848 heartbeater.cc:464] Registering TS with master...
I20260806 09:17:57.924378 24848 heartbeater.cc:511] Master 127.10.255.126:46817 requested a full tablet report, sending...
I20260806 09:17:57.926278 24361 ts_manager.cc:194] Registered new tserver with Master: 53a1116b35c44704b190131f7b717a44 (127.10.255.67:37357)
I20260806 09:17:57.927201 24361 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.67@KRBTEST.COM'} at 127.10.255.67:35711
I20260806 09:17:57.931773 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 09:17:57.958294 24853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:57.938564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55642 (local address 127.10.255.126:46817)
0806 09:17:57.938816 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0806 09:17:57.938827 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:17:57.939423 (+ 596us) server_negotiation.cc:407] Connection header received
0806 09:17:57.939679 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:17:57.939686 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:17:57.939770 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:17:57.939927 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:17:57.942025 (+ 2098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:57.942917 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:57.945125 (+ 2208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:57.945872 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:57.946011 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:57.950352 (+ 4341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:17:57.950362 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:17:57.950367 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:17:57.950425 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:17:57.954350 (+ 3925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:57.955545 (+ 1195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:57.955554 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:57.955558 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:57.955747 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:57.956299 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:57.956304 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:57.956307 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:57.956726 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:17:57.956956 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0806 09:17:57.957632 (+ 676us) server_negotiation.cc:299] Negotiation successful
0806 09:17:57.957909 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 09:17:57.967141 24361 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55642:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:17:57.979673 24361 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:17:58.045974 24867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:58.032297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:32809 (local address 127.0.0.1:48852)
0806 09:17:58.035933 (+ 3636us) negotiation.cc:107] Waiting for socket to connect
0806 09:17:58.035955 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 09:17:58.036131 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:17:58.036984 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:17:58.036990 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:17:58.037019 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:17:58.037508 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:17:58.037524 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.039511 (+ 1987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.039518 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:17:58.042395 (+ 2877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:17:58.042415 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.045061 (+ 2646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.045069 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:17:58.045258 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:58.045292 (+ 34us) client_negotiation.cc:769] Sending connection context
0806 09:17:58.045395 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 09:17:58.045570 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3462,"thread_start_us":3310,"threads_started":1}
I20260806 09:17:58.047055 24865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:58.009172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57768 (local address 127.10.255.67:37357)
0806 09:17:58.024563 (+ 15391us) server_negotiation.cc:206] Beginning negotiation
0806 09:17:58.024575 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 09:17:58.026841 (+ 2266us) server_negotiation.cc:407] Connection header received
0806 09:17:58.032556 (+ 5715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:17:58.032573 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:17:58.033116 (+ 543us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:17:58.033394 (+ 278us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:17:58.035122 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.036849 (+ 1727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.041329 (+ 4480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.043396 (+ 2067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.043646 (+ 250us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:58.044403 (+ 757us) server_negotiation.cc:1035] Waiting for connection context
0806 09:17:58.046425 (+ 2022us) server_negotiation.cc:299] Negotiation successful
0806 09:17:58.046654 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15142,"thread_start_us":14944,"threads_started":1}
I20260806 09:17:58.047256 24866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:58.027369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48852 (local address 127.10.255.66:32809)
0806 09:17:58.035603 (+ 8234us) server_negotiation.cc:206] Beginning negotiation
0806 09:17:58.035614 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:17:58.036294 (+ 680us) server_negotiation.cc:407] Connection header received
0806 09:17:58.036414 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:17:58.036423 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:17:58.036731 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:17:58.037765 (+ 1034us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:17:58.038035 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.039332 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.042681 (+ 3349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.044454 (+ 1773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.044584 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:58.044791 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0806 09:17:58.046675 (+ 1884us) server_negotiation.cc:299] Negotiation successful
0806 09:17:58.046882 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8019,"thread_start_us":7836,"threads_started":1}
I20260806 09:17:58.046015 24863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:58.008413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:37357 (local address 127.0.0.1:57768)
0806 09:17:58.025435 (+ 17022us) negotiation.cc:107] Waiting for socket to connect
0806 09:17:58.025502 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 09:17:58.032012 (+ 6510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:17:58.034146 (+ 2134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:17:58.034161 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:17:58.034218 (+ 57us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:17:58.034803 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:17:58.034822 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.037121 (+ 2299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.037130 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:17:58.041068 (+ 3938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:17:58.041092 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.044593 (+ 3501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.044601 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:17:58.044869 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:58.044959 (+ 90us) client_negotiation.cc:769] Sending connection context
0806 09:17:58.045242 (+ 283us) client_negotiation.cc:240] Negotiation successful
0806 09:17:58.045494 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16625,"mutex_wait_us":1,"thread_start_us":16395,"threads_started":1}
I20260806 09:17:58.058364 24780 tablet_service.cc:1467] Processing CreateTablet for tablet fe59fde922594d05a58a8b4e63288c23 (DEFAULT_TABLE table=test-table [id=cb20b2a06286497db21647b1ffb6bb3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:17:58.060276 24780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe59fde922594d05a58a8b4e63288c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:17:58.061795 24644 tablet_service.cc:1467] Processing CreateTablet for tablet fe59fde922594d05a58a8b4e63288c23 (DEFAULT_TABLE table=test-table [id=cb20b2a06286497db21647b1ffb6bb3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:17:58.063692 24644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe59fde922594d05a58a8b4e63288c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:17:58.065471 24867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:58.044531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:43745 (local address 127.0.0.1:46908)
0806 09:17:58.046318 (+ 1787us) negotiation.cc:107] Waiting for socket to connect
0806 09:17:58.046341 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 09:17:58.046473 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:17:58.057247 (+ 10774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:17:58.057252 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:17:58.057285 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:17:58.057475 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:17:58.057489 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.059690 (+ 2201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.059699 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:17:58.061640 (+ 1941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:17:58.061668 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.064533 (+ 2865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.064542 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:17:58.064776 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:58.064816 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 09:17:58.064929 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 09:17:58.065127 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1673,"thread_start_us":7376,"threads_started":1}
I20260806 09:17:58.066398 24868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:58.036518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46908 (local address 127.10.255.65:43745)
0806 09:17:58.040029 (+ 3511us) server_negotiation.cc:206] Beginning negotiation
0806 09:17:58.040039 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:17:58.047651 (+ 7612us) server_negotiation.cc:407] Connection header received
0806 09:17:58.047789 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:17:58.047799 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:17:58.048187 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:17:58.056908 (+ 8721us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:17:58.057717 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.059435 (+ 1718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.061912 (+ 2477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.063930 (+ 2018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.064114 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:58.064375 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0806 09:17:58.065805 (+ 1430us) server_negotiation.cc:299] Negotiation successful
0806 09:17:58.066008 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3317,"thread_start_us":3145,"threads_started":1}
I20260806 09:17:58.081481 24497 tablet_service.cc:1467] Processing CreateTablet for tablet fe59fde922594d05a58a8b4e63288c23 (DEFAULT_TABLE table=test-table [id=cb20b2a06286497db21647b1ffb6bb3a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:17:58.083343 24497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe59fde922594d05a58a8b4e63288c23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:17:58.092747 24870 tablet_bootstrap.cc:492] T fe59fde922594d05a58a8b4e63288c23 P 53a1116b35c44704b190131f7b717a44: Bootstrap starting.
I20260806 09:17:58.100418 24871 tablet_bootstrap.cc:492] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8: Bootstrap starting.
I20260806 09:17:58.102110 24870 tablet_bootstrap.cc:654] T fe59fde922594d05a58a8b4e63288c23 P 53a1116b35c44704b190131f7b717a44: Neither blocks nor log segments found. Creating new log.
I20260806 09:17:58.103711 24870 log.cc:824] T fe59fde922594d05a58a8b4e63288c23 P 53a1116b35c44704b190131f7b717a44: Log is configured to *not* fsync() on all Append() calls
I20260806 09:17:58.106819 24871 tablet_bootstrap.cc:654] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8: Neither blocks nor log segments found. Creating new log.
I20260806 09:17:58.108422 24871 log.cc:824] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8: Log is configured to *not* fsync() on all Append() calls
I20260806 09:17:58.118049 24870 tablet_bootstrap.cc:492] T fe59fde922594d05a58a8b4e63288c23 P 53a1116b35c44704b190131f7b717a44: No bootstrap required, opened a new log
I20260806 09:17:58.118060 24871 tablet_bootstrap.cc:492] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8: No bootstrap required, opened a new log
I20260806 09:17:58.118460 24871 ts_tablet_manager.cc:1397] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.000s
I20260806 09:17:58.119086 24870 ts_tablet_manager.cc:1397] T fe59fde922594d05a58a8b4e63288c23 P 53a1116b35c44704b190131f7b717a44: Time spent bootstrapping tablet: real 0.026s user 0.010s sys 0.000s
I20260806 09:17:58.128422 24874 tablet_bootstrap.cc:492] T fe59fde922594d05a58a8b4e63288c23 P 094e9e60830c4728ac4c952eb95ef736: Bootstrap starting.
I20260806 09:17:58.132652 24870 raft_consensus.cc:348] T fe59fde922594d05a58a8b4e63288c23 P 53a1116b35c44704b190131f7b717a44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a1116b35c44704b190131f7b717a44" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 37357 } } peers { permanent_uuid: "a3856ff92acd400b93145422605f86e8" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 32809 } } peers { permanent_uuid: "094e9e60830c4728ac4c952eb95ef736" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 43745 } }
I20260806 09:17:58.133396 24870 raft_consensus.cc:374] T fe59fde922594d05a58a8b4e63288c23 P 53a1116b35c44704b190131f7b717a44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:17:58.133586 24870 raft_consensus.cc:729] T fe59fde922594d05a58a8b4e63288c23 P 53a1116b35c44704b190131f7b717a44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a1116b35c44704b190131f7b717a44, State: Initialized, Role: FOLLOWER
I20260806 09:17:58.134168 24874 tablet_bootstrap.cc:654] T fe59fde922594d05a58a8b4e63288c23 P 094e9e60830c4728ac4c952eb95ef736: Neither blocks nor log segments found. Creating new log.
I20260806 09:17:58.134513 24870 consensus_queue.cc:260] T fe59fde922594d05a58a8b4e63288c23 P 53a1116b35c44704b190131f7b717a44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a1116b35c44704b190131f7b717a44" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 37357 } } peers { permanent_uuid: "a3856ff92acd400b93145422605f86e8" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 32809 } } peers { permanent_uuid: "094e9e60830c4728ac4c952eb95ef736" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 43745 } }
I20260806 09:17:58.135622 24874 log.cc:824] T fe59fde922594d05a58a8b4e63288c23 P 094e9e60830c4728ac4c952eb95ef736: Log is configured to *not* fsync() on all Append() calls
I20260806 09:17:58.166965 24871 raft_consensus.cc:348] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a1116b35c44704b190131f7b717a44" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 37357 } } peers { permanent_uuid: "a3856ff92acd400b93145422605f86e8" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 32809 } } peers { permanent_uuid: "094e9e60830c4728ac4c952eb95ef736" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 43745 } }
I20260806 09:17:58.167558 24871 raft_consensus.cc:374] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:17:58.167682 24871 raft_consensus.cc:729] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3856ff92acd400b93145422605f86e8, State: Initialized, Role: FOLLOWER
I20260806 09:17:58.177353 24871 consensus_queue.cc:260] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a1116b35c44704b190131f7b717a44" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 37357 } } peers { permanent_uuid: "a3856ff92acd400b93145422605f86e8" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 32809 } } peers { permanent_uuid: "094e9e60830c4728ac4c952eb95ef736" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 43745 } }
I20260806 09:17:58.178802 24870 ts_tablet_manager.cc:1428] T fe59fde922594d05a58a8b4e63288c23 P 53a1116b35c44704b190131f7b717a44: Time spent starting tablet: real 0.059s user 0.018s sys 0.020s
I20260806 09:17:58.179488 24874 tablet_bootstrap.cc:492] T fe59fde922594d05a58a8b4e63288c23 P 094e9e60830c4728ac4c952eb95ef736: No bootstrap required, opened a new log
I20260806 09:17:58.179908 24874 ts_tablet_manager.cc:1397] T fe59fde922594d05a58a8b4e63288c23 P 094e9e60830c4728ac4c952eb95ef736: Time spent bootstrapping tablet: real 0.054s user 0.025s sys 0.017s
I20260806 09:17:58.180056 24848 heartbeater.cc:503] Master 127.10.255.126:46817 was elected leader, sending a full tablet report...
I20260806 09:17:58.192961 24711 heartbeater.cc:503] Master 127.10.255.126:46817 was elected leader, sending a full tablet report...
I20260806 09:17:58.193815 24874 raft_consensus.cc:348] T fe59fde922594d05a58a8b4e63288c23 P 094e9e60830c4728ac4c952eb95ef736 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a1116b35c44704b190131f7b717a44" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 37357 } } peers { permanent_uuid: "a3856ff92acd400b93145422605f86e8" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 32809 } } peers { permanent_uuid: "094e9e60830c4728ac4c952eb95ef736" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 43745 } }
I20260806 09:17:58.194456 24874 raft_consensus.cc:374] T fe59fde922594d05a58a8b4e63288c23 P 094e9e60830c4728ac4c952eb95ef736 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:17:58.194559 24874 raft_consensus.cc:729] T fe59fde922594d05a58a8b4e63288c23 P 094e9e60830c4728ac4c952eb95ef736 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 094e9e60830c4728ac4c952eb95ef736, State: Initialized, Role: FOLLOWER
I20260806 09:17:58.195453 24874 consensus_queue.cc:260] T fe59fde922594d05a58a8b4e63288c23 P 094e9e60830c4728ac4c952eb95ef736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a1116b35c44704b190131f7b717a44" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 37357 } } peers { permanent_uuid: "a3856ff92acd400b93145422605f86e8" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 32809 } } peers { permanent_uuid: "094e9e60830c4728ac4c952eb95ef736" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 43745 } }
I20260806 09:17:58.196302 24871 ts_tablet_manager.cc:1428] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8: Time spent starting tablet: real 0.078s user 0.018s sys 0.016s
I20260806 09:17:58.198642 24874 ts_tablet_manager.cc:1428] T fe59fde922594d05a58a8b4e63288c23 P 094e9e60830c4728ac4c952eb95ef736: Time spent starting tablet: real 0.018s user 0.012s sys 0.005s
I20260806 09:17:58.198846 24563 heartbeater.cc:503] Master 127.10.255.126:46817 was elected leader, sending a full tablet report...
W20260806 09:17:58.251091 24564 tablet.cc:2369] T fe59fde922594d05a58a8b4e63288c23 P 094e9e60830c4728ac4c952eb95ef736: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:17:58.385346 24883 raft_consensus.cc:482] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:17:58.385816 24883 raft_consensus.cc:504] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a1116b35c44704b190131f7b717a44" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 37357 } } peers { permanent_uuid: "a3856ff92acd400b93145422605f86e8" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 32809 } } peers { permanent_uuid: "094e9e60830c4728ac4c952eb95ef736" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 43745 } }
I20260806 09:17:58.388532 24883 leader_election.cc:288] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a1116b35c44704b190131f7b717a44 (127.10.255.67:37357), 094e9e60830c4728ac4c952eb95ef736 (127.10.255.65:43745)
W20260806 09:17:58.389735 24849 tablet.cc:2369] T fe59fde922594d05a58a8b4e63288c23 P 53a1116b35c44704b190131f7b717a44: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 09:17:58.393899 24713 tablet.cc:2369] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:17:58.402208 24865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:58.389238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:53439 (local address 127.10.255.67:37357)
0806 09:17:58.389509 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0806 09:17:58.389515 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:17:58.391673 (+ 2158us) server_negotiation.cc:407] Connection header received
0806 09:17:58.391929 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:17:58.391936 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:17:58.392012 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:17:58.392077 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:17:58.393891 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.395404 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.398472 (+ 3068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.400398 (+ 1926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.400608 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:58.400689 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 09:17:58.401481 (+ 792us) server_negotiation.cc:299] Negotiation successful
0806 09:17:58.401657 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260806 09:17:58.402616 24886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:58.389974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:37357 (local address 127.10.255.66:53439)
0806 09:17:58.391475 (+ 1501us) negotiation.cc:107] Waiting for socket to connect
0806 09:17:58.391496 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 09:17:58.391694 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:17:58.392281 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:17:58.392286 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:17:58.392312 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:17:58.393691 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:17:58.393708 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.395639 (+ 1931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.395645 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:17:58.398273 (+ 2628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:17:58.398289 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.400965 (+ 2676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.400985 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:17:58.401241 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:58.401269 (+ 28us) client_negotiation.cc:769] Sending connection context
0806 09:17:58.401387 (+ 118us) client_negotiation.cc:240] Negotiation successful
0806 09:17:58.401539 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1348,"thread_start_us":906,"threads_started":1}
I20260806 09:17:58.404712 24887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:58.391798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:43745 (local address 127.10.255.66:38459)
0806 09:17:58.394059 (+ 2261us) negotiation.cc:107] Waiting for socket to connect
0806 09:17:58.394082 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 09:17:58.394339 (+ 257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:17:58.394993 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:17:58.395001 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:17:58.395032 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:17:58.396144 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:17:58.396172 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.398189 (+ 2017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.398195 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:17:58.400996 (+ 2801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:17:58.401010 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.403540 (+ 2530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.403549 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:17:58.403823 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:58.403901 (+ 78us) client_negotiation.cc:769] Sending connection context
0806 09:17:58.404002 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 09:17:58.404148 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2059,"thread_start_us":1523,"threads_started":1}
I20260806 09:17:58.404518 24803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe59fde922594d05a58a8b4e63288c23" candidate_uuid: "a3856ff92acd400b93145422605f86e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a1116b35c44704b190131f7b717a44" is_pre_election: true
I20260806 09:17:58.404744 24868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:58.392475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:38459 (local address 127.10.255.65:43745)
0806 09:17:58.392836 (+ 361us) server_negotiation.cc:206] Beginning negotiation
0806 09:17:58.392843 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:17:58.394184 (+ 1341us) server_negotiation.cc:407] Connection header received
0806 09:17:58.394541 (+ 357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:17:58.394547 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:17:58.394634 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:17:58.394709 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:17:58.396522 (+ 1813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.397965 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.401210 (+ 3245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.402945 (+ 1735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.403156 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:58.403251 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 09:17:58.404119 (+ 868us) server_negotiation.cc:299] Negotiation successful
0806 09:17:58.404293 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 09:17:58.405586 24803 raft_consensus.cc:2454] T fe59fde922594d05a58a8b4e63288c23 P 53a1116b35c44704b190131f7b717a44 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3856ff92acd400b93145422605f86e8 in term 0.
I20260806 09:17:58.406885 24597 leader_election.cc:302] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a1116b35c44704b190131f7b717a44, a3856ff92acd400b93145422605f86e8; no voters:
I20260806 09:17:58.407698 24883 raft_consensus.cc:2781] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:17:58.408001 24883 raft_consensus.cc:482] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:17:58.408231 24883 raft_consensus.cc:3037] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:17:58.407917 24517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe59fde922594d05a58a8b4e63288c23" candidate_uuid: "a3856ff92acd400b93145422605f86e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "094e9e60830c4728ac4c952eb95ef736" is_pre_election: true
I20260806 09:17:58.408689 24517 raft_consensus.cc:2454] T fe59fde922594d05a58a8b4e63288c23 P 094e9e60830c4728ac4c952eb95ef736 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a3856ff92acd400b93145422605f86e8 in term 0.
I20260806 09:17:58.412750 24883 raft_consensus.cc:504] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a1116b35c44704b190131f7b717a44" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 37357 } } peers { permanent_uuid: "a3856ff92acd400b93145422605f86e8" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 32809 } } peers { permanent_uuid: "094e9e60830c4728ac4c952eb95ef736" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 43745 } }
I20260806 09:17:58.413995 24883 leader_election.cc:288] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8 [CANDIDATE]: Term 1 election: Requested vote from peers 53a1116b35c44704b190131f7b717a44 (127.10.255.67:37357), 094e9e60830c4728ac4c952eb95ef736 (127.10.255.65:43745)
I20260806 09:17:58.415066 24517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe59fde922594d05a58a8b4e63288c23" candidate_uuid: "a3856ff92acd400b93145422605f86e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "094e9e60830c4728ac4c952eb95ef736"
I20260806 09:17:58.415019 24803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe59fde922594d05a58a8b4e63288c23" candidate_uuid: "a3856ff92acd400b93145422605f86e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a1116b35c44704b190131f7b717a44"
I20260806 09:17:58.415416 24803 raft_consensus.cc:3037] T fe59fde922594d05a58a8b4e63288c23 P 53a1116b35c44704b190131f7b717a44 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:17:58.415402 24517 raft_consensus.cc:3037] T fe59fde922594d05a58a8b4e63288c23 P 094e9e60830c4728ac4c952eb95ef736 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:17:58.419224 24517 raft_consensus.cc:2454] T fe59fde922594d05a58a8b4e63288c23 P 094e9e60830c4728ac4c952eb95ef736 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3856ff92acd400b93145422605f86e8 in term 1.
I20260806 09:17:58.420114 24597 leader_election.cc:302] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 094e9e60830c4728ac4c952eb95ef736, a3856ff92acd400b93145422605f86e8; no voters:
I20260806 09:17:58.420243 24803 raft_consensus.cc:2454] T fe59fde922594d05a58a8b4e63288c23 P 53a1116b35c44704b190131f7b717a44 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a3856ff92acd400b93145422605f86e8 in term 1.
I20260806 09:17:58.420589 24883 raft_consensus.cc:2781] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:17:58.421666 24883 raft_consensus.cc:686] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8 [term 1 LEADER]: Becoming Leader. State: Replica: a3856ff92acd400b93145422605f86e8, State: Running, Role: LEADER
I20260806 09:17:58.422255 24883 consensus_queue.cc:237] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a1116b35c44704b190131f7b717a44" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 37357 } } peers { permanent_uuid: "a3856ff92acd400b93145422605f86e8" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 32809 } } peers { permanent_uuid: "094e9e60830c4728ac4c952eb95ef736" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 43745 } }
I20260806 09:17:58.428666 24361 catalog_manager.cc:5495] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a3856ff92acd400b93145422605f86e8 (127.10.255.66). New cstate: current_term: 1 leader_uuid: "a3856ff92acd400b93145422605f86e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a1116b35c44704b190131f7b717a44" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 37357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3856ff92acd400b93145422605f86e8" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 32809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "094e9e60830c4728ac4c952eb95ef736" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 43745 } health_report { overall_health: UNKNOWN } } }
I20260806 09:17:58.451354 24866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:58.444569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48866 (local address 127.10.255.66:32809)
0806 09:17:58.444861 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0806 09:17:58.444866 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:17:58.444887 (+ 21us) server_negotiation.cc:407] Connection header received
0806 09:17:58.445046 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:17:58.445051 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:17:58.445149 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:17:58.445285 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:17:58.445888 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.446799 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.448640 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.449242 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.449350 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:58.450067 (+ 717us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:17:58.450587 (+ 520us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:17:58.450709 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 09:17:58.450853 (+ 144us) server_negotiation.cc:299] Negotiation successful
0806 09:17:58.450929 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260806 09:17:58.463368 24517 raft_consensus.cc:1261] T fe59fde922594d05a58a8b4e63288c23 P 094e9e60830c4728ac4c952eb95ef736 [term 1 FOLLOWER]: Refusing update from remote peer a3856ff92acd400b93145422605f86e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:17:58.463330 24803 raft_consensus.cc:1261] T fe59fde922594d05a58a8b4e63288c23 P 53a1116b35c44704b190131f7b717a44 [term 1 FOLLOWER]: Refusing update from remote peer a3856ff92acd400b93145422605f86e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:17:58.464708 24888 consensus_queue.cc:1035] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a1116b35c44704b190131f7b717a44" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 37357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:17:58.465394 24883 consensus_queue.cc:1035] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "094e9e60830c4728ac4c952eb95ef736" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 43745 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:17:58.508589 24360 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55642:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:17:58.509251 24360 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55642:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:17:58.515082 24360 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3e7d277dafe14df2bf41274df5e85e73: Sending DeleteTablet for 3 replicas of tablet fe59fde922594d05a58a8b4e63288c23
I20260806 09:17:58.517161 24644 tablet_service.cc:1514] Processing DeleteTablet for tablet fe59fde922594d05a58a8b4e63288c23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:17:58 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:48852
I20260806 09:17:58.517397 24780 tablet_service.cc:1514] Processing DeleteTablet for tablet fe59fde922594d05a58a8b4e63288c23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:17:58 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:57768
I20260806 09:17:58.517450 24497 tablet_service.cc:1514] Processing DeleteTablet for tablet fe59fde922594d05a58a8b4e63288c23 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:17:58 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:46908
I20260806 09:17:58.519388 24903 tablet_replica.cc:330] T fe59fde922594d05a58a8b4e63288c23 P 094e9e60830c4728ac4c952eb95ef736: stopping tablet replica
I20260806 09:17:58.520256 24903 raft_consensus.cc:2229] T fe59fde922594d05a58a8b4e63288c23 P 094e9e60830c4728ac4c952eb95ef736 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:17:58.521473 24903 raft_consensus.cc:2258] T fe59fde922594d05a58a8b4e63288c23 P 094e9e60830c4728ac4c952eb95ef736 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:17:58.521504 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 24398
I20260806 09:17:58.525497 24903 ts_tablet_manager.cc:1905] T fe59fde922594d05a58a8b4e63288c23 P 094e9e60830c4728ac4c952eb95ef736: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:17:58.541501 24902 tablet_replica.cc:330] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8: stopping tablet replica
I20260806 09:17:58.544348 24902 raft_consensus.cc:2229] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8 [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:17:58.545552 24903 ts_tablet_manager.cc:1918] T fe59fde922594d05a58a8b4e63288c23 P 094e9e60830c4728ac4c952eb95ef736: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:17:58.545770 24902 raft_consensus.cc:2258] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:17:58.545897 24903 log.cc:1196] T fe59fde922594d05a58a8b4e63288c23 P 094e9e60830c4728ac4c952eb95ef736: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-0/wal/wals/fe59fde922594d05a58a8b4e63288c23
I20260806 09:17:58.546856 24903 ts_tablet_manager.cc:1939] T fe59fde922594d05a58a8b4e63288c23 P 094e9e60830c4728ac4c952eb95ef736: Deleting consensus metadata
I20260806 09:17:58.549319 24346 catalog_manager.cc:4841] TS 094e9e60830c4728ac4c952eb95ef736 (127.10.255.65:43745): tablet fe59fde922594d05a58a8b4e63288c23 (table test-table [id=cb20b2a06286497db21647b1ffb6bb3a]) successfully deleted
I20260806 09:17:58.550321 24901 tablet_replica.cc:330] T fe59fde922594d05a58a8b4e63288c23 P 53a1116b35c44704b190131f7b717a44: stopping tablet replica
I20260806 09:17:58.550899 24901 raft_consensus.cc:2229] T fe59fde922594d05a58a8b4e63288c23 P 53a1116b35c44704b190131f7b717a44 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:17:58.551601 24901 raft_consensus.cc:2258] T fe59fde922594d05a58a8b4e63288c23 P 53a1116b35c44704b190131f7b717a44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:17:58.554319 24901 ts_tablet_manager.cc:1905] T fe59fde922594d05a58a8b4e63288c23 P 53a1116b35c44704b190131f7b717a44: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:17:58.554303 24902 ts_tablet_manager.cc:1905] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:17:58.564678 24901 ts_tablet_manager.cc:1918] T fe59fde922594d05a58a8b4e63288c23 P 53a1116b35c44704b190131f7b717a44: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:17:58.565263 24901 log.cc:1196] T fe59fde922594d05a58a8b4e63288c23 P 53a1116b35c44704b190131f7b717a44: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/fe59fde922594d05a58a8b4e63288c23
I20260806 09:17:58.566382 24901 ts_tablet_manager.cc:1939] T fe59fde922594d05a58a8b4e63288c23 P 53a1116b35c44704b190131f7b717a44: Deleting consensus metadata
I20260806 09:17:58.568885 24346 catalog_manager.cc:4841] TS 53a1116b35c44704b190131f7b717a44 (127.10.255.67:37357): tablet fe59fde922594d05a58a8b4e63288c23 (table test-table [id=cb20b2a06286497db21647b1ffb6bb3a]) successfully deleted
I20260806 09:17:58.570154 24902 ts_tablet_manager.cc:1918] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:17:58.570360 24868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:58.523311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46910 (local address 127.10.255.65:43745)
0806 09:17:58.523491 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 09:17:58.523498 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:17:58.534195 (+ 10697us) server_negotiation.cc:407] Connection header received
0806 09:17:58.534963 (+ 768us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:17:58.534972 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:17:58.535115 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:17:58.535211 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:17:58.538121 (+ 2910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.539771 (+ 1650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.546485 (+ 6714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.547434 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.547573 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:58.556298 (+ 8725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:17:58.556314 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:17:58.556330 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:17:58.556372 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:17:58.561136 (+ 4764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:58.565630 (+ 4494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:58.565642 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:58.565657 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:58.565966 (+ 309us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:58.566646 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:58.566653 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:58.566656 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:58.567473 (+ 817us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:17:58.567984 (+ 511us) server_negotiation.cc:1035] Waiting for connection context
0806 09:17:58.569399 (+ 1415us) server_negotiation.cc:299] Negotiation successful
0806 09:17:58.569756 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 09:17:58.570498 24902 log.cc:1196] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/fe59fde922594d05a58a8b4e63288c23
I20260806 09:17:58.571251 24902 ts_tablet_manager.cc:1939] T fe59fde922594d05a58a8b4e63288c23 P a3856ff92acd400b93145422605f86e8: Deleting consensus metadata
I20260806 09:17:58.572497 24558 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:17:58.574050 24346 catalog_manager.cc:4841] TS a3856ff92acd400b93145422605f86e8 (127.10.255.66:32809): tablet fe59fde922594d05a58a8b4e63288c23 (table test-table [id=cb20b2a06286497db21647b1ffb6bb3a]) successfully deleted
I20260806 09:17:58.674182 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 24398
I20260806 09:17:58.701128 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 24567
I20260806 09:17:58.721903 24866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:58.702066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48868 (local address 127.10.255.66:32809)
0806 09:17:58.702255 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 09:17:58.702259 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:17:58.702280 (+ 21us) server_negotiation.cc:407] Connection header received
0806 09:17:58.702581 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:17:58.702587 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:17:58.702666 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:17:58.702778 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:17:58.704744 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.706134 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.708636 (+ 2502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.709475 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.709609 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:58.713314 (+ 3705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:17:58.713331 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:17:58.713348 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:17:58.713395 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:17:58.718151 (+ 4756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:58.719104 (+ 953us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:58.719122 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:58.719125 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:58.719347 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:58.719791 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:58.719796 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:58.719800 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:58.720449 (+ 649us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:17:58.720813 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0806 09:17:58.721212 (+ 399us) server_negotiation.cc:299] Negotiation successful
0806 09:17:58.721480 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 09:17:58.722927 24706 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:17:58.845786 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 24567
I20260806 09:17:58.867746 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 24716
I20260806 09:17:58.888209 24865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:17:58.868853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57778 (local address 127.10.255.67:37357)
0806 09:17:58.869030 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 09:17:58.869035 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:17:58.869055 (+ 20us) server_negotiation.cc:407] Connection header received
0806 09:17:58.869168 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:17:58.869172 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:17:58.869255 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:17:58.869345 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:17:58.871328 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.872378 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.874434 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:17:58.875209 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:17:58.875414 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:17:58.879733 (+ 4319us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:17:58.879753 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:17:58.879775 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:17:58.880127 (+ 352us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:17:58.884734 (+ 4607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:58.885716 (+ 982us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:58.885726 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:58.885730 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:58.885889 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:17:58.886339 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:17:58.886345 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:17:58.886348 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:17:58.886876 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:17:58.887231 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0806 09:17:58.887530 (+ 299us) server_negotiation.cc:299] Negotiation successful
0806 09:17:58.887779 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 09:17:58.889009 24843 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:17:58.982817 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 24716
I20260806 09:17:59.001784 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 24328
I20260806 09:17:59.003180 24391 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:17:59.122992 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 24328
I20260806 09:17:59.148161 11261 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 09:17:59.495198 11261 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 09:17:59.495410 11261 mini_ranger.cc:66] Stopping Ranger...
I20260806 09:17:59.842912 11261 mini_ranger.cc:68] Stopped Ranger
2026-08-06 09:17:59.843 UTC [23366] LOG: received smart shutdown request
2026-08-06 09:17:59.847 UTC [23366] LOG: background worker "logical replication launcher" (PID 23376) exited with exit code 1
2026-08-06 09:17:59.847 UTC [23371] LOG: shutting down
2026-08-06 09:18:00.035 UTC [23366] LOG: database system is shut down
2026-08-06T09:18:00Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (60493 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:18:00 dist-test-slave-mvvj krb5kdc[24917](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:18:00 dist-test-slave-mvvj krb5kdc[24917](info): set up 2 sockets
Aug 06 09:18:00 dist-test-slave-mvvj krb5kdc[24917](info): commencing operation
krb5kdc: starting...
W20260806 09:18:01.339154 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.001s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:18:01 dist-test-slave-mvvj krb5kdc[24917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007881, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:18:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:18:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:18:01.625221 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:40413
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:41295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:40413,127.10.255.125:43053,127.10.255.124:42565
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:18:02.005821 24930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:18:02.006227 24930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:18:02.006413 24930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:18:02.014720 24930 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:18:02.014921 24930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:18:02.015053 24930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:18:02.015163 24930 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:18:02.015244 24930 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:18:02.026191 24930 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:41295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:40413,127.10.255.125:43053,127.10.255.124:42565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:40413
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:18:02.027776 24930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:18:02.029307 24930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:18:02.043097 24937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:02.043184 24938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:02.043216 24940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:18:02.044198 24930 server_base.cc:1034] running on GCE node
I20260806 09:18:02.045252 24930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:18:02.046954 24930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:18:02.048218 24930 hybrid_clock.cc:648] HybridClock initialized: now 1786007882048181 us; error 40 us; skew 500 ppm
I20260806 09:18:02.048664 24930 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:18:02 dist-test-slave-mvvj krb5kdc[24917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007882, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:18:02.058956 24930 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:18:02.061021 24930 webserver.cc:460] Webserver started at http://127.10.255.126:36303/ using document root <none> and password file <none>
I20260806 09:18:02.061863 24930 fs_manager.cc:359] Metadata directory not provided
I20260806 09:18:02.062043 24930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:18:02.062414 24930 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:18:02.066052 24930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "e3f186de75bd4e22afb27c1b908d7731"
format_stamp: "Formatted at 2026-08-06 09:18:02 on dist-test-slave-mvvj"
server_key: "0cf5bd8ca42b7a2eee725d9a01821581"
server_key_iv: "84cb14a99965fa60bb1553af77b8edcf"
server_key_version: "encryptionkey@0"
I20260806 09:18:02.067124 24930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "e3f186de75bd4e22afb27c1b908d7731"
format_stamp: "Formatted at 2026-08-06 09:18:02 on dist-test-slave-mvvj"
server_key: "0cf5bd8ca42b7a2eee725d9a01821581"
server_key_iv: "84cb14a99965fa60bb1553af77b8edcf"
server_key_version: "encryptionkey@0"
I20260806 09:18:02.073537 24930 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260806 09:18:02.077783 24947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:02.079504 24930 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 09:18:02.079753 24930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "e3f186de75bd4e22afb27c1b908d7731"
format_stamp: "Formatted at 2026-08-06 09:18:02 on dist-test-slave-mvvj"
server_key: "0cf5bd8ca42b7a2eee725d9a01821581"
server_key_iv: "84cb14a99965fa60bb1553af77b8edcf"
server_key_version: "encryptionkey@0"
I20260806 09:18:02.080060 24930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:18:02.096833 24930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:18:02.102099 24930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:18:02.102447 24930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:18:02.126700 24930 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:40413
I20260806 09:18:02.126763 24998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:40413 every 8 connection(s)
I20260806 09:18:02.128427 24930 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:18:02.133267 25000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:18:02.135071 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 24930
I20260806 09:18:02.135334 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:18:02.136142 11261 external_mini_cluster.cc:1428] Setting key 26df97a68e015004c45877b02ba83fab
I20260806 09:18:02.141469 25000 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40413 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 09:18:02 dist-test-slave-mvvj krb5kdc[24917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007882, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.255.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.125@KRBTEST.COM" created.
I20260806 09:18:02.172209 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.145655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:40413 (local address 127.0.0.1:44948)
0806 09:18:02.147376 (+ 1721us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.147438 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:02.150515 (+ 3077us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:02.152204 (+ 1689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:02.152212 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:02.153113 (+ 901us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:18:02.153532 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:02.153567 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:02.155332 (+ 1765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:02.155342 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:02.156697 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:02.156714 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:02.157957 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:02.157965 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:02.158144 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:02.158921 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:18:02.158947 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:18:02.161827 (+ 2880us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:18:02.166674 (+ 4847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:02.166687 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:02.166701 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:02.167330 (+ 629us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:02.167821 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:02.167853 (+ 32us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:02.167857 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:02.168064 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:02.169173 (+ 1109us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:18:02.169183 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:18:02.169518 (+ 335us) client_negotiation.cc:769] Sending connection context
0806 09:18:02.169878 (+ 360us) client_negotiation.cc:240] Negotiation successful
0806 09:18:02.170545 (+ 667us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1085,"thread_start_us":811,"threads_started":1}
I20260806 09:18:02.173084 25004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.145655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44948 (local address 127.10.255.126:40413)
0806 09:18:02.148372 (+ 2717us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:02.148384 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:02.148459 (+ 75us) server_negotiation.cc:407] Connection header received
0806 09:18:02.151398 (+ 2939us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:02.151406 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:02.151737 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:02.152186 (+ 449us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:02.153812 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:02.155113 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:02.156888 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:02.157662 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:02.157918 (+ 256us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:02.162147 (+ 4229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:02.162181 (+ 34us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:02.162205 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:02.162254 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:02.166462 (+ 4208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:02.167491 (+ 1029us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:02.167500 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:02.167503 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:02.167692 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:02.168181 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:02.168185 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:02.168189 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:02.168996 (+ 807us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:02.169233 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:02.170352 (+ 1119us) server_negotiation.cc:299] Negotiation successful
0806 09:18:02.170693 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":48,"server-negotiator.queue_time_us":2476,"thread_start_us":2184,"threads_started":1}
I20260806 09:18:02.176311 25000 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } has no permanent_uuid. Determining permanent_uuid...
I20260806 09:18:02.177686 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.177071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:43053 (local address 127.0.0.1:52304)
0806 09:18:02.177339 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.177498 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:43053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260806 09:18:02.178789 24950 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.255.125:43053: connect: Connection refused (error 111)
I20260806 09:18:02.180960 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.180502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:43053 (local address 127.0.0.1:52314)
0806 09:18:02.180716 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.180799 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:43053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260806 09:18:02.181231 25000 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.125:43053: Network error: Client connection negotiation failed: client connection to 127.10.255.125:43053: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.125.keytab.
Entry for principal kudu/127.10.255.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.125.keytab.
I20260806 09:18:02.208199 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.125:43053
--webserver_interface=127.10.255.125
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.125.keytab
--principal=kudu/127.10.255.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:41295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:40413,127.10.255.125:43053,127.10.255.124:42565
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:18:02.230756 25000 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } attempt: 1
I20260806 09:18:02.232349 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.231775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:43053 (local address 127.0.0.1:52318)
0806 09:18:02.232051 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.232190 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:43053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260806 09:18:02.233501 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.233124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:43053 (local address 127.0.0.1:52324)
0806 09:18:02.233286 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.233365 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:43053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260806 09:18:02.233712 25000 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.125:43053: Network error: Client connection negotiation failed: client connection to 127.10.255.125:43053: connect: Connection refused (error 111)
I20260806 09:18:02.302009 25000 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } attempt: 2
I20260806 09:18:02.303694 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.302945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:43053 (local address 127.0.0.1:52332)
0806 09:18:02.303313 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.303457 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:43053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260806 09:18:02.305352 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.304799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:43053 (local address 127.0.0.1:52346)
0806 09:18:02.305017 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.305141 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:43053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260806 09:18:02.305685 25000 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.125:43053: Network error: Client connection negotiation failed: client connection to 127.10.255.125:43053: connect: Connection refused (error 111)
I20260806 09:18:02.397028 25000 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } attempt: 3
I20260806 09:18:02.398424 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.397823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:43053 (local address 127.0.0.1:52360)
0806 09:18:02.398092 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.398217 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:43053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260806 09:18:02.400146 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.399482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:43053 (local address 127.0.0.1:52364)
0806 09:18:02.399753 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.399917 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:43053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
W20260806 09:18:02.400400 25000 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.125:43053: Network error: Client connection negotiation failed: client connection to 127.10.255.125:43053: connect: Connection refused (error 111)
I20260806 09:18:02.543828 25000 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } attempt: 4
I20260806 09:18:02.545507 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.544712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:43053 (local address 127.0.0.1:52380)
0806 09:18:02.545107 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.545273 (+ 166us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:43053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208}
I20260806 09:18:02.547008 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.546487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:43053 (local address 127.0.0.1:52390)
0806 09:18:02.546685 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.546821 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:43053: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260806 09:18:02.547293 25000 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.125:43053: Network error: Client connection negotiation failed: client connection to 127.10.255.125:43053: connect: Connection refused (error 111)
W20260806 09:18:02.576084 25007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:18:02.576417 25007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:18:02.576599 25007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:18:02.584457 25007 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:18:02.584597 25007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:18:02.584689 25007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:18:02.584793 25007 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:18:02.584870 25007 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:18:02.595890 25007 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:41295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:40413,127.10.255.125:43053,127.10.255.124:42565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.125.keytab
--principal=kudu/127.10.255.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.125:43053
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.255.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:18:02.597390 25007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:18:02.598791 25007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:18:02.611726 25012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:02.611771 25013 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:02.611800 25015 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:18:02.612964 25007 server_base.cc:1034] running on GCE node
I20260806 09:18:02.613802 25007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:18:02.615371 25007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:18:02.616639 25007 hybrid_clock.cc:648] HybridClock initialized: now 1786007882616588 us; error 47 us; skew 500 ppm
I20260806 09:18:02.617190 25007 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:18:02 dist-test-slave-mvvj krb5kdc[24917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007882, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:18:02.621073 25007 init.cc:377] Logged in from keytab as kudu/127.10.255.125@KRBTEST.COM (short username kudu)
I20260806 09:18:02.623071 25007 webserver.cc:460] Webserver started at http://127.10.255.125:38537/ using document root <none> and password file <none>
I20260806 09:18:02.624035 25007 fs_manager.cc:359] Metadata directory not provided
I20260806 09:18:02.624174 25007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:18:02.624594 25007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:18:02.628453 25007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-1/data/instance:
uuid: "749eeff1f4694a22895c7c62a49eb832"
format_stamp: "Formatted at 2026-08-06 09:18:02 on dist-test-slave-mvvj"
server_key: "2164343a45172069a4c405eedf7b6a33"
server_key_iv: "eeb9294f93ba533da287e9e4fd3b94c0"
server_key_version: "encryptionkey@0"
I20260806 09:18:02.629463 25007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-1/wal/instance:
uuid: "749eeff1f4694a22895c7c62a49eb832"
format_stamp: "Formatted at 2026-08-06 09:18:02 on dist-test-slave-mvvj"
server_key: "2164343a45172069a4c405eedf7b6a33"
server_key_iv: "eeb9294f93ba533da287e9e4fd3b94c0"
server_key_version: "encryptionkey@0"
I20260806 09:18:02.636132 25007 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260806 09:18:02.640784 25022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:02.642616 25007 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:18:02.642877 25007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-1/wal
uuid: "749eeff1f4694a22895c7c62a49eb832"
format_stamp: "Formatted at 2026-08-06 09:18:02 on dist-test-slave-mvvj"
server_key: "2164343a45172069a4c405eedf7b6a33"
server_key_iv: "eeb9294f93ba533da287e9e4fd3b94c0"
server_key_version: "encryptionkey@0"
I20260806 09:18:02.643119 25007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:18:02.658927 25007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:18:02.664626 25007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:18:02.665006 25007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:18:02.687534 25007 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.125:43053
I20260806 09:18:02.687561 25074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.125:43053 every 8 connection(s)
I20260806 09:18:02.689191 25007 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-1/data/info.pb
I20260806 09:18:02.693432 25076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:18:02.697831 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 25007
I20260806 09:18:02.698092 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-1/wal/instance
I20260806 09:18:02.698799 11261 external_mini_cluster.cc:1428] Setting key 0b4e1e106f3d0a438eee2fc4f5514019
I20260806 09:18:02.705070 25076 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40413 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 09:18:02 dist-test-slave-mvvj krb5kdc[24917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007882, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.125@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.255.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.124@KRBTEST.COM" created.
I20260806 09:18:02.732712 25079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.709173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44962 (local address 127.10.255.126:40413)
0806 09:18:02.709793 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:02.709797 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:02.711593 (+ 1796us) server_negotiation.cc:407] Connection header received
0806 09:18:02.714525 (+ 2932us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:02.714533 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:02.714656 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:02.714952 (+ 296us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:02.716997 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:02.717820 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:02.719569 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:02.720084 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:02.720236 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:02.724761 (+ 4525us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:02.724767 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:02.724771 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:02.724814 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:02.728335 (+ 3521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:02.729690 (+ 1355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:02.729695 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:02.729697 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:02.729833 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:02.730439 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:02.730443 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:02.730445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:02.730758 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:02.730883 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:02.732158 (+ 1275us) server_negotiation.cc:299] Negotiation successful
0806 09:18:02.732363 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":501,"thread_start_us":354,"threads_started":1}
I20260806 09:18:02.734417 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.710166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:40413 (local address 127.0.0.1:44962)
0806 09:18:02.711302 (+ 1136us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.711349 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:02.714114 (+ 2765us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:02.715267 (+ 1153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:02.715277 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:02.716060 (+ 783us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:18:02.716744 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:02.716765 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:02.718035 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:02.718040 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:02.719355 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:02.719370 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:02.720371 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:02.720382 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:02.720741 (+ 359us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:02.721513 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:18:02.721539 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:18:02.724388 (+ 2849us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:18:02.728569 (+ 4181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:02.728587 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:02.728613 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:02.729515 (+ 902us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:02.729969 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:02.729978 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:02.729985 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:02.730294 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:02.730917 (+ 623us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:18:02.730930 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:18:02.731549 (+ 619us) client_negotiation.cc:769] Sending connection context
0806 09:18:02.731982 (+ 433us) client_negotiation.cc:240] Negotiation successful
0806 09:18:02.732696 (+ 714us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":831,"thread_start_us":543,"threads_started":1}
I20260806 09:18:02.736629 25076 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 09:18:02 dist-test-slave-mvvj krb5kdc[24917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007882, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.125@KRBTEST.COM for kudu/127.10.255.125@KRBTEST.COM
I20260806 09:18:02.754771 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.737615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:43053 (local address 127.0.0.1:52396)
0806 09:18:02.737835 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.737858 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:02.737973 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:02.739086 (+ 1113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:02.739091 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:02.739629 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:18:02.739789 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:02.739799 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:02.741413 (+ 1614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:02.741421 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:02.742371 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:02.742384 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:02.743371 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:02.743377 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:02.743671 (+ 294us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:02.744489 (+ 818us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:18:02.744546 (+ 57us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:18:02.747498 (+ 2952us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:18:02.751789 (+ 4291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:02.751797 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:02.751801 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:02.752456 (+ 655us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:02.752972 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:02.752979 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:02.752985 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:02.753167 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:02.753958 (+ 791us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:18:02.753962 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:18:02.754086 (+ 124us) client_negotiation.cc:769] Sending connection context
0806 09:18:02.754199 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 09:18:02.754434 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87,"mutex_wait_us":24}
I20260806 09:18:02.755229 25082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.737808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52396 (local address 127.10.255.125:43053)
0806 09:18:02.738596 (+ 788us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:02.738603 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:02.738633 (+ 30us) server_negotiation.cc:407] Connection header received
0806 09:18:02.738688 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:02.738695 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:02.738890 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:02.739084 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:02.740044 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:02.741253 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:02.742542 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:02.743195 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:02.743356 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:02.747882 (+ 4526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:02.747898 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:02.747917 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:02.747964 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:02.751567 (+ 3603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:02.752678 (+ 1111us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:02.752686 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:02.752688 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:02.752820 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:02.753288 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:02.753292 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:02.753294 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:02.753724 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:02.754013 (+ 289us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:02.754476 (+ 463us) server_negotiation.cc:299] Negotiation successful
0806 09:18:02.754799 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":616,"thread_start_us":447,"threads_started":1}
I20260806 09:18:02.757997 25076 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } has no permanent_uuid. Determining permanent_uuid...
I20260806 09:18:02.759291 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.758707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42565 (local address 127.0.0.1:49286)
0806 09:18:02.758898 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.759054 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
W20260806 09:18:02.759582 25024 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
I20260806 09:18:02.761211 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.760878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42565 (local address 127.0.0.1:49288)
0806 09:18:02.761019 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.761101 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260806 09:18:02.761612 25076 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:42565: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.124.keytab.
Entry for principal kudu/127.10.255.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.124.keytab.
I20260806 09:18:02.764364 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.124:42565
--webserver_interface=127.10.255.124
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.124.keytab
--principal=kudu/127.10.255.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:41295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:40413,127.10.255.125:43053,127.10.255.124:42565
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:18:02.811000 25076 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } attempt: 1
I20260806 09:18:02.812471 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.811928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42565 (local address 127.0.0.1:49290)
0806 09:18:02.812134 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.812260 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260806 09:18:02.813519 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.813155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42565 (local address 127.0.0.1:49306)
0806 09:18:02.813329 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.813409 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260806 09:18:02.813741 25076 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:42565: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
I20260806 09:18:02.846654 25000 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } attempt: 5
Aug 06 09:18:02 dist-test-slave-mvvj krb5kdc[24917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007882, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for kudu/127.10.255.125@KRBTEST.COM
I20260806 09:18:02.864403 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.847548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:43053 (local address 127.0.0.1:52406)
0806 09:18:02.847862 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.847946 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:02.848178 (+ 232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:02.848690 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:02.848696 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:02.849240 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:18:02.849453 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:02.849466 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:02.850700 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:02.850706 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:02.851767 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:02.851788 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:02.852931 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:02.852938 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:02.853196 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:02.853987 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:18:02.854012 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:18:02.856582 (+ 2570us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:18:02.860837 (+ 4255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:02.860843 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:02.860846 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:02.861307 (+ 461us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:02.861891 (+ 584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:02.861896 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:02.861898 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:02.862069 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:02.863075 (+ 1006us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:18:02.863085 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:18:02.863351 (+ 266us) client_negotiation.cc:769] Sending connection context
0806 09:18:02.863545 (+ 194us) client_negotiation.cc:240] Negotiation successful
0806 09:18:02.864006 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103}
I20260806 09:18:02.864540 25082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.847692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52406 (local address 127.10.255.125:43053)
0806 09:18:02.847909 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:02.847915 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:02.848053 (+ 138us) server_negotiation.cc:407] Connection header received
0806 09:18:02.848393 (+ 340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:02.848398 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:02.848490 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:02.848619 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:02.849790 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:02.850517 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:02.852007 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:02.852541 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:02.852935 (+ 394us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:02.856898 (+ 3963us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:02.856905 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:02.856910 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:02.856960 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:02.860581 (+ 3621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:02.861495 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:02.861502 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:02.861505 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:02.861685 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:02.862211 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:02.862217 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:02.862220 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:02.862788 (+ 568us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:02.862965 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:02.863928 (+ 963us) server_negotiation.cc:299] Negotiation successful
0806 09:18:02.864200 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 09:18:02.866020 25000 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } has no permanent_uuid. Determining permanent_uuid...
I20260806 09:18:02.867501 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.866964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42565 (local address 127.0.0.1:49318)
0806 09:18:02.867209 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.867318 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260806 09:18:02.868995 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.868508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42565 (local address 127.0.0.1:49322)
0806 09:18:02.868758 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.868854 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
W20260806 09:18:02.869293 25000 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:42565: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
I20260806 09:18:02.881986 25076 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } attempt: 2
I20260806 09:18:02.883510 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.882835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42565 (local address 127.0.0.1:49326)
0806 09:18:02.883223 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.883324 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214}
I20260806 09:18:02.884991 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.884517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42565 (local address 127.0.0.1:49338)
0806 09:18:02.884690 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.884788 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260806 09:18:02.885282 25076 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:42565: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
I20260806 09:18:02.920554 25000 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } attempt: 1
I20260806 09:18:02.922065 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.921435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42565 (local address 127.0.0.1:49348)
0806 09:18:02.921706 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.921815 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260806 09:18:02.923429 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.923019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42565 (local address 127.0.0.1:49360)
0806 09:18:02.923197 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.923301 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260806 09:18:02.923684 25000 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:42565: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
I20260806 09:18:02.976668 25076 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } attempt: 3
I20260806 09:18:02.978084 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.977534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42565 (local address 127.0.0.1:49374)
0806 09:18:02.977755 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.977866 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260806 09:18:02.979331 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.978858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42565 (local address 127.0.0.1:49384)
0806 09:18:02.979113 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.979198 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140}
W20260806 09:18:02.979573 25076 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:42565: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
I20260806 09:18:02.991954 25000 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } attempt: 2
I20260806 09:18:02.993183 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.992656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42565 (local address 127.0.0.1:49392)
0806 09:18:02.992891 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.993010 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260806 09:18:02.994268 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:02.993909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42565 (local address 127.0.0.1:49398)
0806 09:18:02.994100 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:02.994168 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260806 09:18:02.994472 25000 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:42565: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
I20260806 09:18:03.100719 25000 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } attempt: 3
I20260806 09:18:03.102114 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:03.101550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42565 (local address 127.0.0.1:49412)
0806 09:18:03.101803 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:03.101903 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260806 09:18:03.103327 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:03.102887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42565 (local address 127.0.0.1:49426)
0806 09:18:03.103125 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:03.103203 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
W20260806 09:18:03.103605 25000 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:42565: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
I20260806 09:18:03.122821 25076 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } attempt: 4
I20260806 09:18:03.124135 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:03.123564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42565 (local address 127.0.0.1:49440)
0806 09:18:03.123817 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:03.123963 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260806 09:18:03.125195 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:03.124859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42565 (local address 127.0.0.1:49448)
0806 09:18:03.125011 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:03.125092 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260806 09:18:03.125394 25076 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:42565: Network error: Client connection negotiation failed: client connection to 127.10.255.124:42565: connect: Connection refused (error 111)
W20260806 09:18:03.140965 25084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:18:03.141345 25084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:18:03.141500 25084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:18:03.149549 25084 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:18:03.149724 25084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:18:03.149828 25084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:18:03.149931 25084 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:18:03.150010 25084 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:18:03.160496 25084 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:41295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:40413,127.10.255.125:43053,127.10.255.124:42565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.124.keytab
--principal=kudu/127.10.255.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.124:42565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.255.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:18:03.162098 25084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:18:03.163486 25084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:18:03.176234 25089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:03.176303 25092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:03.177167 25090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:18:03.178211 25084 server_base.cc:1034] running on GCE node
I20260806 09:18:03.179204 25084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:18:03.180855 25084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:18:03.182124 25084 hybrid_clock.cc:648] HybridClock initialized: now 1786007883182062 us; error 64 us; skew 500 ppm
I20260806 09:18:03.182515 25084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:18:03 dist-test-slave-mvvj krb5kdc[24917](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007883, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:18:03.186369 25084 init.cc:377] Logged in from keytab as kudu/127.10.255.124@KRBTEST.COM (short username kudu)
I20260806 09:18:03.188202 25084 webserver.cc:460] Webserver started at http://127.10.255.124:33261/ using document root <none> and password file <none>
I20260806 09:18:03.188941 25084 fs_manager.cc:359] Metadata directory not provided
I20260806 09:18:03.189059 25084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:18:03.189337 25084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:18:03.192647 25084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-2/data/instance:
uuid: "c0a346e93a8b4e59804fd164b67728e7"
format_stamp: "Formatted at 2026-08-06 09:18:03 on dist-test-slave-mvvj"
server_key: "139d58cc44049c5b07b0d245b78003df"
server_key_iv: "8c02449fa614c3ffb744d7db6f274c4b"
server_key_version: "encryptionkey@0"
I20260806 09:18:03.193452 25084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-2/wal/instance:
uuid: "c0a346e93a8b4e59804fd164b67728e7"
format_stamp: "Formatted at 2026-08-06 09:18:03 on dist-test-slave-mvvj"
server_key: "139d58cc44049c5b07b0d245b78003df"
server_key_iv: "8c02449fa614c3ffb744d7db6f274c4b"
server_key_version: "encryptionkey@0"
I20260806 09:18:03.198891 25084 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260806 09:18:03.202981 25099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:03.204772 25084 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:18:03.204958 25084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-2/wal
uuid: "c0a346e93a8b4e59804fd164b67728e7"
format_stamp: "Formatted at 2026-08-06 09:18:03 on dist-test-slave-mvvj"
server_key: "139d58cc44049c5b07b0d245b78003df"
server_key_iv: "8c02449fa614c3ffb744d7db6f274c4b"
server_key_version: "encryptionkey@0"
I20260806 09:18:03.205178 25084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:18:03.237651 25084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:18:03.242555 25084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:18:03.242812 25084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:18:03.264724 25084 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.124:42565
I20260806 09:18:03.264786 25151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.124:42565 every 8 connection(s)
I20260806 09:18:03.266271 25084 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-2/data/info.pb
I20260806 09:18:03.270447 25152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:18:03.272089 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 25084
I20260806 09:18:03.272320 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786007647474472-11261-0/minicluster-data/master-2/wal/instance
I20260806 09:18:03.272881 11261 external_mini_cluster.cc:1428] Setting key 39b772e66e2eb6712d9af86f9daa29f5
I20260806 09:18:03.280822 25000 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } attempt: 4
I20260806 09:18:03.280689 25152 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40413 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 09:18:03 dist-test-slave-mvvj krb5kdc[24917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007881, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.124@KRBTEST.COM
Aug 06 09:18:03 dist-test-slave-mvvj krb5kdc[24917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007882, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for kudu/127.10.255.124@KRBTEST.COM
I20260806 09:18:03.300699 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:03.281544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42565 (local address 127.0.0.1:49468)
0806 09:18:03.281749 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:03.281773 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:03.281919 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:03.282649 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:03.282654 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:03.283141 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:18:03.283333 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:03.283345 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.285076 (+ 1731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.285082 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:03.286493 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:03.286509 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.287622 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.287631 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:03.287896 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:03.288529 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:18:03.288571 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:18:03.292112 (+ 3541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:18:03.297217 (+ 5105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:03.297225 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:03.297231 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:03.297843 (+ 612us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:03.298326 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:03.298334 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:03.298339 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:03.298545 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:03.299615 (+ 1070us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:18:03.299619 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:18:03.299752 (+ 133us) client_negotiation.cc:769] Sending connection context
0806 09:18:03.299943 (+ 191us) client_negotiation.cc:240] Negotiation successful
0806 09:18:03.300262 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
Aug 06 09:18:03 dist-test-slave-mvvj krb5kdc[24917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007883, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.124@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:18:03.302227 25156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:03.281632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49468 (local address 127.10.255.124:42565)
0806 09:18:03.282311 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:03.282317 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:03.282340 (+ 23us) server_negotiation.cc:407] Connection header received
0806 09:18:03.282389 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:03.282394 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:03.282466 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:03.282576 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:03.283523 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.284887 (+ 1364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.286728 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.287415 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.288240 (+ 825us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:03.292462 (+ 4222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:03.292472 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:03.292484 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:03.292546 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:03.297041 (+ 4495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:03.297983 (+ 942us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:03.297990 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:03.297994 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:03.298190 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:03.298670 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:03.298676 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:03.298679 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:03.299207 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:03.299429 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:03.301011 (+ 1582us) server_negotiation.cc:299] Negotiation successful
0806 09:18:03.301246 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":519,"thread_start_us":319,"threads_started":1}
I20260806 09:18:03.302290 25155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:03.275110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49456 (local address 127.10.255.124:42565)
0806 09:18:03.276128 (+ 1018us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:03.276141 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:03.276185 (+ 44us) server_negotiation.cc:407] Connection header received
0806 09:18:03.277834 (+ 1649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:03.277863 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:03.278301 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:03.278669 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:03.280737 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.282886 (+ 2149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.284959 (+ 2073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.286024 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.286943 (+ 919us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:03.292461 (+ 5518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:03.292471 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:03.292483 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:03.292589 (+ 106us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:03.296873 (+ 4284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:03.297708 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:03.297720 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:03.297734 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:03.297971 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:03.298430 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:03.298437 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:03.298439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:03.299238 (+ 799us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:03.299545 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:03.300175 (+ 630us) server_negotiation.cc:299] Negotiation successful
0806 09:18:03.300795 (+ 620us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":788,"spinlock_wait_cycles":60416,"thread_start_us":499,"threads_started":1}
I20260806 09:18:03.310877 25000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3f186de75bd4e22afb27c1b908d7731: Bootstrap starting.
I20260806 09:18:03.311519 25158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:03.284721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:40413 (local address 127.0.0.1:44964)
0806 09:18:03.290662 (+ 5941us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:03.290720 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:03.290885 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:03.292331 (+ 1446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:03.292343 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:03.293367 (+ 1024us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:18:03.293835 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:03.293857 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.295499 (+ 1642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.295505 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:03.297448 (+ 1943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:03.297462 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.298762 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.298769 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:03.299017 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:03.300053 (+ 1036us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:18:03.300091 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:18:03.303275 (+ 3184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:18:03.308078 (+ 4803us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:03.308097 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:03.308105 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:03.308620 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:03.309119 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:03.309128 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:03.309134 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:03.309347 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:03.310139 (+ 792us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:18:03.310148 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:18:03.310394 (+ 246us) client_negotiation.cc:769] Sending connection context
0806 09:18:03.310605 (+ 211us) client_negotiation.cc:240] Negotiation successful
0806 09:18:03.311030 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5620,"mutex_wait_us":20,"thread_start_us":5474,"threads_started":1}
I20260806 09:18:03.312683 25157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:03.284653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44964 (local address 127.10.255.126:40413)
0806 09:18:03.291994 (+ 7341us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:03.291999 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:03.292016 (+ 17us) server_negotiation.cc:407] Connection header received
0806 09:18:03.292068 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:03.292072 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:03.292128 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:03.292257 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:03.294041 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.295270 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.297619 (+ 2349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.298315 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.298486 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:03.303504 (+ 5018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:03.303510 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:03.303513 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:03.303585 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:03.307896 (+ 4311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:03.308770 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:03.308776 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:03.308779 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:03.308948 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:03.309507 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:03.309512 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:03.309515 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:03.309952 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:03.311805 (+ 1853us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:03.312016 (+ 211us) server_negotiation.cc:299] Negotiation successful
0806 09:18:03.312264 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7138,"thread_start_us":6954,"threads_started":1}
I20260806 09:18:03.314383 25152 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } has no permanent_uuid. Determining permanent_uuid...
I20260806 09:18:03.315678 25000 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3f186de75bd4e22afb27c1b908d7731: Neither blocks nor log segments found. Creating new log.
I20260806 09:18:03.317142 25000 log.cc:824] T 00000000000000000000000000000000 P e3f186de75bd4e22afb27c1b908d7731: Log is configured to *not* fsync() on all Append() calls
Aug 06 09:18:03 dist-test-slave-mvvj krb5kdc[24917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007881, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:18:03.320729 25000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3f186de75bd4e22afb27c1b908d7731: No bootstrap required, opened a new log
Aug 06 09:18:03 dist-test-slave-mvvj krb5kdc[24917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007883, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.124@KRBTEST.COM for kudu/127.10.255.125@KRBTEST.COM
I20260806 09:18:03.327610 25159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:03.306690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44976 (local address 127.10.255.126:40413)
0806 09:18:03.307572 (+ 882us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:03.307578 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:03.307605 (+ 27us) server_negotiation.cc:407] Connection header received
0806 09:18:03.307675 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:03.307681 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:03.307779 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:03.308020 (+ 241us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:03.310608 (+ 2588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.311726 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.313691 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.314237 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.314385 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:03.320688 (+ 6303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:03.320697 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:03.320702 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:03.320752 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:03.324179 (+ 3427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:03.324948 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:03.324956 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:03.324965 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:03.325188 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:03.325721 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:03.325727 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:03.325730 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:03.326158 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:03.326418 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:03.326778 (+ 360us) server_negotiation.cc:299] Negotiation successful
0806 09:18:03.327021 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":718,"thread_start_us":629,"threads_started":1}
I20260806 09:18:03.332216 25000 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3f186de75bd4e22afb27c1b908d7731 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3f186de75bd4e22afb27c1b908d7731" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40413 } } peers { permanent_uuid: "749eeff1f4694a22895c7c62a49eb832" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } } peers { permanent_uuid: "c0a346e93a8b4e59804fd164b67728e7" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } }
I20260806 09:18:03.332681 25000 raft_consensus.cc:374] T 00000000000000000000000000000000 P e3f186de75bd4e22afb27c1b908d7731 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:18:03.332798 25000 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3f186de75bd4e22afb27c1b908d7731 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3f186de75bd4e22afb27c1b908d7731, State: Initialized, Role: FOLLOWER
I20260806 09:18:03.333010 25158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:03.315521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:43053 (local address 127.0.0.1:52418)
0806 09:18:03.315864 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:03.315885 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:03.316013 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:03.316449 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:03.316454 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:03.316949 (+ 495us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:18:03.317175 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:03.317189 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.318889 (+ 1700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.318894 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:03.320150 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:03.320165 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.321236 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.321245 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:03.321455 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:03.322171 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:18:03.322197 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:18:03.325017 (+ 2820us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:18:03.329692 (+ 4675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:03.329700 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:03.329704 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:03.330440 (+ 736us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:03.330984 (+ 544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:03.330990 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:03.330994 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:03.331190 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:03.331903 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:18:03.331909 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:18:03.332104 (+ 195us) client_negotiation.cc:769] Sending connection context
0806 09:18:03.332272 (+ 168us) client_negotiation.cc:240] Negotiation successful
0806 09:18:03.332627 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188}
I20260806 09:18:03.333685 25000 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3f186de75bd4e22afb27c1b908d7731 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3f186de75bd4e22afb27c1b908d7731" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40413 } } peers { permanent_uuid: "749eeff1f4694a22895c7c62a49eb832" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } } peers { permanent_uuid: "c0a346e93a8b4e59804fd164b67728e7" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } }
I20260806 09:18:03.334122 25082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:03.315485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52418 (local address 127.10.255.125:43053)
0806 09:18:03.315695 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:03.315701 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:03.315975 (+ 274us) server_negotiation.cc:407] Connection header received
0806 09:18:03.316188 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:03.316195 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:03.316290 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:03.316403 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:03.317424 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.318720 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.320318 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.321044 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.321181 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:03.325260 (+ 4079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:03.325269 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:03.325273 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:03.325324 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:03.329481 (+ 4157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:03.330628 (+ 1147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:03.330634 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:03.330638 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:03.330820 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:03.331349 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:03.331353 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:03.331357 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:03.331727 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:03.331939 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:03.332431 (+ 492us) server_negotiation.cc:299] Negotiation successful
0806 09:18:03.332942 (+ 511us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260806 09:18:03.334935 25162 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3f186de75bd4e22afb27c1b908d7731 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3f186de75bd4e22afb27c1b908d7731" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40413 } } peers { permanent_uuid: "749eeff1f4694a22895c7c62a49eb832" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } } peers { permanent_uuid: "c0a346e93a8b4e59804fd164b67728e7" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } } }
I20260806 09:18:03.335268 25152 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } has no permanent_uuid. Determining permanent_uuid...
I20260806 09:18:03.335515 25162 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3f186de75bd4e22afb27c1b908d7731 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:18:03.336458 25000 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3f186de75bd4e22afb27c1b908d7731 [sys.catalog]: configured and running, proceeding with master startup.
Aug 06 09:18:03 dist-test-slave-mvvj krb5kdc[24917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007881, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.125@KRBTEST.COM
Aug 06 09:18:03 dist-test-slave-mvvj krb5kdc[24917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007883, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.124@KRBTEST.COM for kudu/127.10.255.124@KRBTEST.COM
W20260806 09:18:03.347812 25173 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e3f186de75bd4e22afb27c1b908d7731: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 09:18:03.347982 25173 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 09:18:03.353310 25161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:03.329377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52424 (local address 127.10.255.125:43053)
0806 09:18:03.331061 (+ 1684us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:03.331067 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:03.331094 (+ 27us) server_negotiation.cc:407] Connection header received
0806 09:18:03.331240 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:03.331245 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:03.331313 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:03.331423 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:03.333166 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.334162 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.336493 (+ 2331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.337180 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.337314 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:03.343817 (+ 6503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:03.343855 (+ 38us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:03.343863 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:03.343916 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:03.348449 (+ 4533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:03.349518 (+ 1069us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:03.349523 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:03.349527 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:03.349706 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:03.350283 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:03.350288 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:03.350292 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:03.350780 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:03.351079 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:03.352551 (+ 1472us) server_negotiation.cc:299] Negotiation successful
0806 09:18:03.352824 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1555,"thread_start_us":1325,"threads_started":1}
W20260806 09:18:03.356137 24953 tablet.cc:2369] T 00000000000000000000000000000000 P e3f186de75bd4e22afb27c1b908d7731: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:18:03.357082 25158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:03.336076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42565 (local address 127.0.0.1:49472)
0806 09:18:03.336467 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:03.336502 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:03.336597 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:03.336943 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:03.336948 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:03.337441 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:18:03.337621 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:03.337629 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.339108 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.339115 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:03.340132 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:03.340151 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.341443 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.341451 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:03.341651 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:03.342315 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:18:03.342350 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:18:03.349413 (+ 7063us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:18:03.353661 (+ 4248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:03.353666 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:03.353669 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:03.354621 (+ 952us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:03.355064 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:03.355068 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:03.355072 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:03.355241 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:03.355985 (+ 744us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:18:03.355989 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:18:03.356150 (+ 161us) client_negotiation.cc:769] Sending connection context
0806 09:18:03.356348 (+ 198us) client_negotiation.cc:240] Negotiation successful
0806 09:18:03.356694 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272}
I20260806 09:18:03.357923 25156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:03.336293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49472 (local address 127.10.255.124:42565)
0806 09:18:03.336518 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:03.336526 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:03.336546 (+ 20us) server_negotiation.cc:407] Connection header received
0806 09:18:03.336719 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:03.336724 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:03.336797 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:03.336902 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:03.337817 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.338941 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.340317 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.341093 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.341234 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:03.349760 (+ 8526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:03.349769 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:03.349777 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:03.349821 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:03.353500 (+ 3679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:03.354757 (+ 1257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:03.354762 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:03.354766 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:03.354933 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:03.355362 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:03.355366 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:03.355370 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:03.355740 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:03.355929 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:03.357457 (+ 1528us) server_negotiation.cc:299] Negotiation successful
0806 09:18:03.357691 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 09:18:03.347349 24930 master_runner.cc:186] Error getting master registration for 127.10.255.125:43053: OK, instance_id { permanent_uuid: "749eeff1f4694a22895c7c62a49eb832" instance_seqno: 1786007882681255 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 09:18:03.359182 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:18:03.359352 24930 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 09:18:03.362849 25152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7: Bootstrap starting.
I20260806 09:18:03.367357 25152 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7: Neither blocks nor log segments found. Creating new log.
I20260806 09:18:03.381318 25152 log.cc:824] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7: Log is configured to *not* fsync() on all Append() calls
I20260806 09:18:03.386395 25161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:03.364355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52438 (local address 127.10.255.125:43053)
0806 09:18:03.364612 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:03.364620 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:03.366057 (+ 1437us) server_negotiation.cc:407] Connection header received
0806 09:18:03.366340 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:03.366346 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:03.366428 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:03.366498 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:03.369291 (+ 2793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.370395 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.372766 (+ 2371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.373435 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.373546 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:03.377868 (+ 4322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:03.377876 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:03.377881 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:03.377929 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:03.381623 (+ 3694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:03.382760 (+ 1137us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:03.382770 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:03.382776 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:03.383127 (+ 351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:03.383938 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:03.383947 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:03.383953 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:03.384502 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:03.384919 (+ 417us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:03.385636 (+ 717us) server_negotiation.cc:299] Negotiation successful
0806 09:18:03.385932 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 09:18:03.387204 25159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:03.364150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44992 (local address 127.10.255.126:40413)
0806 09:18:03.364377 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:03.364386 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:03.365876 (+ 1490us) server_negotiation.cc:407] Connection header received
0806 09:18:03.366241 (+ 365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:03.366250 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:03.366348 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:03.366435 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:03.369730 (+ 3295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.371003 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.373989 (+ 2986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.375006 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.375136 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:03.379470 (+ 4334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:03.379568 (+ 98us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:03.379576 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:03.379639 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:03.383368 (+ 3729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:03.384453 (+ 1085us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:03.384459 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:03.384463 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:03.384672 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:03.385186 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:03.385192 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:03.385197 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:03.385673 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:03.385920 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:03.386545 (+ 625us) server_negotiation.cc:299] Negotiation successful
0806 09:18:03.386816 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 09:18:03.389070 25152 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7: No bootstrap required, opened a new log
I20260806 09:18:03.398082 25156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:03.366624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49486 (local address 127.10.255.124:42565)
0806 09:18:03.366815 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:03.366823 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:03.377914 (+ 11091us) server_negotiation.cc:407] Connection header received
0806 09:18:03.378491 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:03.378498 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:03.378599 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:03.378679 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:03.380696 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.382022 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.384459 (+ 2437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.385364 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.385503 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:03.390500 (+ 4997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:03.390508 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:03.390513 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:03.390563 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:03.394530 (+ 3967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:03.395574 (+ 1044us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:03.395580 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:03.395587 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:03.395773 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:03.396270 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:03.396276 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:03.396280 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:03.396734 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:03.397057 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:03.397411 (+ 354us) server_negotiation.cc:299] Negotiation successful
0806 09:18:03.397678 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260806 09:18:03.398916 25152 raft_consensus.cc:348] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3f186de75bd4e22afb27c1b908d7731" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40413 } } peers { permanent_uuid: "749eeff1f4694a22895c7c62a49eb832" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } } peers { permanent_uuid: "c0a346e93a8b4e59804fd164b67728e7" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } }
I20260806 09:18:03.399312 25152 raft_consensus.cc:374] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:18:03.399452 25152 raft_consensus.cc:729] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0a346e93a8b4e59804fd164b67728e7, State: Initialized, Role: FOLLOWER
I20260806 09:18:03.400210 25152 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3f186de75bd4e22afb27c1b908d7731" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40413 } } peers { permanent_uuid: "749eeff1f4694a22895c7c62a49eb832" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } } peers { permanent_uuid: "c0a346e93a8b4e59804fd164b67728e7" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } }
I20260806 09:18:03.401225 25183 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3f186de75bd4e22afb27c1b908d7731" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40413 } } peers { permanent_uuid: "749eeff1f4694a22895c7c62a49eb832" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } } peers { permanent_uuid: "c0a346e93a8b4e59804fd164b67728e7" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } } }
I20260806 09:18:03.401654 25183 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:18:03.402467 25152 sys_catalog.cc:564] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 09:18:03.418761 25194 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 09:18:03.419629 25194 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 09:18:03.424620 25076 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } attempt: 5
I20260806 09:18:03.420416 25084 master_runner.cc:186] Error getting master registration for 127.10.255.125:43053: OK, instance_id { permanent_uuid: "749eeff1f4694a22895c7c62a49eb832" instance_seqno: 1786007882681255 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 09:18:03.434190 25084 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 06 09:18:03 dist-test-slave-mvvj krb5kdc[24917](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007882, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.125@KRBTEST.COM for kudu/127.10.255.124@KRBTEST.COM
I20260806 09:18:03.448019 25080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:03.425404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:42565 (local address 127.0.0.1:49488)
0806 09:18:03.425877 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:03.425900 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:03.426032 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:03.427185 (+ 1153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:03.427190 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:03.427798 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:18:03.430116 (+ 2318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:03.430132 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.431817 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.431824 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:03.433514 (+ 1690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:03.433537 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.434748 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.434756 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:03.434987 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:03.435728 (+ 741us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:18:03.435754 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:18:03.440004 (+ 4250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:18:03.444577 (+ 4573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:03.444584 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:03.444588 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:03.445142 (+ 554us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:03.445728 (+ 586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:03.445735 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:03.445741 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:03.445957 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:03.446798 (+ 841us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:18:03.446804 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:18:03.447001 (+ 197us) client_negotiation.cc:769] Sending connection context
0806 09:18:03.447164 (+ 163us) client_negotiation.cc:240] Negotiation successful
0806 09:18:03.447589 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330}
I20260806 09:18:03.449218 25156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:03.426282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49488 (local address 127.10.255.124:42565)
0806 09:18:03.426493 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:03.426499 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:03.426522 (+ 23us) server_negotiation.cc:407] Connection header received
0806 09:18:03.426593 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:03.426598 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:03.426699 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:03.426820 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:03.430322 (+ 3502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.431633 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.433755 (+ 2122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:03.434551 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:03.434691 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:03.440247 (+ 5556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:03.440254 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:03.440259 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:03.440304 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:03.444404 (+ 4100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:03.445304 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:03.445310 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:03.445314 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:03.445492 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:03.446111 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:03.446116 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:03.446119 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:03.446561 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:03.446726 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:03.448596 (+ 1870us) server_negotiation.cc:299] Negotiation successful
0806 09:18:03.448857 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 09:18:03.455883 25076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 749eeff1f4694a22895c7c62a49eb832: Bootstrap starting.
I20260806 09:18:03.455160 25183 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:18:03.460588 25076 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 749eeff1f4694a22895c7c62a49eb832: Neither blocks nor log segments found. Creating new log.
I20260806 09:18:03.462113 25076 log.cc:824] T 00000000000000000000000000000000 P 749eeff1f4694a22895c7c62a49eb832: Log is configured to *not* fsync() on all Append() calls
I20260806 09:18:03.463663 25183 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3f186de75bd4e22afb27c1b908d7731" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40413 } } peers { permanent_uuid: "749eeff1f4694a22895c7c62a49eb832" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } } peers { permanent_uuid: "c0a346e93a8b4e59804fd164b67728e7" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } }
I20260806 09:18:03.465567 25183 leader_election.cc:288] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3f186de75bd4e22afb27c1b908d7731 (127.10.255.126:40413), 749eeff1f4694a22895c7c62a49eb832 (127.10.255.125:43053)
I20260806 09:18:03.467962 24974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0a346e93a8b4e59804fd164b67728e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f186de75bd4e22afb27c1b908d7731" is_pre_election: true
I20260806 09:18:03.468667 24974 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e3f186de75bd4e22afb27c1b908d7731 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0a346e93a8b4e59804fd164b67728e7 in term 0.
I20260806 09:18:03.469628 25101 leader_election.cc:302] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0a346e93a8b4e59804fd164b67728e7, e3f186de75bd4e22afb27c1b908d7731; no voters:
I20260806 09:18:03.472326 25076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 749eeff1f4694a22895c7c62a49eb832: No bootstrap required, opened a new log
I20260806 09:18:03.474412 25183 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:18:03.474620 25183 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:18:03.474743 25183 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:18:03.478317 25183 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3f186de75bd4e22afb27c1b908d7731" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40413 } } peers { permanent_uuid: "749eeff1f4694a22895c7c62a49eb832" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } } peers { permanent_uuid: "c0a346e93a8b4e59804fd164b67728e7" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } }
I20260806 09:18:03.479993 24974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0a346e93a8b4e59804fd164b67728e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3f186de75bd4e22afb27c1b908d7731"
I20260806 09:18:03.480276 24974 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3f186de75bd4e22afb27c1b908d7731 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:18:03.484944 24974 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e3f186de75bd4e22afb27c1b908d7731 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0a346e93a8b4e59804fd164b67728e7 in term 1.
I20260806 09:18:03.484758 25076 raft_consensus.cc:348] T 00000000000000000000000000000000 P 749eeff1f4694a22895c7c62a49eb832 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3f186de75bd4e22afb27c1b908d7731" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40413 } } peers { permanent_uuid: "749eeff1f4694a22895c7c62a49eb832" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } } peers { permanent_uuid: "c0a346e93a8b4e59804fd164b67728e7" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } }
I20260806 09:18:03.485301 25076 raft_consensus.cc:374] T 00000000000000000000000000000000 P 749eeff1f4694a22895c7c62a49eb832 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:18:03.485455 25076 raft_consensus.cc:729] T 00000000000000000000000000000000 P 749eeff1f4694a22895c7c62a49eb832 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 749eeff1f4694a22895c7c62a49eb832, State: Initialized, Role: FOLLOWER
I20260806 09:18:03.486004 25101 leader_election.cc:302] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0a346e93a8b4e59804fd164b67728e7, e3f186de75bd4e22afb27c1b908d7731; no voters:
I20260806 09:18:03.486330 25076 consensus_queue.cc:260] T 00000000000000000000000000000000 P 749eeff1f4694a22895c7c62a49eb832 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3f186de75bd4e22afb27c1b908d7731" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40413 } } peers { permanent_uuid: "749eeff1f4694a22895c7c62a49eb832" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } } peers { permanent_uuid: "c0a346e93a8b4e59804fd164b67728e7" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } }
I20260806 09:18:03.485944 25183 leader_election.cc:288] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [CANDIDATE]: Term 1 election: Requested vote from peers e3f186de75bd4e22afb27c1b908d7731 (127.10.255.126:40413), 749eeff1f4694a22895c7c62a49eb832 (127.10.255.125:43053)
I20260806 09:18:03.490682 25183 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:18:03.490643 25198 sys_catalog.cc:455] T 00000000000000000000000000000000 P 749eeff1f4694a22895c7c62a49eb832 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3f186de75bd4e22afb27c1b908d7731" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40413 } } peers { permanent_uuid: "749eeff1f4694a22895c7c62a49eb832" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } } peers { permanent_uuid: "c0a346e93a8b4e59804fd164b67728e7" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } } }
I20260806 09:18:03.491241 25198 sys_catalog.cc:458] T 00000000000000000000000000000000 P 749eeff1f4694a22895c7c62a49eb832 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:18:03.491641 25183 raft_consensus.cc:686] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [term 1 LEADER]: Becoming Leader. State: Replica: c0a346e93a8b4e59804fd164b67728e7, State: Running, Role: LEADER
I20260806 09:18:03.492322 25076 sys_catalog.cc:564] T 00000000000000000000000000000000 P 749eeff1f4694a22895c7c62a49eb832 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:18:03.492369 25183 consensus_queue.cc:237] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3f186de75bd4e22afb27c1b908d7731" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40413 } } peers { permanent_uuid: "749eeff1f4694a22895c7c62a49eb832" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } } peers { permanent_uuid: "c0a346e93a8b4e59804fd164b67728e7" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } }
I20260806 09:18:03.492399 25048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0a346e93a8b4e59804fd164b67728e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "749eeff1f4694a22895c7c62a49eb832"
I20260806 09:18:03.492926 25048 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 749eeff1f4694a22895c7c62a49eb832 [term 0 FOLLOWER]: Advancing to term 1
W20260806 09:18:03.495440 25105 tablet.cc:2369] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:18:03.492349 25049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0a346e93a8b4e59804fd164b67728e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "749eeff1f4694a22895c7c62a49eb832" is_pre_election: true
I20260806 09:18:03.500113 25048 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 749eeff1f4694a22895c7c62a49eb832 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0a346e93a8b4e59804fd164b67728e7 in term 1.
I20260806 09:18:03.507494 25197 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0a346e93a8b4e59804fd164b67728e7. Latest consensus state: current_term: 1 leader_uuid: "c0a346e93a8b4e59804fd164b67728e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3f186de75bd4e22afb27c1b908d7731" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40413 } } peers { permanent_uuid: "749eeff1f4694a22895c7c62a49eb832" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } } peers { permanent_uuid: "c0a346e93a8b4e59804fd164b67728e7" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } } }
I20260806 09:18:03.508184 25197 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [sys.catalog]: This master's current role is: LEADER
I20260806 09:18:03.524842 25204 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:18:03.528016 25204 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:18:03.548452 25048 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 749eeff1f4694a22895c7c62a49eb832 [term 1 FOLLOWER]: Refusing update from remote peer c0a346e93a8b4e59804fd164b67728e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:18:03.550066 25197 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "749eeff1f4694a22895c7c62a49eb832" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:18:03.560892 24974 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e3f186de75bd4e22afb27c1b908d7731 [term 1 FOLLOWER]: Refusing update from remote peer c0a346e93a8b4e59804fd164b67728e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:18:03.561980 25197 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3f186de75bd4e22afb27c1b908d7731" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40413 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:18:03.578171 25162 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3f186de75bd4e22afb27c1b908d7731 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0a346e93a8b4e59804fd164b67728e7. Latest consensus state: current_term: 1 leader_uuid: "c0a346e93a8b4e59804fd164b67728e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3f186de75bd4e22afb27c1b908d7731" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40413 } } peers { permanent_uuid: "749eeff1f4694a22895c7c62a49eb832" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } } peers { permanent_uuid: "c0a346e93a8b4e59804fd164b67728e7" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } } }
I20260806 09:18:03.578562 25162 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3f186de75bd4e22afb27c1b908d7731 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:18:03.595788 25162 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3f186de75bd4e22afb27c1b908d7731 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c0a346e93a8b4e59804fd164b67728e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3f186de75bd4e22afb27c1b908d7731" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40413 } } peers { permanent_uuid: "749eeff1f4694a22895c7c62a49eb832" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } } peers { permanent_uuid: "c0a346e93a8b4e59804fd164b67728e7" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } } }
I20260806 09:18:03.596133 25162 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3f186de75bd4e22afb27c1b908d7731 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:18:03.600510 25198 sys_catalog.cc:455] T 00000000000000000000000000000000 P 749eeff1f4694a22895c7c62a49eb832 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0a346e93a8b4e59804fd164b67728e7. Latest consensus state: current_term: 1 leader_uuid: "c0a346e93a8b4e59804fd164b67728e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3f186de75bd4e22afb27c1b908d7731" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40413 } } peers { permanent_uuid: "749eeff1f4694a22895c7c62a49eb832" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } } peers { permanent_uuid: "c0a346e93a8b4e59804fd164b67728e7" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } } }
I20260806 09:18:03.600895 25198 sys_catalog.cc:458] T 00000000000000000000000000000000 P 749eeff1f4694a22895c7c62a49eb832 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:18:03.609539 25197 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c0a346e93a8b4e59804fd164b67728e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3f186de75bd4e22afb27c1b908d7731" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40413 } } peers { permanent_uuid: "749eeff1f4694a22895c7c62a49eb832" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } } peers { permanent_uuid: "c0a346e93a8b4e59804fd164b67728e7" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } } }
I20260806 09:18:03.609903 25197 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [sys.catalog]: This master's current role is: LEADER
I20260806 09:18:03.610409 25204 catalog_manager.cc:1347] Generated new cluster ID: 49f8af22dbd043809f4c3980455d140c
I20260806 09:18:03.610284 25197 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c0a346e93a8b4e59804fd164b67728e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3f186de75bd4e22afb27c1b908d7731" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40413 } } peers { permanent_uuid: "749eeff1f4694a22895c7c62a49eb832" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } } peers { permanent_uuid: "c0a346e93a8b4e59804fd164b67728e7" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } } }
I20260806 09:18:03.610512 25204 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:18:03.610538 25197 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7 [sys.catalog]: This master's current role is: LEADER
I20260806 09:18:03.610561 25198 sys_catalog.cc:455] T 00000000000000000000000000000000 P 749eeff1f4694a22895c7c62a49eb832 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c0a346e93a8b4e59804fd164b67728e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3f186de75bd4e22afb27c1b908d7731" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40413 } } peers { permanent_uuid: "749eeff1f4694a22895c7c62a49eb832" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 43053 } } peers { permanent_uuid: "c0a346e93a8b4e59804fd164b67728e7" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 42565 } } }
I20260806 09:18:03.610834 25198 sys_catalog.cc:458] T 00000000000000000000000000000000 P 749eeff1f4694a22895c7c62a49eb832 [sys.catalog]: This master's current role is: FOLLOWER
W20260806 09:18:03.634397 25218 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 749eeff1f4694a22895c7c62a49eb832: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 09:18:03.634702 25218 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 09:18:03.656766 25204 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:18:03.658819 25204 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:18:03.682301 25204 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c0a346e93a8b4e59804fd164b67728e7: Generated new TSK 0
I20260806 09:18:03.683565 25204 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:18:04.350315 25173 catalog_manager.cc:1259] Loaded cluster ID: 49f8af22dbd043809f4c3980455d140c
I20260806 09:18:04.350432 25173 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e3f186de75bd4e22afb27c1b908d7731: loading cluster ID for follower catalog manager: success
I20260806 09:18:04.353168 25173 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e3f186de75bd4e22afb27c1b908d7731: acquiring CA information for follower catalog manager: success
I20260806 09:18:04.355225 25173 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e3f186de75bd4e22afb27c1b908d7731: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 09:18:04.636929 25218 catalog_manager.cc:1259] Loaded cluster ID: 49f8af22dbd043809f4c3980455d140c
I20260806 09:18:04.637039 25218 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 749eeff1f4694a22895c7c62a49eb832: loading cluster ID for follower catalog manager: success
I20260806 09:18:04.639912 25218 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 749eeff1f4694a22895c7c62a49eb832: acquiring CA information for follower catalog manager: success
I20260806 09:18:04.642056 25218 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 749eeff1f4694a22895c7c62a49eb832: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 09:18:04.858475 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 24930
I20260806 09:18:04.859797 24994 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:18:04.976239 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 24930
I20260806 09:18:05.000313 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 25007
I20260806 09:18:05.001487 25069 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:18:05.114720 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 25007
I20260806 09:18:05.137065 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 25084
I20260806 09:18:05.138429 25146 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:18:05.255191 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 25084
2026-08-06T09:18:05Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5086 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:18:05 dist-test-slave-mvvj krb5kdc[25231](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:18:05 dist-test-slave-mvvj krb5kdc[25231](info): set up 2 sockets
Aug 06 09:18:05 dist-test-slave-mvvj krb5kdc[25231](info): commencing operation
krb5kdc: starting...
W20260806 09:18:06.411139 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.003s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:18:06 dist-test-slave-mvvj krb5kdc[25231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007886, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:18:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:18:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:18:06.697091 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:33111
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:42321
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:33111
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:18:07.063273 25244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:18:07.063620 25244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:18:07.063793 25244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:18:07.071667 25244 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:18:07.071820 25244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:18:07.071960 25244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:18:07.072086 25244 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:18:07.072152 25244 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:18:07.082675 25244 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:42321
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:33111
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:33111
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:18:07.084230 25244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:18:07.085667 25244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:18:07.098734 25250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:07.098774 25253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:07.098886 25251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:18:07.099740 25244 server_base.cc:1034] running on GCE node
I20260806 09:18:07.100713 25244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:18:07.102295 25244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:18:07.103552 25244 hybrid_clock.cc:648] HybridClock initialized: now 1786007887103478 us; error 48 us; skew 500 ppm
I20260806 09:18:07.104079 25244 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:18:07 dist-test-slave-mvvj krb5kdc[25231](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007887, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:18:07.112254 25244 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:18:07.114192 25244 webserver.cc:460] Webserver started at http://127.10.255.126:42111/ using document root <none> and password file <none>
I20260806 09:18:07.115044 25244 fs_manager.cc:359] Metadata directory not provided
I20260806 09:18:07.115211 25244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:18:07.115571 25244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:18:07.119059 25244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "ef4322aad5f54723aabdbe3b1fe7c88a"
format_stamp: "Formatted at 2026-08-06 09:18:07 on dist-test-slave-mvvj"
server_key: "7630b5904a63f6016a13a9b53c20d32f"
server_key_iv: "8e76290d5397360d7881fd8477d84fa9"
server_key_version: "encryptionkey@0"
I20260806 09:18:07.120061 25244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "ef4322aad5f54723aabdbe3b1fe7c88a"
format_stamp: "Formatted at 2026-08-06 09:18:07 on dist-test-slave-mvvj"
server_key: "7630b5904a63f6016a13a9b53c20d32f"
server_key_iv: "8e76290d5397360d7881fd8477d84fa9"
server_key_version: "encryptionkey@0"
I20260806 09:18:07.126165 25244 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 09:18:07.130389 25260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:07.132138 25244 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 09:18:07.132359 25244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "ef4322aad5f54723aabdbe3b1fe7c88a"
format_stamp: "Formatted at 2026-08-06 09:18:07 on dist-test-slave-mvvj"
server_key: "7630b5904a63f6016a13a9b53c20d32f"
server_key_iv: "8e76290d5397360d7881fd8477d84fa9"
server_key_version: "encryptionkey@0"
I20260806 09:18:07.132606 25244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:18:07.150188 25244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:18:07.155342 25244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:18:07.155676 25244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:18:07.176541 25244 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:33111
I20260806 09:18:07.176550 25313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:33111 every 8 connection(s)
I20260806 09:18:07.178053 25244 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:18:07.182168 25314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:18:07.185482 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 25244
I20260806 09:18:07.185757 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:18:07.186437 11261 external_mini_cluster.cc:1428] Setting key 5c1a9fba6049dc2b4039839f160af905
I20260806 09:18:07.197151 25314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef4322aad5f54723aabdbe3b1fe7c88a: Bootstrap starting.
I20260806 09:18:07.201220 25314 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef4322aad5f54723aabdbe3b1fe7c88a: Neither blocks nor log segments found. Creating new log.
I20260806 09:18:07.202421 25314 log.cc:824] T 00000000000000000000000000000000 P ef4322aad5f54723aabdbe3b1fe7c88a: Log is configured to *not* fsync() on all Append() calls
Aug 06 09:18:07 dist-test-slave-mvvj krb5kdc[25231](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007886, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:18:07.206058 25314 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef4322aad5f54723aabdbe3b1fe7c88a: No bootstrap required, opened a new log
I20260806 09:18:07.214149 25317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:07.188789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59430 (local address 127.10.255.126:33111)
0806 09:18:07.189713 (+ 924us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:07.189731 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:07.189789 (+ 58us) server_negotiation.cc:407] Connection header received
0806 09:18:07.192283 (+ 2494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:07.192320 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:07.192958 (+ 638us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:07.193508 (+ 550us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:07.195167 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:07.197623 (+ 2456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:07.199155 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:07.200328 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:07.200546 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:07.205528 (+ 4982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:07.205541 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:07.205561 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:07.205610 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:07.209444 (+ 3834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:07.210353 (+ 909us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:07.210365 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:07.210372 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:07.210572 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:07.210998 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:07.211003 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:07.211013 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:07.211613 (+ 600us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:07.212024 (+ 411us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:07.212510 (+ 486us) server_negotiation.cc:299] Negotiation successful
0806 09:18:07.213023 (+ 513us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":659,"thread_start_us":393,"threads_started":1}
I20260806 09:18:07.214792 25314 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef4322aad5f54723aabdbe3b1fe7c88a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef4322aad5f54723aabdbe3b1fe7c88a" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 33111 } }
I20260806 09:18:07.215229 25314 raft_consensus.cc:374] T 00000000000000000000000000000000 P ef4322aad5f54723aabdbe3b1fe7c88a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:18:07.215356 25314 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef4322aad5f54723aabdbe3b1fe7c88a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef4322aad5f54723aabdbe3b1fe7c88a, State: Initialized, Role: FOLLOWER
I20260806 09:18:07.216138 25314 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef4322aad5f54723aabdbe3b1fe7c88a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef4322aad5f54723aabdbe3b1fe7c88a" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 33111 } }
I20260806 09:18:07.216461 25314 raft_consensus.cc:388] T 00000000000000000000000000000000 P ef4322aad5f54723aabdbe3b1fe7c88a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:18:07.216614 25314 raft_consensus.cc:482] T 00000000000000000000000000000000 P ef4322aad5f54723aabdbe3b1fe7c88a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:18:07.216811 25314 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef4322aad5f54723aabdbe3b1fe7c88a [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:18:07.219010 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:18:07.219937 25314 raft_consensus.cc:504] T 00000000000000000000000000000000 P ef4322aad5f54723aabdbe3b1fe7c88a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef4322aad5f54723aabdbe3b1fe7c88a" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 33111 } }
I20260806 09:18:07.220515 25314 leader_election.cc:302] T 00000000000000000000000000000000 P ef4322aad5f54723aabdbe3b1fe7c88a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef4322aad5f54723aabdbe3b1fe7c88a; no voters:
I20260806 09:18:07.221205 25314 leader_election.cc:288] T 00000000000000000000000000000000 P ef4322aad5f54723aabdbe3b1fe7c88a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:18:07.221401 25319 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ef4322aad5f54723aabdbe3b1fe7c88a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:18:07.222695 25319 raft_consensus.cc:686] T 00000000000000000000000000000000 P ef4322aad5f54723aabdbe3b1fe7c88a [term 1 LEADER]: Becoming Leader. State: Replica: ef4322aad5f54723aabdbe3b1fe7c88a, State: Running, Role: LEADER
I20260806 09:18:07.223349 25319 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef4322aad5f54723aabdbe3b1fe7c88a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef4322aad5f54723aabdbe3b1fe7c88a" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 33111 } }
I20260806 09:18:07.223675 25314 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef4322aad5f54723aabdbe3b1fe7c88a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:18:07.226641 25320 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef4322aad5f54723aabdbe3b1fe7c88a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ef4322aad5f54723aabdbe3b1fe7c88a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef4322aad5f54723aabdbe3b1fe7c88a" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 33111 } } }
I20260806 09:18:07.227234 25320 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef4322aad5f54723aabdbe3b1fe7c88a [sys.catalog]: This master's current role is: LEADER
I20260806 09:18:07.226634 25321 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef4322aad5f54723aabdbe3b1fe7c88a [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef4322aad5f54723aabdbe3b1fe7c88a. Latest consensus state: current_term: 1 leader_uuid: "ef4322aad5f54723aabdbe3b1fe7c88a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef4322aad5f54723aabdbe3b1fe7c88a" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 33111 } } }
I20260806 09:18:07.227813 25321 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef4322aad5f54723aabdbe3b1fe7c88a [sys.catalog]: This master's current role is: LEADER
I20260806 09:18:07.230077 25326 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:18:07.235343 25326 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:18:07.245380 25326 catalog_manager.cc:1347] Generated new cluster ID: b2693fdd19a84504838c8dcb4e116456
I20260806 09:18:07.245525 25326 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:18:07.272624 25326 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:18:07.274721 25326 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:18:07.287197 25326 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ef4322aad5f54723aabdbe3b1fe7c88a: Generated new TSK 0
I20260806 09:18:07.288470 25326 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:18:07.332537 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 25244
I20260806 09:18:07.333885 25308 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:18:07.439527 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 25244
2026-08-06T09:18:07Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2184 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:18:07 dist-test-slave-mvvj krb5kdc[25342](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:18:07 dist-test-slave-mvvj krb5kdc[25342](info): set up 2 sockets
Aug 06 09:18:07 dist-test-slave-mvvj krb5kdc[25342](info): commencing operation
krb5kdc: starting...
W20260806 09:18:08.615968 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.131s user 0.000s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:18:08 dist-test-slave-mvvj krb5kdc[25342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:18:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:18:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:18:08.901808 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:42049
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:42049
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:18:09.260885 25356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:18:09.261219 25356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:18:09.261384 25356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:18:09.269709 25356 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:18:09.269856 25356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:18:09.269955 25356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:18:09.270046 25356 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:18:09.270148 25356 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:18:09.281177 25356 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:42049
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:42049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:18:09.282793 25356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:18:09.284384 25356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:18:09.297459 25364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:09.297493 25362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:09.298137 25361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:18:09.298658 25356 server_base.cc:1034] running on GCE node
I20260806 09:18:09.299644 25356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:18:09.301430 25356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:18:09.302711 25356 hybrid_clock.cc:648] HybridClock initialized: now 1786007889302646 us; error 59 us; skew 500 ppm
I20260806 09:18:09.303160 25356 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:18:09 dist-test-slave-mvvj krb5kdc[25342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007889, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:18:09.306954 25356 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:18:09.309064 25356 webserver.cc:460] Webserver started at http://127.10.255.126:46821/ using document root <none> and password file <none>
I20260806 09:18:09.309952 25356 fs_manager.cc:359] Metadata directory not provided
I20260806 09:18:09.310135 25356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:18:09.310492 25356 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:18:09.314145 25356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "9bb051cfc4104bacab3e1877771537b5"
format_stamp: "Formatted at 2026-08-06 09:18:09 on dist-test-slave-mvvj"
server_key: "d13a559accc778ef1d38694d4ed2055f"
server_key_iv: "b40c0367368f8d245fa9b1ab0cab4f1e"
server_key_version: "encryptionkey@0"
I20260806 09:18:09.315080 25356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "9bb051cfc4104bacab3e1877771537b5"
format_stamp: "Formatted at 2026-08-06 09:18:09 on dist-test-slave-mvvj"
server_key: "d13a559accc778ef1d38694d4ed2055f"
server_key_iv: "b40c0367368f8d245fa9b1ab0cab4f1e"
server_key_version: "encryptionkey@0"
I20260806 09:18:09.321664 25356 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260806 09:18:09.325706 25371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:09.327212 25356 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 09:18:09.327422 25356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "9bb051cfc4104bacab3e1877771537b5"
format_stamp: "Formatted at 2026-08-06 09:18:09 on dist-test-slave-mvvj"
server_key: "d13a559accc778ef1d38694d4ed2055f"
server_key_iv: "b40c0367368f8d245fa9b1ab0cab4f1e"
server_key_version: "encryptionkey@0"
I20260806 09:18:09.327662 25356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:18:09.358897 25356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:18:09.363741 25356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:18:09.364096 25356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:18:09.384774 25356 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:42049
I20260806 09:18:09.384793 25424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:42049 every 8 connection(s)
I20260806 09:18:09.386389 25356 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:18:09.390926 25425 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:18:09.392225 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 25356
I20260806 09:18:09.392495 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:18:09.393378 11261 external_mini_cluster.cc:1428] Setting key fb107fb0e6ed52c53712436764f82f75
I20260806 09:18:09.407442 25425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5: Bootstrap starting.
Aug 06 09:18:09 dist-test-slave-mvvj krb5kdc[25342](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:18:09.411523 25425 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5: Neither blocks nor log segments found. Creating new log.
I20260806 09:18:09.412979 25425 log.cc:824] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5: Log is configured to *not* fsync() on all Append() calls
I20260806 09:18:09.416466 25425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5: No bootstrap required, opened a new log
I20260806 09:18:09.419565 25429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:09.395757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54622 (local address 127.10.255.126:42049)
0806 09:18:09.396812 (+ 1055us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:09.396825 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:09.396890 (+ 65us) server_negotiation.cc:407] Connection header received
0806 09:18:09.398617 (+ 1727us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:09.398644 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:09.399299 (+ 655us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:09.399742 (+ 443us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:09.401716 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:09.403072 (+ 1356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:09.405058 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:09.405807 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:09.405953 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:09.411104 (+ 5151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:09.411114 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:09.411130 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:09.411180 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:09.414710 (+ 3530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:09.415563 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:09.415571 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:09.415578 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:09.415763 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:09.416250 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:09.416254 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:09.416256 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:09.416881 (+ 625us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:09.417264 (+ 383us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:09.417774 (+ 510us) server_negotiation.cc:299] Negotiation successful
0806 09:18:09.418275 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":809,"thread_start_us":492,"threads_started":1}
I20260806 09:18:09.426149 25425 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bb051cfc4104bacab3e1877771537b5" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42049 } }
I20260806 09:18:09.426725 25425 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:18:09.426848 25425 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bb051cfc4104bacab3e1877771537b5, State: Initialized, Role: FOLLOWER
I20260806 09:18:09.427577 25425 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bb051cfc4104bacab3e1877771537b5" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42049 } }
I20260806 09:18:09.427924 25425 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:18:09.428133 25425 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:18:09.428336 25425 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:18:09.431413 25425 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bb051cfc4104bacab3e1877771537b5" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42049 } }
I20260806 09:18:09.432399 25425 leader_election.cc:302] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9bb051cfc4104bacab3e1877771537b5; no voters:
I20260806 09:18:09.433310 25425 leader_election.cc:288] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:18:09.433468 25431 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:18:09.434463 25431 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 1 LEADER]: Becoming Leader. State: Replica: 9bb051cfc4104bacab3e1877771537b5, State: Running, Role: LEADER
I20260806 09:18:09.435221 25431 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bb051cfc4104bacab3e1877771537b5" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42049 } }
I20260806 09:18:09.436389 25425 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:18:09.438639 25432 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9bb051cfc4104bacab3e1877771537b5. Latest consensus state: current_term: 1 leader_uuid: "9bb051cfc4104bacab3e1877771537b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bb051cfc4104bacab3e1877771537b5" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42049 } } }
I20260806 09:18:09.438964 25433 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9bb051cfc4104bacab3e1877771537b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bb051cfc4104bacab3e1877771537b5" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42049 } } }
I20260806 09:18:09.439396 25432 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [sys.catalog]: This master's current role is: LEADER
I20260806 09:18:09.439460 25433 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [sys.catalog]: This master's current role is: LEADER
I20260806 09:18:09.442406 25438 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:18:09.448988 25438 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:18:09.464781 25438 catalog_manager.cc:1347] Generated new cluster ID: b3ffcc36224642cba478bbe7ede84d44
I20260806 09:18:09.465070 25438 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:18:09.480664 25438 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:18:09.482244 25438 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:18:09.494171 25438 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5: Generated new TSK 0
I20260806 09:18:09.495224 25438 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.255.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
I20260806 09:18:09.572753 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42049
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:18:09.959120 25452 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:18:09.959465 25452 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:18:09.959576 25452 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:18:09.967656 25452 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:18:09.967813 25452 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:18:09.968021 25452 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:18:09.978781 25452 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42049
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:18:09.980266 25452 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:18:09.981674 25452 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:18:09.996881 25458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:09.997522 25460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:09.997788 25457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:18:09.998291 25452 server_base.cc:1034] running on GCE node
I20260806 09:18:09.998980 25452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:18:10.000085 25452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:18:10.001327 25452 hybrid_clock.cc:648] HybridClock initialized: now 1786007890001279 us; error 35 us; skew 500 ppm
I20260806 09:18:10.001765 25452 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:18:10 dist-test-slave-mvvj krb5kdc[25342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007890, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:18:10.005870 25452 init.cc:377] Logged in from keytab as kudu/127.10.255.65@KRBTEST.COM (short username kudu)
I20260806 09:18:10.008219 25452 webserver.cc:460] Webserver started at http://127.10.255.65:37367/ using document root <none> and password file <none>
I20260806 09:18:10.009030 25452 fs_manager.cc:359] Metadata directory not provided
I20260806 09:18:10.009159 25452 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:18:10.009477 25452 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:18:10.013157 25452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "b985b43c6448460a82ed96d6340db7fc"
format_stamp: "Formatted at 2026-08-06 09:18:10 on dist-test-slave-mvvj"
server_key: "60d397ecd75d2e63e57e4296511214f2"
server_key_iv: "6c5a56d994dce49cee500aeef9839ef9"
server_key_version: "encryptionkey@0"
I20260806 09:18:10.014094 25452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "b985b43c6448460a82ed96d6340db7fc"
format_stamp: "Formatted at 2026-08-06 09:18:10 on dist-test-slave-mvvj"
server_key: "60d397ecd75d2e63e57e4296511214f2"
server_key_iv: "6c5a56d994dce49cee500aeef9839ef9"
server_key_version: "encryptionkey@0"
I20260806 09:18:10.020963 25452 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260806 09:18:10.025290 25468 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:10.027176 25452 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.004s
I20260806 09:18:10.027464 25452 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "b985b43c6448460a82ed96d6340db7fc"
format_stamp: "Formatted at 2026-08-06 09:18:10 on dist-test-slave-mvvj"
server_key: "60d397ecd75d2e63e57e4296511214f2"
server_key_iv: "6c5a56d994dce49cee500aeef9839ef9"
server_key_version: "encryptionkey@0"
I20260806 09:18:10.027768 25452 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:18:10.051084 25452 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:18:10.055904 25452 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:18:10.056242 25452 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:18:10.057338 25452 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:18:10.058868 25452 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:18:10.058990 25452 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:10.059162 25452 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:18:10.059237 25452 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:10.096962 25452 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:45939
I20260806 09:18:10.097011 25584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:45939 every 8 connection(s)
I20260806 09:18:10.098455 25452 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:18:10.105751 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 25452
I20260806 09:18:10.105980 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:18:10.106778 11261 external_mini_cluster.cc:1428] Setting key 4af9bdc6fd770449cf5468bc7b383ed8
Aug 06 09:18:10 dist-test-slave-mvvj krb5kdc[25342](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007890, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:18:10.122869 25587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:10.101275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:46171 (local address 127.10.255.126:42049)
0806 09:18:10.101780 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:10.101787 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:10.102757 (+ 970us) server_negotiation.cc:407] Connection header received
0806 09:18:10.104830 (+ 2073us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:10.104835 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:10.104909 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:10.105023 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:10.106767 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:10.107751 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:10.110231 (+ 2480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:10.110773 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:10.110903 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:10.115978 (+ 5075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:10.115985 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:10.115988 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:10.116033 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:10.119218 (+ 3185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:10.120252 (+ 1034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:10.120265 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:10.120267 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:10.120404 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:10.120926 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:10.120931 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:10.120933 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:10.121219 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:10.121391 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:10.122201 (+ 810us) server_negotiation.cc:299] Negotiation successful
0806 09:18:10.122474 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":228,"threads_started":1}
I20260806 09:18:10.124028 25588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:10.101811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.65:46171)
0806 09:18:10.102580 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:10.102621 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:10.104518 (+ 1897us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:10.105252 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:10.105261 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:10.105805 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:18:10.106542 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:10.106564 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:10.108003 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:10.108008 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:10.109995 (+ 1987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:10.110018 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:10.111078 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:10.111090 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:10.111483 (+ 393us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:10.112396 (+ 913us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:18:10.112442 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:18:10.115607 (+ 3165us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:18:10.119431 (+ 3824us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:10.119444 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:10.119472 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:10.120099 (+ 627us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:10.120546 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:10.120551 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:10.120555 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:10.120779 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:10.121364 (+ 585us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:18:10.121374 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:18:10.121780 (+ 406us) client_negotiation.cc:769] Sending connection context
0806 09:18:10.122075 (+ 295us) client_negotiation.cc:240] Negotiation successful
0806 09:18:10.122707 (+ 632us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":288,"threads_started":1}
I20260806 09:18:10.125839 25585 heartbeater.cc:347] Connected to a master server at 127.10.255.126:42049
I20260806 09:18:10.126200 25585 heartbeater.cc:464] Registering TS with master...
I20260806 09:18:10.127174 25585 heartbeater.cc:511] Master 127.10.255.126:42049 requested a full tablet report, sending...
I20260806 09:18:10.130373 25388 ts_manager.cc:194] Registered new tserver with Master: b985b43c6448460a82ed96d6340db7fc (127.10.255.65:45939)
I20260806 09:18:10.133204 25388 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.65@KRBTEST.COM'} at 127.10.255.65:46171
WARNING: no policy specified for kudu/127.10.255.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
I20260806 09:18:10.172792 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42049
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:18:10.541402 25591 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:18:10.541823 25591 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:18:10.542016 25591 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:18:10.549865 25591 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:18:10.550068 25591 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:18:10.550259 25591 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:18:10.560863 25591 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42049
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:18:10.562348 25591 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:18:10.563788 25591 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:18:10.579584 25597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:10.579867 25596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:10.580160 25599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:18:10.581423 25591 server_base.cc:1034] running on GCE node
I20260806 09:18:10.582108 25591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:18:10.583115 25591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:18:10.584352 25591 hybrid_clock.cc:648] HybridClock initialized: now 1786007890584300 us; error 34 us; skew 500 ppm
I20260806 09:18:10.584792 25591 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:18:10 dist-test-slave-mvvj krb5kdc[25342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007890, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:18:10.588378 25591 init.cc:377] Logged in from keytab as kudu/127.10.255.66@KRBTEST.COM (short username kudu)
I20260806 09:18:10.590123 25591 webserver.cc:460] Webserver started at http://127.10.255.66:36767/ using document root <none> and password file <none>
I20260806 09:18:10.590905 25591 fs_manager.cc:359] Metadata directory not provided
I20260806 09:18:10.591082 25591 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:18:10.591462 25591 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:18:10.594919 25591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "d39fb161ad9c4a4daef355f425d4cb5e"
format_stamp: "Formatted at 2026-08-06 09:18:10 on dist-test-slave-mvvj"
server_key: "6d7aabd963a29709b3d5f4728c1d96c2"
server_key_iv: "923c07d6eb773c1969d548eb1673f8fd"
server_key_version: "encryptionkey@0"
I20260806 09:18:10.596021 25591 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "d39fb161ad9c4a4daef355f425d4cb5e"
format_stamp: "Formatted at 2026-08-06 09:18:10 on dist-test-slave-mvvj"
server_key: "6d7aabd963a29709b3d5f4728c1d96c2"
server_key_iv: "923c07d6eb773c1969d548eb1673f8fd"
server_key_version: "encryptionkey@0"
I20260806 09:18:10.601963 25591 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 09:18:10.605836 25606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:10.607336 25591 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 09:18:10.607535 25591 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "d39fb161ad9c4a4daef355f425d4cb5e"
format_stamp: "Formatted at 2026-08-06 09:18:10 on dist-test-slave-mvvj"
server_key: "6d7aabd963a29709b3d5f4728c1d96c2"
server_key_iv: "923c07d6eb773c1969d548eb1673f8fd"
server_key_version: "encryptionkey@0"
I20260806 09:18:10.607777 25591 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:18:10.626223 25591 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:18:10.631690 25591 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:18:10.632117 25591 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:18:10.633391 25591 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:18:10.635048 25591 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:18:10.635130 25591 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:10.635227 25591 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:18:10.635273 25591 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:10.673607 25591 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:46389
I20260806 09:18:10.673758 25721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:46389 every 8 connection(s)
I20260806 09:18:10.675544 25591 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:18:10.680941 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 25591
I20260806 09:18:10.681186 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:18:10.681747 11261 external_mini_cluster.cc:1428] Setting key 475081f34988bd2399ffde58a637bce8
Aug 06 09:18:10 dist-test-slave-mvvj krb5kdc[25342](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007890, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:18:10.702855 25724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:10.678594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:35683 (local address 127.10.255.126:42049)
0806 09:18:10.679118 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:10.679125 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:10.680095 (+ 970us) server_negotiation.cc:407] Connection header received
0806 09:18:10.682830 (+ 2735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:10.682835 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:10.682985 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:10.683128 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:10.685306 (+ 2178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:10.686081 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:10.688764 (+ 2683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:10.689274 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:10.689391 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:10.694558 (+ 5167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:10.694566 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:10.694571 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:10.694628 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:10.698779 (+ 4151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:10.699869 (+ 1090us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:10.699879 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:10.699886 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:10.700093 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:10.700722 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:10.700726 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:10.700728 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:10.701030 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:10.701164 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:10.702286 (+ 1122us) server_negotiation.cc:299] Negotiation successful
0806 09:18:10.702502 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":261,"threads_started":1}
I20260806 09:18:10.704516 25725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:10.679087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.66:35683)
0806 09:18:10.679919 (+ 832us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:10.679959 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:10.682465 (+ 2506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:10.683384 (+ 919us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:10.683403 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:10.684179 (+ 776us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:18:10.685083 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:10.685114 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:10.686266 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:10.686275 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:10.688553 (+ 2278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:10.688575 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:10.689553 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:10.689562 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:10.689960 (+ 398us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:10.690878 (+ 918us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:18:10.690916 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:18:10.694137 (+ 3221us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:18:10.699040 (+ 4903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:10.699050 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:10.699074 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:10.699632 (+ 558us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:10.700243 (+ 611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:10.700251 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:10.700258 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:10.700568 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:10.701193 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:18:10.701205 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:18:10.701770 (+ 565us) client_negotiation.cc:769] Sending connection context
0806 09:18:10.702151 (+ 381us) client_negotiation.cc:240] Negotiation successful
0806 09:18:10.702829 (+ 678us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":286,"threads_started":1}
I20260806 09:18:10.706432 25722 heartbeater.cc:347] Connected to a master server at 127.10.255.126:42049
I20260806 09:18:10.706869 25722 heartbeater.cc:464] Registering TS with master...
I20260806 09:18:10.707892 25722 heartbeater.cc:511] Master 127.10.255.126:42049 requested a full tablet report, sending...
I20260806 09:18:10.709946 25388 ts_manager.cc:194] Registered new tserver with Master: d39fb161ad9c4a4daef355f425d4cb5e (127.10.255.66:46389)
I20260806 09:18:10.710875 25388 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.66@KRBTEST.COM'} at 127.10.255.66:35683
WARNING: no policy specified for kudu/127.10.255.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
I20260806 09:18:10.754346 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42049
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:18:11.118252 25728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:18:11.118750 25728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:18:11.118952 25728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:18:11.128404 25728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:18:11.128623 25728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:18:11.128832 25728 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:18:11.137812 25585 heartbeater.cc:503] Master 127.10.255.126:42049 was elected leader, sending a full tablet report...
I20260806 09:18:11.141463 25728 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42049
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:18:11.142904 25728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:18:11.144443 25728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:18:11.159861 25734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:11.160007 25737 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:11.159816 25735 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:18:11.161108 25728 server_base.cc:1034] running on GCE node
I20260806 09:18:11.161939 25728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:18:11.163030 25728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:18:11.164270 25728 hybrid_clock.cc:648] HybridClock initialized: now 1786007891164204 us; error 63 us; skew 500 ppm
I20260806 09:18:11.164628 25728 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:18:11 dist-test-slave-mvvj krb5kdc[25342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007891, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:18:11.168184 25728 init.cc:377] Logged in from keytab as kudu/127.10.255.67@KRBTEST.COM (short username kudu)
I20260806 09:18:11.169904 25728 webserver.cc:460] Webserver started at http://127.10.255.67:32801/ using document root <none> and password file <none>
I20260806 09:18:11.170658 25728 fs_manager.cc:359] Metadata directory not provided
I20260806 09:18:11.170775 25728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:18:11.171046 25728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:18:11.174351 25728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7"
format_stamp: "Formatted at 2026-08-06 09:18:11 on dist-test-slave-mvvj"
server_key: "a3a5118cc0602c2a96e8163a95ff39e2"
server_key_iv: "cfe85997e845992d34cac86609109339"
server_key_version: "encryptionkey@0"
I20260806 09:18:11.175348 25728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7"
format_stamp: "Formatted at 2026-08-06 09:18:11 on dist-test-slave-mvvj"
server_key: "a3a5118cc0602c2a96e8163a95ff39e2"
server_key_iv: "cfe85997e845992d34cac86609109339"
server_key_version: "encryptionkey@0"
I20260806 09:18:11.181550 25728 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260806 09:18:11.185328 25744 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:11.186803 25728 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 09:18:11.186951 25728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7"
format_stamp: "Formatted at 2026-08-06 09:18:11 on dist-test-slave-mvvj"
server_key: "a3a5118cc0602c2a96e8163a95ff39e2"
server_key_iv: "cfe85997e845992d34cac86609109339"
server_key_version: "encryptionkey@0"
I20260806 09:18:11.187145 25728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:18:11.216602 25728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:18:11.221443 25728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:18:11.221786 25728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:18:11.222913 25728 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:18:11.224505 25728 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:18:11.224584 25728 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:11.224756 25728 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:18:11.224809 25728 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:11.261776 25728 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:45265
I20260806 09:18:11.261875 25858 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:45265 every 8 connection(s)
I20260806 09:18:11.263171 25728 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:18:11.273066 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 25728
I20260806 09:18:11.273288 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:18:11.273792 11261 external_mini_cluster.cc:1428] Setting key 898f3ba6ea4a0600bcc23c10bfd513c8
Aug 06 09:18:11 dist-test-slave-mvvj krb5kdc[25342](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007891, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:18:11.287024 25861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:11.266158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:44917 (local address 127.10.255.126:42049)
0806 09:18:11.266735 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:11.266739 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:11.267748 (+ 1009us) server_negotiation.cc:407] Connection header received
0806 09:18:11.269985 (+ 2237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:11.269992 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:11.270106 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:11.270242 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:11.272151 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.273217 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.275591 (+ 2374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.276228 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.276343 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:11.280789 (+ 4446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:11.280794 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:11.280797 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:11.280836 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:11.283757 (+ 2921us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:11.284670 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:11.284674 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:11.284676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:11.284802 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:11.285257 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:11.285260 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:11.285262 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:11.285533 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:11.285659 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:11.286497 (+ 838us) server_negotiation.cc:299] Negotiation successful
0806 09:18:11.286694 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":357,"threads_started":1}
I20260806 09:18:11.288125 25862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:11.266636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.67:44917)
0806 09:18:11.267424 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:11.267507 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:11.269571 (+ 2064us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:11.270546 (+ 975us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:11.270560 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:11.271177 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:18:11.271911 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:11.271954 (+ 43us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.273455 (+ 1501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.273462 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:11.275419 (+ 1957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:11.275436 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.276519 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.276527 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:11.276879 (+ 352us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:11.277834 (+ 955us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:18:11.277862 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:18:11.280502 (+ 2640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:18:11.283962 (+ 3460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:11.283971 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:11.283987 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:11.284530 (+ 543us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:11.284906 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:11.284910 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:11.284913 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:11.285149 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:11.285655 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:18:11.285661 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:18:11.286023 (+ 362us) client_negotiation.cc:769] Sending connection context
0806 09:18:11.286324 (+ 301us) client_negotiation.cc:240] Negotiation successful
0806 09:18:11.286784 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":333,"threads_started":1}
I20260806 09:18:11.289752 25859 heartbeater.cc:347] Connected to a master server at 127.10.255.126:42049
I20260806 09:18:11.290119 25859 heartbeater.cc:464] Registering TS with master...
I20260806 09:18:11.291101 25859 heartbeater.cc:511] Master 127.10.255.126:42049 requested a full tablet report, sending...
I20260806 09:18:11.292940 25387 ts_manager.cc:194] Registered new tserver with Master: 7542c0e9e9e244ee85b9067cb8e9bdf7 (127.10.255.67:45265)
I20260806 09:18:11.293903 25387 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.67@KRBTEST.COM'} at 127.10.255.67:44917
I20260806 09:18:11.303998 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 09:18:11.324661 25861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:11.309448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54628 (local address 127.10.255.126:42049)
0806 09:18:11.309749 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:11.309759 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:11.310173 (+ 414us) server_negotiation.cc:407] Connection header received
0806 09:18:11.310462 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:11.310467 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:11.310547 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:11.310672 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:11.312552 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.313403 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.314951 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.315413 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.315571 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:11.318409 (+ 2838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:11.318414 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:11.318418 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:11.318459 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:11.321540 (+ 3081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:11.322356 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:11.322361 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:11.322364 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:11.322505 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:11.322936 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:11.322941 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:11.322945 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:11.323330 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:11.323607 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:11.324021 (+ 414us) server_negotiation.cc:299] Negotiation successful
0806 09:18:11.324303 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260806 09:18:11.335068 25387 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54628:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:18:11.343485 25387 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:18:11.370750 25873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:11.358149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:46389 (local address 127.0.0.1:56056)
0806 09:18:11.360892 (+ 2743us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:11.360967 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:11.361327 (+ 360us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:11.362305 (+ 978us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:11.362311 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:11.362335 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:18:11.362620 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:11.362629 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.365133 (+ 2504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.365143 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:11.367428 (+ 2285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:11.367445 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.369531 (+ 2086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.369538 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:11.369839 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:11.369883 (+ 44us) client_negotiation.cc:769] Sending connection context
0806 09:18:11.370065 (+ 182us) client_negotiation.cc:240] Negotiation successful
0806 09:18:11.370284 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2342,"mutex_wait_us":87,"thread_start_us":2157,"threads_started":1}
I20260806 09:18:11.370682 25872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:11.358127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56056 (local address 127.10.255.66:46389)
0806 09:18:11.360100 (+ 1973us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:11.360114 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:11.361114 (+ 1000us) server_negotiation.cc:407] Connection header received
0806 09:18:11.361602 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:11.361614 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:11.361905 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:11.362051 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:18:11.362812 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.364893 (+ 2081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.367624 (+ 2731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.369294 (+ 1670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.369439 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:11.369670 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:11.370132 (+ 462us) server_negotiation.cc:299] Negotiation successful
0806 09:18:11.370309 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1711,"thread_start_us":3338,"threads_started":1}
I20260806 09:18:11.372020 25876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:11.359719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:45939 (local address 127.0.0.1:44746)
0806 09:18:11.363529 (+ 3810us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:11.363543 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:11.363711 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:11.364687 (+ 976us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:11.364691 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:11.364714 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:18:11.365214 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:11.365233 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.367074 (+ 1841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.367082 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:11.369231 (+ 2149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:11.369252 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.371349 (+ 2097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.371354 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:11.371481 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:11.371504 (+ 23us) client_negotiation.cc:769] Sending connection context
0806 09:18:11.371579 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 09:18:11.371674 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3694,"thread_start_us":3576,"threads_started":1}
I20260806 09:18:11.372963 25877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:11.360600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44746 (local address 127.10.255.65:45939)
0806 09:18:11.363172 (+ 2572us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:11.363179 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:11.363667 (+ 488us) server_negotiation.cc:407] Connection header received
0806 09:18:11.363935 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:11.363944 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:11.364214 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:11.364419 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:18:11.365471 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.366919 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.369436 (+ 2517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.371036 (+ 1600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.371194 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:11.371451 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:11.371749 (+ 298us) server_negotiation.cc:299] Negotiation successful
0806 09:18:11.371941 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2422,"thread_start_us":2288,"threads_started":1}
I20260806 09:18:11.375538 25874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:11.358244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:45265 (local address 127.0.0.1:53426)
0806 09:18:11.361498 (+ 3254us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:11.361517 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:11.361646 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:11.366364 (+ 4718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:11.366370 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:11.366397 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:18:11.366892 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:11.366905 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.368895 (+ 1990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.368900 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:11.372321 (+ 3421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:11.372337 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.374606 (+ 2269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.374613 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:11.374815 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:11.374861 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 09:18:11.374978 (+ 117us) client_negotiation.cc:240] Negotiation successful
0806 09:18:11.375145 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3097,"mutex_wait_us":2,"thread_start_us":2929,"threads_started":1}
I20260806 09:18:11.375607 25875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:11.359023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53426 (local address 127.10.255.67:45265)
0806 09:18:11.365703 (+ 6680us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:11.365713 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:11.365750 (+ 37us) server_negotiation.cc:407] Connection header received
0806 09:18:11.365852 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:11.365860 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:11.366125 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:11.366338 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:18:11.367139 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.368723 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.372577 (+ 3854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.374066 (+ 1489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.374216 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:11.374476 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:11.375056 (+ 580us) server_negotiation.cc:299] Negotiation successful
0806 09:18:11.375246 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6474,"thread_start_us":6279,"threads_started":1}
I20260806 09:18:11.375509 25655 tablet_service.cc:1467] Processing CreateTablet for tablet 34412556dc72482f94b87d0279ad55b6 (DEFAULT_TABLE table=test-table [id=96e08f9cd51f4307a6ab90114c5f7a8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:18:11.377092 25655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34412556dc72482f94b87d0279ad55b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:18:11.376868 25517 tablet_service.cc:1467] Processing CreateTablet for tablet 34412556dc72482f94b87d0279ad55b6 (DEFAULT_TABLE table=test-table [id=96e08f9cd51f4307a6ab90114c5f7a8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:18:11.378209 25517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34412556dc72482f94b87d0279ad55b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:18:11.379992 25793 tablet_service.cc:1467] Processing CreateTablet for tablet 34412556dc72482f94b87d0279ad55b6 (DEFAULT_TABLE table=test-table [id=96e08f9cd51f4307a6ab90114c5f7a8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:18:11.381569 25793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 34412556dc72482f94b87d0279ad55b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:18:11.398841 25878 tablet_bootstrap.cc:492] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc: Bootstrap starting.
I20260806 09:18:11.402915 25878 tablet_bootstrap.cc:654] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc: Neither blocks nor log segments found. Creating new log.
I20260806 09:18:11.404412 25878 log.cc:824] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc: Log is configured to *not* fsync() on all Append() calls
I20260806 09:18:11.407649 25879 tablet_bootstrap.cc:492] T 34412556dc72482f94b87d0279ad55b6 P d39fb161ad9c4a4daef355f425d4cb5e: Bootstrap starting.
I20260806 09:18:11.410885 25878 tablet_bootstrap.cc:492] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc: No bootstrap required, opened a new log
I20260806 09:18:11.411365 25878 ts_tablet_manager.cc:1397] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.000s
I20260806 09:18:11.413396 25879 tablet_bootstrap.cc:654] T 34412556dc72482f94b87d0279ad55b6 P d39fb161ad9c4a4daef355f425d4cb5e: Neither blocks nor log segments found. Creating new log.
I20260806 09:18:11.414559 25879 log.cc:824] T 34412556dc72482f94b87d0279ad55b6 P d39fb161ad9c4a4daef355f425d4cb5e: Log is configured to *not* fsync() on all Append() calls
I20260806 09:18:11.420173 25880 tablet_bootstrap.cc:492] T 34412556dc72482f94b87d0279ad55b6 P 7542c0e9e9e244ee85b9067cb8e9bdf7: Bootstrap starting.
I20260806 09:18:11.423939 25880 tablet_bootstrap.cc:654] T 34412556dc72482f94b87d0279ad55b6 P 7542c0e9e9e244ee85b9067cb8e9bdf7: Neither blocks nor log segments found. Creating new log.
I20260806 09:18:11.424391 25879 tablet_bootstrap.cc:492] T 34412556dc72482f94b87d0279ad55b6 P d39fb161ad9c4a4daef355f425d4cb5e: No bootstrap required, opened a new log
I20260806 09:18:11.424743 25879 ts_tablet_manager.cc:1397] T 34412556dc72482f94b87d0279ad55b6 P d39fb161ad9c4a4daef355f425d4cb5e: Time spent bootstrapping tablet: real 0.017s user 0.008s sys 0.000s
I20260806 09:18:11.425194 25880 log.cc:824] T 34412556dc72482f94b87d0279ad55b6 P 7542c0e9e9e244ee85b9067cb8e9bdf7: Log is configured to *not* fsync() on all Append() calls
I20260806 09:18:11.424955 25878 raft_consensus.cc:348] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39fb161ad9c4a4daef355f425d4cb5e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 46389 } } peers { permanent_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45265 } } peers { permanent_uuid: "b985b43c6448460a82ed96d6340db7fc" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45939 } }
I20260806 09:18:11.425706 25878 raft_consensus.cc:374] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:18:11.425843 25878 raft_consensus.cc:729] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b985b43c6448460a82ed96d6340db7fc, State: Initialized, Role: FOLLOWER
I20260806 09:18:11.426661 25878 consensus_queue.cc:260] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39fb161ad9c4a4daef355f425d4cb5e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 46389 } } peers { permanent_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45265 } } peers { permanent_uuid: "b985b43c6448460a82ed96d6340db7fc" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45939 } }
I20260806 09:18:11.428807 25878 ts_tablet_manager.cc:1428] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc: Time spent starting tablet: real 0.017s user 0.011s sys 0.009s
I20260806 09:18:11.428894 25880 tablet_bootstrap.cc:492] T 34412556dc72482f94b87d0279ad55b6 P 7542c0e9e9e244ee85b9067cb8e9bdf7: No bootstrap required, opened a new log
I20260806 09:18:11.429214 25880 ts_tablet_manager.cc:1397] T 34412556dc72482f94b87d0279ad55b6 P 7542c0e9e9e244ee85b9067cb8e9bdf7: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.001s
I20260806 09:18:11.436721 25879 raft_consensus.cc:348] T 34412556dc72482f94b87d0279ad55b6 P d39fb161ad9c4a4daef355f425d4cb5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39fb161ad9c4a4daef355f425d4cb5e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 46389 } } peers { permanent_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45265 } } peers { permanent_uuid: "b985b43c6448460a82ed96d6340db7fc" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45939 } }
I20260806 09:18:11.437402 25879 raft_consensus.cc:374] T 34412556dc72482f94b87d0279ad55b6 P d39fb161ad9c4a4daef355f425d4cb5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:18:11.437582 25879 raft_consensus.cc:729] T 34412556dc72482f94b87d0279ad55b6 P d39fb161ad9c4a4daef355f425d4cb5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d39fb161ad9c4a4daef355f425d4cb5e, State: Initialized, Role: FOLLOWER
I20260806 09:18:11.438304 25879 consensus_queue.cc:260] T 34412556dc72482f94b87d0279ad55b6 P d39fb161ad9c4a4daef355f425d4cb5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39fb161ad9c4a4daef355f425d4cb5e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 46389 } } peers { permanent_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45265 } } peers { permanent_uuid: "b985b43c6448460a82ed96d6340db7fc" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45939 } }
I20260806 09:18:11.439640 25722 heartbeater.cc:503] Master 127.10.255.126:42049 was elected leader, sending a full tablet report...
I20260806 09:18:11.439636 25880 raft_consensus.cc:348] T 34412556dc72482f94b87d0279ad55b6 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39fb161ad9c4a4daef355f425d4cb5e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 46389 } } peers { permanent_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45265 } } peers { permanent_uuid: "b985b43c6448460a82ed96d6340db7fc" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45939 } }
I20260806 09:18:11.440208 25880 raft_consensus.cc:374] T 34412556dc72482f94b87d0279ad55b6 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:18:11.440258 25879 ts_tablet_manager.cc:1428] T 34412556dc72482f94b87d0279ad55b6 P d39fb161ad9c4a4daef355f425d4cb5e: Time spent starting tablet: real 0.015s user 0.016s sys 0.000s
I20260806 09:18:11.440325 25880 raft_consensus.cc:729] T 34412556dc72482f94b87d0279ad55b6 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7542c0e9e9e244ee85b9067cb8e9bdf7, State: Initialized, Role: FOLLOWER
I20260806 09:18:11.440980 25880 consensus_queue.cc:260] T 34412556dc72482f94b87d0279ad55b6 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39fb161ad9c4a4daef355f425d4cb5e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 46389 } } peers { permanent_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45265 } } peers { permanent_uuid: "b985b43c6448460a82ed96d6340db7fc" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45939 } }
I20260806 09:18:11.442229 25859 heartbeater.cc:503] Master 127.10.255.126:42049 was elected leader, sending a full tablet report...
I20260806 09:18:11.443109 25880 ts_tablet_manager.cc:1428] T 34412556dc72482f94b87d0279ad55b6 P 7542c0e9e9e244ee85b9067cb8e9bdf7: Time spent starting tablet: real 0.014s user 0.011s sys 0.002s
W20260806 09:18:11.515115 25860 tablet.cc:2369] T 34412556dc72482f94b87d0279ad55b6 P 7542c0e9e9e244ee85b9067cb8e9bdf7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:18:11.599745 25884 raft_consensus.cc:482] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:18:11.600109 25884 raft_consensus.cc:504] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39fb161ad9c4a4daef355f425d4cb5e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 46389 } } peers { permanent_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45265 } } peers { permanent_uuid: "b985b43c6448460a82ed96d6340db7fc" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45939 } }
W20260806 09:18:11.601431 25586 tablet.cc:2369] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:18:11.602094 25884 leader_election.cc:288] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d39fb161ad9c4a4daef355f425d4cb5e (127.10.255.66:46389), 7542c0e9e9e244ee85b9067cb8e9bdf7 (127.10.255.67:45265)
I20260806 09:18:11.610499 25875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:11.602714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:43931 (local address 127.10.255.67:45265)
0806 09:18:11.603009 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:11.603019 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:11.603813 (+ 794us) server_negotiation.cc:407] Connection header received
0806 09:18:11.604087 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:11.604091 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:11.604156 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:11.604264 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:18:11.604923 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.605780 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.608331 (+ 2551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.609191 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.609425 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:11.609510 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:11.609991 (+ 481us) server_negotiation.cc:299] Negotiation successful
0806 09:18:11.610164 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260806 09:18:11.610612 25888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:11.602493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:45265 (local address 127.10.255.65:43931)
0806 09:18:11.603665 (+ 1172us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:11.603683 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:11.603911 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:11.604284 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:11.604289 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:11.604315 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:18:11.604754 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:11.604764 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.605929 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.605935 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:11.608088 (+ 2153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:11.608136 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.609521 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.609530 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:11.609750 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:11.609794 (+ 44us) client_negotiation.cc:769] Sending connection context
0806 09:18:11.609954 (+ 160us) client_negotiation.cc:240] Negotiation successful
0806 09:18:11.610165 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1027,"mutex_wait_us":1,"thread_start_us":803,"threads_started":1}
I20260806 09:18:11.610627 25872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:11.602717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:48609 (local address 127.10.255.66:46389)
0806 09:18:11.603048 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:11.603057 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:11.603874 (+ 817us) server_negotiation.cc:407] Connection header received
0806 09:18:11.604128 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:11.604132 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:11.604200 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:11.604307 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:18:11.605000 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.605866 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.608451 (+ 2585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.609522 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.609714 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:11.609796 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:11.610184 (+ 388us) server_negotiation.cc:299] Negotiation successful
0806 09:18:11.610339 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260806 09:18:11.611409 25887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:11.602578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:46389 (local address 127.10.255.65:48609)
0806 09:18:11.603724 (+ 1146us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:11.603740 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:11.603959 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:11.604323 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:11.604328 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:11.604351 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:18:11.604787 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:11.604796 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.606015 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.606022 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:11.608218 (+ 2196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:11.608235 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.609797 (+ 1562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.609806 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:11.609976 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:11.610008 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 09:18:11.610845 (+ 837us) client_negotiation.cc:240] Negotiation successful
0806 09:18:11.610985 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1034,"mutex_wait_us":41,"thread_start_us":670,"threads_started":1}
I20260806 09:18:11.611905 25813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34412556dc72482f94b87d0279ad55b6" candidate_uuid: "b985b43c6448460a82ed96d6340db7fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" is_pre_election: true
I20260806 09:18:11.612535 25675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34412556dc72482f94b87d0279ad55b6" candidate_uuid: "b985b43c6448460a82ed96d6340db7fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d39fb161ad9c4a4daef355f425d4cb5e" is_pre_election: true
I20260806 09:18:11.612627 25813 raft_consensus.cc:2454] T 34412556dc72482f94b87d0279ad55b6 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b985b43c6448460a82ed96d6340db7fc in term 0.
I20260806 09:18:11.612998 25675 raft_consensus.cc:2454] T 34412556dc72482f94b87d0279ad55b6 P d39fb161ad9c4a4daef355f425d4cb5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b985b43c6448460a82ed96d6340db7fc in term 0.
I20260806 09:18:11.613464 25472 leader_election.cc:302] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7542c0e9e9e244ee85b9067cb8e9bdf7, b985b43c6448460a82ed96d6340db7fc; no voters:
I20260806 09:18:11.613968 25884 raft_consensus.cc:2781] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:18:11.614143 25884 raft_consensus.cc:482] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:18:11.614271 25884 raft_consensus.cc:3037] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:18:11.616946 25884 raft_consensus.cc:504] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39fb161ad9c4a4daef355f425d4cb5e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 46389 } } peers { permanent_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45265 } } peers { permanent_uuid: "b985b43c6448460a82ed96d6340db7fc" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45939 } }
I20260806 09:18:11.617667 25884 leader_election.cc:288] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc [CANDIDATE]: Term 1 election: Requested vote from peers d39fb161ad9c4a4daef355f425d4cb5e (127.10.255.66:46389), 7542c0e9e9e244ee85b9067cb8e9bdf7 (127.10.255.67:45265)
I20260806 09:18:11.618501 25675 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34412556dc72482f94b87d0279ad55b6" candidate_uuid: "b985b43c6448460a82ed96d6340db7fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d39fb161ad9c4a4daef355f425d4cb5e"
I20260806 09:18:11.618535 25813 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "34412556dc72482f94b87d0279ad55b6" candidate_uuid: "b985b43c6448460a82ed96d6340db7fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7"
I20260806 09:18:11.618789 25675 raft_consensus.cc:3037] T 34412556dc72482f94b87d0279ad55b6 P d39fb161ad9c4a4daef355f425d4cb5e [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:18:11.618788 25813 raft_consensus.cc:3037] T 34412556dc72482f94b87d0279ad55b6 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:18:11.621428 25813 raft_consensus.cc:2454] T 34412556dc72482f94b87d0279ad55b6 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b985b43c6448460a82ed96d6340db7fc in term 1.
I20260806 09:18:11.621841 25675 raft_consensus.cc:2454] T 34412556dc72482f94b87d0279ad55b6 P d39fb161ad9c4a4daef355f425d4cb5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b985b43c6448460a82ed96d6340db7fc in term 1.
I20260806 09:18:11.622045 25472 leader_election.cc:302] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7542c0e9e9e244ee85b9067cb8e9bdf7, b985b43c6448460a82ed96d6340db7fc; no voters:
I20260806 09:18:11.622460 25884 raft_consensus.cc:2781] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:18:11.622999 25884 raft_consensus.cc:686] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc [term 1 LEADER]: Becoming Leader. State: Replica: b985b43c6448460a82ed96d6340db7fc, State: Running, Role: LEADER
I20260806 09:18:11.623634 25884 consensus_queue.cc:237] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39fb161ad9c4a4daef355f425d4cb5e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 46389 } } peers { permanent_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45265 } } peers { permanent_uuid: "b985b43c6448460a82ed96d6340db7fc" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45939 } }
I20260806 09:18:11.628922 25388 catalog_manager.cc:5495] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc reported cstate change: term changed from 0 to 1, leader changed from <none> to b985b43c6448460a82ed96d6340db7fc (127.10.255.65). New cstate: current_term: 1 leader_uuid: "b985b43c6448460a82ed96d6340db7fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d39fb161ad9c4a4daef355f425d4cb5e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 46389 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b985b43c6448460a82ed96d6340db7fc" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45939 } health_report { overall_health: HEALTHY } } }
W20260806 09:18:11.678036 25723 tablet.cc:2369] T 34412556dc72482f94b87d0279ad55b6 P d39fb161ad9c4a4daef355f425d4cb5e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:18:11.686285 25877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:11.678521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44758 (local address 127.10.255.65:45939)
0806 09:18:11.678740 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:11.678748 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:11.678775 (+ 27us) server_negotiation.cc:407] Connection header received
0806 09:18:11.678898 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:11.678904 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:11.679019 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:11.679183 (+ 164us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:18:11.679693 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.680616 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.683088 (+ 2472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.683524 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.683656 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:11.684631 (+ 975us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:18:11.685337 (+ 706us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:18:11.685468 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:11.685922 (+ 454us) server_negotiation.cc:299] Negotiation successful
0806 09:18:11.686041 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 09:18:11.696696 25675 raft_consensus.cc:1261] T 34412556dc72482f94b87d0279ad55b6 P d39fb161ad9c4a4daef355f425d4cb5e [term 1 FOLLOWER]: Refusing update from remote peer b985b43c6448460a82ed96d6340db7fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:18:11.696745 25813 raft_consensus.cc:1261] T 34412556dc72482f94b87d0279ad55b6 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [term 1 FOLLOWER]: Refusing update from remote peer b985b43c6448460a82ed96d6340db7fc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:18:11.697860 25889 consensus_queue.cc:1035] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d39fb161ad9c4a4daef355f425d4cb5e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:18:11.698261 25884 consensus_queue.cc:1035] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:18:11.712886 25893 mvcc.cc:205] Tried to move back new op lower bound from 7315488324377640960 to 7315488324094705664. Current Snapshot: MvccSnapshot[applied={T|T < 7315488324377640960}]
I20260806 09:18:11.729423 25388 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54628:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:18:11.729775 25388 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54628:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:18:11.734402 25388 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5: Sending DeleteTablet for 3 replicas of tablet 34412556dc72482f94b87d0279ad55b6
I20260806 09:18:11.736120 25793 tablet_service.cc:1514] Processing DeleteTablet for tablet 34412556dc72482f94b87d0279ad55b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:18:11 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:53426
I20260806 09:18:11.736140 25655 tablet_service.cc:1514] Processing DeleteTablet for tablet 34412556dc72482f94b87d0279ad55b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:18:11 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:56056
I20260806 09:18:11.736557 25517 tablet_service.cc:1514] Processing DeleteTablet for tablet 34412556dc72482f94b87d0279ad55b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:18:11 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:44746
I20260806 09:18:11.737653 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 25452
I20260806 09:18:11.749373 25904 tablet_replica.cc:330] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc: stopping tablet replica
I20260806 09:18:11.750090 25904 raft_consensus.cc:2229] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:18:11.750988 25904 raft_consensus.cc:2258] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:18:11.753912 25904 ts_tablet_manager.cc:1905] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:18:11.764768 25904 ts_tablet_manager.cc:1918] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:18:11.765022 25904 log.cc:1196] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/wal/wals/34412556dc72482f94b87d0279ad55b6
I20260806 09:18:11.765724 25904 ts_tablet_manager.cc:1939] T 34412556dc72482f94b87d0279ad55b6 P b985b43c6448460a82ed96d6340db7fc: Deleting consensus metadata
I20260806 09:18:11.765805 25903 tablet_replica.cc:330] T 34412556dc72482f94b87d0279ad55b6 P d39fb161ad9c4a4daef355f425d4cb5e: stopping tablet replica
I20260806 09:18:11.766310 25903 raft_consensus.cc:2229] T 34412556dc72482f94b87d0279ad55b6 P d39fb161ad9c4a4daef355f425d4cb5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:18:11.766912 25903 raft_consensus.cc:2258] T 34412556dc72482f94b87d0279ad55b6 P d39fb161ad9c4a4daef355f425d4cb5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:18:11.767805 25902 tablet_replica.cc:330] T 34412556dc72482f94b87d0279ad55b6 P 7542c0e9e9e244ee85b9067cb8e9bdf7: stopping tablet replica
I20260806 09:18:11.768139 25372 catalog_manager.cc:4841] TS b985b43c6448460a82ed96d6340db7fc (127.10.255.65:45939): tablet 34412556dc72482f94b87d0279ad55b6 (table test-table [id=96e08f9cd51f4307a6ab90114c5f7a8f]) successfully deleted
I20260806 09:18:11.768307 25902 raft_consensus.cc:2229] T 34412556dc72482f94b87d0279ad55b6 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:18:11.768771 25902 raft_consensus.cc:2258] T 34412556dc72482f94b87d0279ad55b6 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:18:11.770843 25902 ts_tablet_manager.cc:1905] T 34412556dc72482f94b87d0279ad55b6 P 7542c0e9e9e244ee85b9067cb8e9bdf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:18:11.771183 25903 ts_tablet_manager.cc:1905] T 34412556dc72482f94b87d0279ad55b6 P d39fb161ad9c4a4daef355f425d4cb5e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:18:11.778821 25902 ts_tablet_manager.cc:1918] T 34412556dc72482f94b87d0279ad55b6 P 7542c0e9e9e244ee85b9067cb8e9bdf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:18:11.779074 25902 log.cc:1196] T 34412556dc72482f94b87d0279ad55b6 P 7542c0e9e9e244ee85b9067cb8e9bdf7: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/34412556dc72482f94b87d0279ad55b6
I20260806 09:18:11.779258 25903 ts_tablet_manager.cc:1918] T 34412556dc72482f94b87d0279ad55b6 P d39fb161ad9c4a4daef355f425d4cb5e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:18:11.779464 25903 log.cc:1196] T 34412556dc72482f94b87d0279ad55b6 P d39fb161ad9c4a4daef355f425d4cb5e: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/34412556dc72482f94b87d0279ad55b6
I20260806 09:18:11.779708 25902 ts_tablet_manager.cc:1939] T 34412556dc72482f94b87d0279ad55b6 P 7542c0e9e9e244ee85b9067cb8e9bdf7: Deleting consensus metadata
I20260806 09:18:11.780098 25903 ts_tablet_manager.cc:1939] T 34412556dc72482f94b87d0279ad55b6 P d39fb161ad9c4a4daef355f425d4cb5e: Deleting consensus metadata
Aug 06 09:18:11 dist-test-slave-mvvj krb5kdc[25342](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.65@KRBTEST.COM
I20260806 09:18:11.781980 25373 catalog_manager.cc:4841] TS d39fb161ad9c4a4daef355f425d4cb5e (127.10.255.66:46389): tablet 34412556dc72482f94b87d0279ad55b6 (table test-table [id=96e08f9cd51f4307a6ab90114c5f7a8f]) successfully deleted
I20260806 09:18:11.782333 25375 catalog_manager.cc:4841] TS 7542c0e9e9e244ee85b9067cb8e9bdf7 (127.10.255.67:45265): tablet 34412556dc72482f94b87d0279ad55b6 (table test-table [id=96e08f9cd51f4307a6ab90114c5f7a8f]) successfully deleted
I20260806 09:18:11.790823 25877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:11.740861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44762 (local address 127.10.255.65:45939)
0806 09:18:11.741165 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:11.741173 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:11.762220 (+ 21047us) server_negotiation.cc:407] Connection header received
0806 09:18:11.762809 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:11.762815 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:11.762918 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:11.762998 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:11.769372 (+ 6374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.770696 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.774124 (+ 3428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.774879 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.775001 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:11.782142 (+ 7141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:11.782168 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:11.782191 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:11.782261 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:11.786792 (+ 4531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:11.787899 (+ 1107us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:11.787912 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:11.787916 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:11.788156 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:11.788720 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:11.788726 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:11.788730 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:11.789320 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:11.789721 (+ 401us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:11.790083 (+ 362us) server_negotiation.cc:299] Negotiation successful
0806 09:18:11.790414 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260806 09:18:11.791657 25580 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:18:11.906383 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 25452
I20260806 09:18:11.927045 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 25591
Aug 06 09:18:11 dist-test-slave-mvvj krb5kdc[25342](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.66@KRBTEST.COM
I20260806 09:18:11.945082 25872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:11.927785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56072 (local address 127.10.255.66:46389)
0806 09:18:11.927994 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:11.927999 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:11.928017 (+ 18us) server_negotiation.cc:407] Connection header received
0806 09:18:11.928171 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:11.928175 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:11.928243 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:11.928334 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:11.929837 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.930755 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.932446 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:11.932929 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:11.933116 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:11.938096 (+ 4980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:11.938116 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:11.938133 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:11.938182 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:11.941425 (+ 3243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:11.942338 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:11.942346 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:11.942348 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:11.942498 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:11.942965 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:11.942970 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:11.942973 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:11.943397 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:11.943746 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:11.944431 (+ 685us) server_negotiation.cc:299] Negotiation successful
0806 09:18:11.944686 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260806 09:18:11.945724 25717 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:18:12.040753 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 25591
I20260806 09:18:12.059684 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 25728
Aug 06 09:18:12 dist-test-slave-mvvj krb5kdc[25342](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.67@KRBTEST.COM
I20260806 09:18:12.077805 25875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:12.060671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53430 (local address 127.10.255.67:45265)
0806 09:18:12.060862 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:12.060869 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:12.060893 (+ 24us) server_negotiation.cc:407] Connection header received
0806 09:18:12.061008 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:12.061013 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:12.061094 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:12.061209 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:12.062705 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:12.063470 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:12.064921 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:12.065335 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:12.065490 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:12.070768 (+ 5278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:12.070788 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:12.070806 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:12.070853 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:12.074237 (+ 3384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:12.075235 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:12.075251 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:12.075253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:12.075546 (+ 293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:12.076144 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:12.076150 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:12.076154 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:12.076680 (+ 526us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:12.076947 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:12.077265 (+ 318us) server_negotiation.cc:299] Negotiation successful
0806 09:18:12.077463 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 09:18:12.078634 25853 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:18:12.174652 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 25728
I20260806 09:18:12.194629 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 25356
I20260806 09:18:12.196146 25420 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:18:12.312920 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 25356
I20260806 09:18:12.336397 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:42049
--webserver_interface=127.10.255.126
--webserver_port=46821
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:42049
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:18:12.696352 25910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:18:12.696763 25910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:18:12.696940 25910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:18:12.704682 25910 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:18:12.704873 25910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:18:12.704988 25910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:18:12.705086 25910 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:18:12.705173 25910 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:18:12.716248 25910 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:42049
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:42049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=46821
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:18:12.717962 25910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:18:12.719901 25910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:18:12.747537 25916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:12.747450 25917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:12.747473 25919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:18:12.749212 25910 server_base.cc:1034] running on GCE node
I20260806 09:18:12.750504 25910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:18:12.752915 25910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:18:12.754311 25910 hybrid_clock.cc:648] HybridClock initialized: now 1786007892754227 us; error 74 us; skew 500 ppm
I20260806 09:18:12.754892 25910 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:18:12 dist-test-slave-mvvj krb5kdc[25342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007892, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:18:12.764896 25910 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:18:12.767113 25910 webserver.cc:460] Webserver started at http://127.10.255.126:46821/ using document root <none> and password file <none>
I20260806 09:18:12.768148 25910 fs_manager.cc:359] Metadata directory not provided
I20260806 09:18:12.768354 25910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:18:12.775416 25910 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.002s sys 0.004s
I20260806 09:18:12.778913 25926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:12.780771 25910 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260806 09:18:12.781091 25910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "9bb051cfc4104bacab3e1877771537b5"
format_stamp: "Formatted at 2026-08-06 09:18:09 on dist-test-slave-mvvj"
server_key: "d13a559accc778ef1d38694d4ed2055f"
server_key_iv: "b40c0367368f8d245fa9b1ab0cab4f1e"
server_key_version: "encryptionkey@0"
I20260806 09:18:12.782392 25910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:18:12.795539 25910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:18:12.801187 25910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:18:12.801554 25910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:18:12.824237 25910 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:42049
I20260806 09:18:12.824357 25978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:42049 every 8 connection(s)
I20260806 09:18:12.826009 25910 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:18:12.834445 25979 sys_catalog.cc:263] Verifying existing consensus state
I20260806 09:18:12.835307 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 25910
I20260806 09:18:12.836478 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:45939
--local_ip_for_outbound_sockets=127.10.255.65
--tserver_master_addrs=127.10.255.126:42049
--webserver_port=37367
--webserver_interface=127.10.255.65
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:18:12.841015 25979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5: Bootstrap starting.
I20260806 09:18:12.865417 25979 log.cc:824] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5: Log is configured to *not* fsync() on all Append() calls
I20260806 09:18:12.882654 25979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 09:18:12.883303 25979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5: Bootstrap complete.
I20260806 09:18:12.894940 25979 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bb051cfc4104bacab3e1877771537b5" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42049 } }
I20260806 09:18:12.896071 25979 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bb051cfc4104bacab3e1877771537b5, State: Initialized, Role: FOLLOWER
I20260806 09:18:12.896826 25979 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bb051cfc4104bacab3e1877771537b5" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42049 } }
I20260806 09:18:12.897116 25979 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:18:12.897264 25979 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:18:12.897496 25979 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 1 FOLLOWER]: Advancing to term 2
I20260806 09:18:12.902423 25979 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bb051cfc4104bacab3e1877771537b5" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42049 } }
I20260806 09:18:12.903110 25979 leader_election.cc:302] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9bb051cfc4104bacab3e1877771537b5; no voters:
I20260806 09:18:12.903920 25979 leader_election.cc:288] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 09:18:12.904109 25983 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 09:18:12.905488 25983 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 2 LEADER]: Becoming Leader. State: Replica: 9bb051cfc4104bacab3e1877771537b5, State: Running, Role: LEADER
I20260806 09:18:12.906185 25983 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bb051cfc4104bacab3e1877771537b5" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42049 } }
I20260806 09:18:12.906782 25979 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:18:12.909140 25985 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9bb051cfc4104bacab3e1877771537b5. Latest consensus state: current_term: 2 leader_uuid: "9bb051cfc4104bacab3e1877771537b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bb051cfc4104bacab3e1877771537b5" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42049 } } }
I20260806 09:18:12.909734 25985 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [sys.catalog]: This master's current role is: LEADER
I20260806 09:18:12.910509 25984 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9bb051cfc4104bacab3e1877771537b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bb051cfc4104bacab3e1877771537b5" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42049 } } }
I20260806 09:18:12.910917 25984 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [sys.catalog]: This master's current role is: LEADER
I20260806 09:18:12.917526 25989 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:18:12.932121 25989 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:18:12.933849 25989 catalog_manager.cc:1259] Loaded cluster ID: b3ffcc36224642cba478bbe7ede84d44
I20260806 09:18:12.934048 25989 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:18:12.937563 25989 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260806 09:18:12.956425 25989 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260806 09:18:12.966970 25989 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:18:12.969040 25989 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5: Loaded TSK: 0
I20260806 09:18:12.970749 25989 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 09:18:13.237305 25981 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:18:13.237629 25981 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:18:13.237803 25981 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:18:13.245978 25981 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:18:13.246119 25981 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:18:13.246311 25981 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:18:13.257105 25981 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:45939
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=37367
--tserver_master_addrs=127.10.255.126:42049
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:18:13.258575 25981 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:18:13.260155 25981 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:18:13.275264 26008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:13.275399 26010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:13.276245 26007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:18:13.281771 25981 server_base.cc:1034] running on GCE node
I20260806 09:18:13.282721 25981 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:18:13.284125 25981 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:18:13.285406 25981 hybrid_clock.cc:648] HybridClock initialized: now 1786007893285357 us; error 41 us; skew 500 ppm
I20260806 09:18:13.285832 25981 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:18:13 dist-test-slave-mvvj krb5kdc[25342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007893, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:18:13.290307 25981 init.cc:377] Logged in from keytab as kudu/127.10.255.65@KRBTEST.COM (short username kudu)
I20260806 09:18:13.292236 25981 webserver.cc:460] Webserver started at http://127.10.255.65:37367/ using document root <none> and password file <none>
I20260806 09:18:13.293043 25981 fs_manager.cc:359] Metadata directory not provided
I20260806 09:18:13.293208 25981 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:18:13.299422 25981 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.004s
I20260806 09:18:13.302858 26017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:13.304689 25981 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.002s
I20260806 09:18:13.304916 25981 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "b985b43c6448460a82ed96d6340db7fc"
format_stamp: "Formatted at 2026-08-06 09:18:10 on dist-test-slave-mvvj"
server_key: "60d397ecd75d2e63e57e4296511214f2"
server_key_iv: "6c5a56d994dce49cee500aeef9839ef9"
server_key_version: "encryptionkey@0"
I20260806 09:18:13.306203 25981 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:18:13.353974 25981 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:18:13.359334 25981 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:18:13.359661 25981 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:18:13.360954 25981 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:18:13.362569 25981 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:18:13.362701 25981 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:13.362848 25981 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:18:13.362947 25981 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:13.402786 25981 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:45939
I20260806 09:18:13.402884 26133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:45939 every 8 connection(s)
I20260806 09:18:13.404425 25981 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:18:13.410657 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 25981
I20260806 09:18:13.411381 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:46389
--local_ip_for_outbound_sockets=127.10.255.66
--tserver_master_addrs=127.10.255.126:42049
--webserver_port=36767
--webserver_interface=127.10.255.66
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 09:18:13 dist-test-slave-mvvj krb5kdc[25342](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007893, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:18:13.434259 26137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:13.408346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:50729 (local address 127.10.255.126:42049)
0806 09:18:13.409109 (+ 763us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:13.409123 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:13.409577 (+ 454us) server_negotiation.cc:407] Connection header received
0806 09:18:13.412487 (+ 2910us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:13.412511 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:13.413056 (+ 545us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:13.413487 (+ 431us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:13.415106 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:13.417365 (+ 2259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:13.419189 (+ 1824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:13.420046 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:13.420196 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:13.425207 (+ 5011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:13.425216 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:13.425234 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:13.425282 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:13.428817 (+ 3535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:13.430028 (+ 1211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:13.430039 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:13.430045 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:13.430250 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:13.430878 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:13.430882 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:13.430884 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:13.431457 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:13.431640 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:13.432804 (+ 1164us) server_negotiation.cc:299] Negotiation successful
0806 09:18:13.433222 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":373,"threads_started":1}
I20260806 09:18:13.434795 26138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:13.408302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.65:50729)
0806 09:18:13.409369 (+ 1067us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:13.409424 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:13.411752 (+ 2328us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:13.413631 (+ 1879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:13.413640 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:13.414208 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:18:13.414815 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:13.414837 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:13.417583 (+ 2746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:13.417588 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:13.418969 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:13.418984 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:13.420331 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:13.420342 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:13.420702 (+ 360us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:13.421495 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:18:13.421534 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:18:13.424770 (+ 3236us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:18:13.429082 (+ 4312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:13.429096 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:13.429117 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:13.429846 (+ 729us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:13.430404 (+ 558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:13.430412 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:13.430419 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:13.430725 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:13.431645 (+ 920us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:18:13.431656 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:18:13.432203 (+ 547us) client_negotiation.cc:769] Sending connection context
0806 09:18:13.432581 (+ 378us) client_negotiation.cc:240] Negotiation successful
0806 09:18:13.433294 (+ 713us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":750,"thread_start_us":461,"threads_started":1}
I20260806 09:18:13.438525 26134 heartbeater.cc:347] Connected to a master server at 127.10.255.126:42049
I20260806 09:18:13.438989 26134 heartbeater.cc:464] Registering TS with master...
I20260806 09:18:13.439967 26134 heartbeater.cc:511] Master 127.10.255.126:42049 requested a full tablet report, sending...
I20260806 09:18:13.442862 25944 ts_manager.cc:194] Registered new tserver with Master: b985b43c6448460a82ed96d6340db7fc (127.10.255.65:45939)
I20260806 09:18:13.445407 25944 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.65@KRBTEST.COM'} at 127.10.255.65:50729
W20260806 09:18:13.798557 26139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:18:13.798903 26139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:18:13.799006 26139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:18:13.807340 26139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:18:13.807549 26139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:18:13.807680 26139 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:18:13.818303 26139 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:46389
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=36767
--tserver_master_addrs=127.10.255.126:42049
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:18:13.819715 26139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:18:13.821069 26139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:18:13.838019 26145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:13.838817 26144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:13.838019 26147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:18:13.839777 26139 server_base.cc:1034] running on GCE node
I20260806 09:18:13.840628 26139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:18:13.841830 26139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:18:13.843205 26139 hybrid_clock.cc:648] HybridClock initialized: now 1786007893843137 us; error 51 us; skew 500 ppm
I20260806 09:18:13.843642 26139 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:18:13 dist-test-slave-mvvj krb5kdc[25342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007893, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:18:13.847707 26139 init.cc:377] Logged in from keytab as kudu/127.10.255.66@KRBTEST.COM (short username kudu)
I20260806 09:18:13.849668 26139 webserver.cc:460] Webserver started at http://127.10.255.66:36767/ using document root <none> and password file <none>
I20260806 09:18:13.850512 26139 fs_manager.cc:359] Metadata directory not provided
I20260806 09:18:13.850708 26139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:18:13.857372 26139 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 09:18:13.860960 26154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:13.862588 26139 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:18:13.862826 26139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "d39fb161ad9c4a4daef355f425d4cb5e"
format_stamp: "Formatted at 2026-08-06 09:18:10 on dist-test-slave-mvvj"
server_key: "6d7aabd963a29709b3d5f4728c1d96c2"
server_key_iv: "923c07d6eb773c1969d548eb1673f8fd"
server_key_version: "encryptionkey@0"
I20260806 09:18:13.864176 26139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:18:13.891522 26139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:18:13.897017 26139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:18:13.897363 26139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:18:13.898574 26139 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:18:13.900226 26139 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:18:13.900369 26139 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:13.900523 26139 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:18:13.900622 26139 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:13.941149 26139 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:46389
I20260806 09:18:13.941258 26269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:46389 every 8 connection(s)
I20260806 09:18:13.942874 26139 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:18:13.946591 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 26139
I20260806 09:18:13.947504 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:45265
--local_ip_for_outbound_sockets=127.10.255.67
--tserver_master_addrs=127.10.255.126:42049
--webserver_port=32801
--webserver_interface=127.10.255.67
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 09:18:13 dist-test-slave-mvvj krb5kdc[25342](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007893, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:18:13.968750 26272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:13.946204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:60155 (local address 127.10.255.126:42049)
0806 09:18:13.946853 (+ 649us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:13.946861 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:13.947731 (+ 870us) server_negotiation.cc:407] Connection header received
0806 09:18:13.950093 (+ 2362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:13.950099 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:13.950234 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:13.950386 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:13.952346 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:13.953158 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:13.956067 (+ 2909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:13.956583 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:13.956769 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:13.961205 (+ 4436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:13.961211 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:13.961215 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:13.961257 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:13.964685 (+ 3428us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:13.965757 (+ 1072us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:13.965762 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:13.965765 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:13.965935 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:13.966506 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:13.966510 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:13.966512 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:13.966845 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:13.967086 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:13.967956 (+ 870us) server_negotiation.cc:299] Negotiation successful
0806 09:18:13.968248 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":381,"threads_started":1}
I20260806 09:18:13.969982 26273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:13.946618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.66:60155)
0806 09:18:13.947511 (+ 893us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:13.947557 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:13.949706 (+ 2149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:13.950698 (+ 992us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:13.950710 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:13.951324 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:18:13.952124 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:13.952146 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:13.953372 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:13.953377 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:13.955756 (+ 2379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:13.955777 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:13.956883 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:13.956892 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:13.957183 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:13.958033 (+ 850us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:18:13.958062 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:18:13.960868 (+ 2806us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:18:13.964933 (+ 4065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:13.964946 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:13.964977 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:13.965568 (+ 591us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:13.966084 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:13.966090 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:13.966094 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:13.966339 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:13.967025 (+ 686us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:18:13.967035 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:18:13.967482 (+ 447us) client_negotiation.cc:769] Sending connection context
0806 09:18:13.967784 (+ 302us) client_negotiation.cc:240] Negotiation successful
0806 09:18:13.968509 (+ 725us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":597,"thread_start_us":381,"threads_started":1}
I20260806 09:18:13.971933 26270 heartbeater.cc:347] Connected to a master server at 127.10.255.126:42049
I20260806 09:18:13.972312 26270 heartbeater.cc:464] Registering TS with master...
I20260806 09:18:13.973217 26270 heartbeater.cc:511] Master 127.10.255.126:42049 requested a full tablet report, sending...
I20260806 09:18:13.975028 25944 ts_manager.cc:194] Registered new tserver with Master: d39fb161ad9c4a4daef355f425d4cb5e (127.10.255.66:46389)
I20260806 09:18:13.976382 25944 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.66@KRBTEST.COM'} at 127.10.255.66:60155
W20260806 09:18:14.327564 26274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:18:14.327971 26274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:18:14.328097 26274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:18:14.336045 26274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:18:14.336176 26274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:18:14.336294 26274 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:18:14.347210 26274 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:45265
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=32801
--tserver_master_addrs=127.10.255.126:42049
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:18:14.348642 26274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:18:14.350036 26274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:18:14.364809 26279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:14.364959 26282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:14.364843 26280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:18:14.365842 26274 server_base.cc:1034] running on GCE node
I20260806 09:18:14.366496 26274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:18:14.367568 26274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:18:14.368819 26274 hybrid_clock.cc:648] HybridClock initialized: now 1786007894368748 us; error 93 us; skew 500 ppm
I20260806 09:18:14.369235 26274 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:18:14 dist-test-slave-mvvj krb5kdc[25342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007894, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:18:14.372716 26274 init.cc:377] Logged in from keytab as kudu/127.10.255.67@KRBTEST.COM (short username kudu)
I20260806 09:18:14.374287 26274 webserver.cc:460] Webserver started at http://127.10.255.67:32801/ using document root <none> and password file <none>
I20260806 09:18:14.374980 26274 fs_manager.cc:359] Metadata directory not provided
I20260806 09:18:14.375099 26274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:18:14.381278 26274 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260806 09:18:14.384670 26289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:14.386646 26274 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 09:18:14.386873 26274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7"
format_stamp: "Formatted at 2026-08-06 09:18:11 on dist-test-slave-mvvj"
server_key: "a3a5118cc0602c2a96e8163a95ff39e2"
server_key_iv: "cfe85997e845992d34cac86609109339"
server_key_version: "encryptionkey@0"
I20260806 09:18:14.388444 26274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:18:14.412582 26274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:18:14.417618 26274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:18:14.417948 26274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:18:14.419153 26274 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:18:14.420763 26274 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:18:14.420907 26274 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:14.421049 26274 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:18:14.421142 26274 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:14.449834 26134 heartbeater.cc:503] Master 127.10.255.126:42049 was elected leader, sending a full tablet report...
I20260806 09:18:14.460474 26274 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:45265
I20260806 09:18:14.460578 26404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:45265 every 8 connection(s)
I20260806 09:18:14.462067 26274 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:18:14.468155 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 26274
Aug 06 09:18:14 dist-test-slave-mvvj krb5kdc[25342](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007894, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:18:14.486399 26409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:14.469312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54640 (local address 127.10.255.126:42049)
0806 09:18:14.469844 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:14.469852 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:14.470262 (+ 410us) server_negotiation.cc:407] Connection header received
0806 09:18:14.470438 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:14.470443 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:14.470515 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:14.470611 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:14.472509 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.473343 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.474745 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.475352 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.475540 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:14.478988 (+ 3448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:14.478994 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:14.478998 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:14.479084 (+ 86us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:14.482652 (+ 3568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:14.483763 (+ 1111us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:14.483768 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:14.483770 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:14.484038 (+ 268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:14.484533 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:14.484539 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:14.484542 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:14.484943 (+ 401us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:14.485247 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:14.485655 (+ 408us) server_negotiation.cc:299] Negotiation successful
0806 09:18:14.485908 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":84,"server-negotiator.queue_time_us":413,"thread_start_us":313,"threads_started":1}
I20260806 09:18:14.488095 26272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:14.465659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:48581 (local address 127.10.255.126:42049)
0806 09:18:14.465885 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:14.465890 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:14.467155 (+ 1265us) server_negotiation.cc:407] Connection header received
0806 09:18:14.470102 (+ 2947us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:14.470107 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:14.470250 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:14.470383 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:14.472337 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.473178 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.474879 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.475379 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.475546 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:14.480648 (+ 5102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:14.480654 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:14.480658 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:14.480696 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:14.484086 (+ 3390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:14.485230 (+ 1144us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:14.485236 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:14.485240 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:14.485385 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:14.485960 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:14.485965 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:14.485968 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:14.486356 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:14.486528 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:14.487486 (+ 958us) server_negotiation.cc:299] Negotiation successful
0806 09:18:14.487735 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":91}
I20260806 09:18:14.489236 26407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:14.466088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.67:48581)
0806 09:18:14.466963 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:14.467009 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:14.469710 (+ 2701us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:14.470721 (+ 1011us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:14.470736 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:14.471424 (+ 688us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:18:14.472142 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:14.472163 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.473360 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.473366 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:14.474712 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:14.474725 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.475671 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.475681 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:14.476046 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:14.476795 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:18:14.476826 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:18:14.480272 (+ 3446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:18:14.484294 (+ 4022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:14.484303 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:14.484319 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:14.485072 (+ 753us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:14.485547 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:14.485552 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:14.485555 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:14.485832 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:14.486486 (+ 654us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:18:14.486495 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:18:14.487019 (+ 524us) client_negotiation.cc:769] Sending connection context
0806 09:18:14.487319 (+ 300us) client_negotiation.cc:240] Negotiation successful
0806 09:18:14.487952 (+ 633us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":380,"threads_started":1}
I20260806 09:18:14.490808 26405 heartbeater.cc:347] Connected to a master server at 127.10.255.126:42049
I20260806 09:18:14.491115 26405 heartbeater.cc:464] Registering TS with master...
I20260806 09:18:14.491940 26405 heartbeater.cc:511] Master 127.10.255.126:42049 requested a full tablet report, sending...
I20260806 09:18:14.493726 25944 ts_manager.cc:194] Registered new tserver with Master: 7542c0e9e9e244ee85b9067cb8e9bdf7 (127.10.255.67:45265)
I20260806 09:18:14.494635 25944 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.67@KRBTEST.COM'} at 127.10.255.67:48581
I20260806 09:18:14.502458 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 09:18:14.511550 26272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:14.503567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54652 (local address 127.10.255.126:42049)
0806 09:18:14.503814 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:14.503823 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:14.504460 (+ 637us) server_negotiation.cc:407] Connection header received
0806 09:18:14.504723 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:14.504728 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:14.504917 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:14.505080 (+ 163us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:18:14.505636 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.506632 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.508478 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.508985 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.509243 (+ 258us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:14.510100 (+ 857us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:18:14.510767 (+ 667us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:18:14.510884 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:14.511139 (+ 255us) server_negotiation.cc:299] Negotiation successful
0806 09:18:14.511223 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 09:18:14.512789 25944 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:54652:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:18:14.520888 25944 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:18:14.547816 26417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:14.534866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53438 (local address 127.10.255.67:45265)
0806 09:18:14.535810 (+ 944us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:14.535820 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:14.537072 (+ 1252us) server_negotiation.cc:407] Connection header received
0806 09:18:14.537201 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:14.537213 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:14.537526 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:14.537746 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:18:14.539076 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.541153 (+ 2077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.544712 (+ 3559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.546358 (+ 1646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.546529 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:14.546817 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:14.547251 (+ 434us) server_negotiation.cc:299] Negotiation successful
0806 09:18:14.547438 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":704,"thread_start_us":990,"threads_started":1}
I20260806 09:18:14.547962 26418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:14.534475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:45265 (local address 127.0.0.1:53438)
0806 09:18:14.536521 (+ 2046us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:14.536588 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:14.536829 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:14.538154 (+ 1325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:14.538162 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:14.538216 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:18:14.538803 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:14.538822 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.541388 (+ 2566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.541395 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:14.544444 (+ 3049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:14.544462 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.546620 (+ 2158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.546628 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:14.546974 (+ 346us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:14.547036 (+ 62us) client_negotiation.cc:769] Sending connection context
0806 09:18:14.547196 (+ 160us) client_negotiation.cc:240] Negotiation successful
0806 09:18:14.547430 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1756,"mutex_wait_us":60,"thread_start_us":3630,"threads_started":1}
I20260806 09:18:14.549474 26416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:14.534936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:45939 (local address 127.0.0.1:44776)
0806 09:18:14.538411 (+ 3475us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:14.538442 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:14.538602 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:14.540769 (+ 2167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:14.540774 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:14.540810 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:18:14.541317 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:14.541335 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.543801 (+ 2466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.543807 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:14.546062 (+ 2255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:14.546080 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.548655 (+ 2575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.548663 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:14.548826 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:14.548858 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 09:18:14.548947 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 09:18:14.549090 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3272,"thread_start_us":1121,"threads_started":1}
I20260806 09:18:14.550930 26421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:14.536319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44776 (local address 127.10.255.65:45939)
0806 09:18:14.539427 (+ 3108us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:14.539440 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:14.539480 (+ 40us) server_negotiation.cc:407] Connection header received
0806 09:18:14.539608 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:14.539621 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:14.540013 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:14.541001 (+ 988us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:18:14.541661 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.543609 (+ 1948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.546278 (+ 2669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.548325 (+ 2047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.548542 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:14.550246 (+ 1704us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:14.550339 (+ 93us) server_negotiation.cc:299] Negotiation successful
0806 09:18:14.550543 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2856,"thread_start_us":2614,"threads_started":1}
I20260806 09:18:14.551680 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:14.536089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56084 (local address 127.10.255.66:46389)
0806 09:18:14.540639 (+ 4550us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:14.540649 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:14.542019 (+ 1370us) server_negotiation.cc:407] Connection header received
0806 09:18:14.542303 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:14.542311 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:14.542541 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:14.542906 (+ 365us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:18:14.543640 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.545279 (+ 1639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.548349 (+ 3070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.549936 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.550104 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:14.550335 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:14.551110 (+ 775us) server_negotiation.cc:299] Negotiation successful
0806 09:18:14.551319 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4371,"thread_start_us":4260,"threads_started":1}
I20260806 09:18:14.551867 26419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:14.535513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:46389 (local address 127.0.0.1:56084)
0806 09:18:14.541829 (+ 6316us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:14.541856 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:14.542102 (+ 246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:14.542769 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:14.542774 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:14.542809 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:18:14.543383 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:14.543400 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.545461 (+ 2061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.545466 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:14.548090 (+ 2624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:14.548110 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.550498 (+ 2388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.550503 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:14.550650 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:14.550675 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 09:18:14.551061 (+ 386us) client_negotiation.cc:240] Negotiation successful
0806 09:18:14.551254 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6080,"mutex_wait_us":68,"thread_start_us":5713,"threads_started":1}
I20260806 09:18:14.552996 26338 tablet_service.cc:1467] Processing CreateTablet for tablet 611247ba62dd4029b95a109d67ceab05 (DEFAULT_TABLE table=test-table [id=377f321883b649f7ad8d99bf065812b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:18:14.554771 26338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 611247ba62dd4029b95a109d67ceab05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:18:14.555315 26067 tablet_service.cc:1467] Processing CreateTablet for tablet 611247ba62dd4029b95a109d67ceab05 (DEFAULT_TABLE table=test-table [id=377f321883b649f7ad8d99bf065812b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:18:14.555581 26203 tablet_service.cc:1467] Processing CreateTablet for tablet 611247ba62dd4029b95a109d67ceab05 (DEFAULT_TABLE table=test-table [id=377f321883b649f7ad8d99bf065812b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:18:14.557032 26067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 611247ba62dd4029b95a109d67ceab05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:18:14.557062 26203 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 611247ba62dd4029b95a109d67ceab05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:18:14.572198 26422 tablet_bootstrap.cc:492] T 611247ba62dd4029b95a109d67ceab05 P d39fb161ad9c4a4daef355f425d4cb5e: Bootstrap starting.
I20260806 09:18:14.573413 26423 tablet_bootstrap.cc:492] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7: Bootstrap starting.
I20260806 09:18:14.575261 26424 tablet_bootstrap.cc:492] T 611247ba62dd4029b95a109d67ceab05 P b985b43c6448460a82ed96d6340db7fc: Bootstrap starting.
I20260806 09:18:14.577914 26422 tablet_bootstrap.cc:654] T 611247ba62dd4029b95a109d67ceab05 P d39fb161ad9c4a4daef355f425d4cb5e: Neither blocks nor log segments found. Creating new log.
I20260806 09:18:14.577915 26423 tablet_bootstrap.cc:654] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7: Neither blocks nor log segments found. Creating new log.
I20260806 09:18:14.578374 26424 tablet_bootstrap.cc:654] T 611247ba62dd4029b95a109d67ceab05 P b985b43c6448460a82ed96d6340db7fc: Neither blocks nor log segments found. Creating new log.
I20260806 09:18:14.579654 26423 log.cc:824] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7: Log is configured to *not* fsync() on all Append() calls
I20260806 09:18:14.579717 26424 log.cc:824] T 611247ba62dd4029b95a109d67ceab05 P b985b43c6448460a82ed96d6340db7fc: Log is configured to *not* fsync() on all Append() calls
I20260806 09:18:14.580125 26422 log.cc:824] T 611247ba62dd4029b95a109d67ceab05 P d39fb161ad9c4a4daef355f425d4cb5e: Log is configured to *not* fsync() on all Append() calls
I20260806 09:18:14.583323 26424 tablet_bootstrap.cc:492] T 611247ba62dd4029b95a109d67ceab05 P b985b43c6448460a82ed96d6340db7fc: No bootstrap required, opened a new log
I20260806 09:18:14.583432 26423 tablet_bootstrap.cc:492] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7: No bootstrap required, opened a new log
I20260806 09:18:14.583638 26422 tablet_bootstrap.cc:492] T 611247ba62dd4029b95a109d67ceab05 P d39fb161ad9c4a4daef355f425d4cb5e: No bootstrap required, opened a new log
I20260806 09:18:14.583740 26423 ts_tablet_manager.cc:1397] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7: Time spent bootstrapping tablet: real 0.011s user 0.010s sys 0.000s
I20260806 09:18:14.583736 26424 ts_tablet_manager.cc:1397] T 611247ba62dd4029b95a109d67ceab05 P b985b43c6448460a82ed96d6340db7fc: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260806 09:18:14.583943 26422 ts_tablet_manager.cc:1397] T 611247ba62dd4029b95a109d67ceab05 P d39fb161ad9c4a4daef355f425d4cb5e: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.004s
I20260806 09:18:14.593508 26424 raft_consensus.cc:348] T 611247ba62dd4029b95a109d67ceab05 P b985b43c6448460a82ed96d6340db7fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45265 } } peers { permanent_uuid: "b985b43c6448460a82ed96d6340db7fc" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45939 } } peers { permanent_uuid: "d39fb161ad9c4a4daef355f425d4cb5e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 46389 } }
I20260806 09:18:14.594055 26424 raft_consensus.cc:374] T 611247ba62dd4029b95a109d67ceab05 P b985b43c6448460a82ed96d6340db7fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:18:14.594192 26424 raft_consensus.cc:729] T 611247ba62dd4029b95a109d67ceab05 P b985b43c6448460a82ed96d6340db7fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b985b43c6448460a82ed96d6340db7fc, State: Initialized, Role: FOLLOWER
I20260806 09:18:14.594916 26424 consensus_queue.cc:260] T 611247ba62dd4029b95a109d67ceab05 P b985b43c6448460a82ed96d6340db7fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45265 } } peers { permanent_uuid: "b985b43c6448460a82ed96d6340db7fc" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45939 } } peers { permanent_uuid: "d39fb161ad9c4a4daef355f425d4cb5e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 46389 } }
I20260806 09:18:14.595395 26423 raft_consensus.cc:348] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45265 } } peers { permanent_uuid: "b985b43c6448460a82ed96d6340db7fc" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45939 } } peers { permanent_uuid: "d39fb161ad9c4a4daef355f425d4cb5e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 46389 } }
I20260806 09:18:14.595398 26422 raft_consensus.cc:348] T 611247ba62dd4029b95a109d67ceab05 P d39fb161ad9c4a4daef355f425d4cb5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45265 } } peers { permanent_uuid: "b985b43c6448460a82ed96d6340db7fc" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45939 } } peers { permanent_uuid: "d39fb161ad9c4a4daef355f425d4cb5e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 46389 } }
I20260806 09:18:14.595927 26422 raft_consensus.cc:374] T 611247ba62dd4029b95a109d67ceab05 P d39fb161ad9c4a4daef355f425d4cb5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:18:14.595969 26423 raft_consensus.cc:374] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:18:14.596100 26422 raft_consensus.cc:729] T 611247ba62dd4029b95a109d67ceab05 P d39fb161ad9c4a4daef355f425d4cb5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d39fb161ad9c4a4daef355f425d4cb5e, State: Initialized, Role: FOLLOWER
I20260806 09:18:14.596123 26423 raft_consensus.cc:729] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7542c0e9e9e244ee85b9067cb8e9bdf7, State: Initialized, Role: FOLLOWER
I20260806 09:18:14.596865 26423 consensus_queue.cc:260] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45265 } } peers { permanent_uuid: "b985b43c6448460a82ed96d6340db7fc" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45939 } } peers { permanent_uuid: "d39fb161ad9c4a4daef355f425d4cb5e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 46389 } }
I20260806 09:18:14.596884 26422 consensus_queue.cc:260] T 611247ba62dd4029b95a109d67ceab05 P d39fb161ad9c4a4daef355f425d4cb5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45265 } } peers { permanent_uuid: "b985b43c6448460a82ed96d6340db7fc" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45939 } } peers { permanent_uuid: "d39fb161ad9c4a4daef355f425d4cb5e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 46389 } }
I20260806 09:18:14.597185 26424 ts_tablet_manager.cc:1428] T 611247ba62dd4029b95a109d67ceab05 P b985b43c6448460a82ed96d6340db7fc: Time spent starting tablet: real 0.013s user 0.014s sys 0.001s
I20260806 09:18:14.601214 26405 heartbeater.cc:503] Master 127.10.255.126:42049 was elected leader, sending a full tablet report...
I20260806 09:18:14.601261 26270 heartbeater.cc:503] Master 127.10.255.126:42049 was elected leader, sending a full tablet report...
I20260806 09:18:14.601805 26423 ts_tablet_manager.cc:1428] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7: Time spent starting tablet: real 0.018s user 0.013s sys 0.003s
I20260806 09:18:14.602720 26422 ts_tablet_manager.cc:1428] T 611247ba62dd4029b95a109d67ceab05 P d39fb161ad9c4a4daef355f425d4cb5e: Time spent starting tablet: real 0.019s user 0.013s sys 0.004s
W20260806 09:18:14.657449 26135 tablet.cc:2369] T 611247ba62dd4029b95a109d67ceab05 P b985b43c6448460a82ed96d6340db7fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 09:18:14.695358 26271 tablet.cc:2369] T 611247ba62dd4029b95a109d67ceab05 P d39fb161ad9c4a4daef355f425d4cb5e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 09:18:14.713986 26406 tablet.cc:2369] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:18:14.857824 26430 raft_consensus.cc:482] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:18:14.858204 26430 raft_consensus.cc:504] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45265 } } peers { permanent_uuid: "b985b43c6448460a82ed96d6340db7fc" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45939 } } peers { permanent_uuid: "d39fb161ad9c4a4daef355f425d4cb5e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 46389 } }
I20260806 09:18:14.860147 26430 leader_election.cc:288] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b985b43c6448460a82ed96d6340db7fc (127.10.255.65:45939), d39fb161ad9c4a4daef355f425d4cb5e (127.10.255.66:46389)
I20260806 09:18:14.867594 26421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:14.860801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:51131 (local address 127.10.255.65:45939)
0806 09:18:14.861022 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:14.861028 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:14.861126 (+ 98us) server_negotiation.cc:407] Connection header received
0806 09:18:14.861431 (+ 305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:14.861437 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:14.861525 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:14.861649 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:18:14.862191 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.863199 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.865296 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.866559 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.866709 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:14.866768 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:14.867204 (+ 436us) server_negotiation.cc:299] Negotiation successful
0806 09:18:14.867316 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 09:18:14.867728 26407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:14.860534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:45939 (local address 127.10.255.67:51131)
0806 09:18:14.860944 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:14.860971 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:14.861235 (+ 264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:14.861762 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:14.861771 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:14.861808 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:18:14.862016 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:14.862031 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.863361 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.863367 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:14.865105 (+ 1738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:14.865118 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.866746 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.866754 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:14.866985 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:14.867029 (+ 44us) client_negotiation.cc:769] Sending connection context
0806 09:18:14.867147 (+ 118us) client_negotiation.cc:240] Negotiation successful
0806 09:18:14.867322 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231}
I20260806 09:18:14.868673 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:14.860829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:50595 (local address 127.10.255.66:46389)
0806 09:18:14.861060 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:14.861067 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:14.861731 (+ 664us) server_negotiation.cc:407] Connection header received
0806 09:18:14.861859 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:14.861865 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:14.861947 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:14.862070 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:18:14.862846 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.863877 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.866034 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.867422 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.867596 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:14.867684 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:14.868264 (+ 580us) server_negotiation.cc:299] Negotiation successful
0806 09:18:14.868387 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260806 09:18:14.868680 26431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:14.860675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:46389 (local address 127.10.255.67:50595)
0806 09:18:14.861586 (+ 911us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:14.861606 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:14.861736 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:14.862134 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:14.862138 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:14.862166 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:18:14.862635 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:14.862649 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.864069 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.864073 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:14.865822 (+ 1749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:14.865837 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.867768 (+ 1931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.867776 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:14.868031 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:14.868076 (+ 45us) client_negotiation.cc:769] Sending connection context
0806 09:18:14.868206 (+ 130us) client_negotiation.cc:240] Negotiation successful
0806 09:18:14.868355 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":770,"thread_start_us":528,"threads_started":1}
I20260806 09:18:14.869261 26088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "611247ba62dd4029b95a109d67ceab05" candidate_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b985b43c6448460a82ed96d6340db7fc" is_pre_election: true
I20260806 09:18:14.869992 26088 raft_consensus.cc:2454] T 611247ba62dd4029b95a109d67ceab05 P b985b43c6448460a82ed96d6340db7fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7542c0e9e9e244ee85b9067cb8e9bdf7 in term 0.
I20260806 09:18:14.869983 26225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "611247ba62dd4029b95a109d67ceab05" candidate_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d39fb161ad9c4a4daef355f425d4cb5e" is_pre_election: true
I20260806 09:18:14.870502 26225 raft_consensus.cc:2454] T 611247ba62dd4029b95a109d67ceab05 P d39fb161ad9c4a4daef355f425d4cb5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7542c0e9e9e244ee85b9067cb8e9bdf7 in term 0.
I20260806 09:18:14.870959 26290 leader_election.cc:302] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7542c0e9e9e244ee85b9067cb8e9bdf7, b985b43c6448460a82ed96d6340db7fc; no voters:
I20260806 09:18:14.871492 26430 raft_consensus.cc:2781] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:18:14.871698 26430 raft_consensus.cc:482] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:18:14.871834 26430 raft_consensus.cc:3037] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:18:14.874357 26430 raft_consensus.cc:504] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45265 } } peers { permanent_uuid: "b985b43c6448460a82ed96d6340db7fc" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45939 } } peers { permanent_uuid: "d39fb161ad9c4a4daef355f425d4cb5e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 46389 } }
I20260806 09:18:14.875085 26430 leader_election.cc:288] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [CANDIDATE]: Term 1 election: Requested vote from peers b985b43c6448460a82ed96d6340db7fc (127.10.255.65:45939), d39fb161ad9c4a4daef355f425d4cb5e (127.10.255.66:46389)
I20260806 09:18:14.875720 26225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "611247ba62dd4029b95a109d67ceab05" candidate_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d39fb161ad9c4a4daef355f425d4cb5e"
I20260806 09:18:14.875741 26088 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "611247ba62dd4029b95a109d67ceab05" candidate_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b985b43c6448460a82ed96d6340db7fc"
I20260806 09:18:14.876015 26225 raft_consensus.cc:3037] T 611247ba62dd4029b95a109d67ceab05 P d39fb161ad9c4a4daef355f425d4cb5e [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:18:14.876084 26088 raft_consensus.cc:3037] T 611247ba62dd4029b95a109d67ceab05 P b985b43c6448460a82ed96d6340db7fc [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:18:14.878522 26225 raft_consensus.cc:2454] T 611247ba62dd4029b95a109d67ceab05 P d39fb161ad9c4a4daef355f425d4cb5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7542c0e9e9e244ee85b9067cb8e9bdf7 in term 1.
I20260806 09:18:14.878798 26088 raft_consensus.cc:2454] T 611247ba62dd4029b95a109d67ceab05 P b985b43c6448460a82ed96d6340db7fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7542c0e9e9e244ee85b9067cb8e9bdf7 in term 1.
I20260806 09:18:14.879134 26291 leader_election.cc:302] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7542c0e9e9e244ee85b9067cb8e9bdf7, d39fb161ad9c4a4daef355f425d4cb5e; no voters:
I20260806 09:18:14.879577 26430 raft_consensus.cc:2781] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:18:14.880178 26430 raft_consensus.cc:686] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [term 1 LEADER]: Becoming Leader. State: Replica: 7542c0e9e9e244ee85b9067cb8e9bdf7, State: Running, Role: LEADER
I20260806 09:18:14.880805 26430 consensus_queue.cc:237] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45265 } } peers { permanent_uuid: "b985b43c6448460a82ed96d6340db7fc" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45939 } } peers { permanent_uuid: "d39fb161ad9c4a4daef355f425d4cb5e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 46389 } }
I20260806 09:18:14.886431 25943 catalog_manager.cc:5495] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7542c0e9e9e244ee85b9067cb8e9bdf7 (127.10.255.67). New cstate: current_term: 1 leader_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b985b43c6448460a82ed96d6340db7fc" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45939 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d39fb161ad9c4a4daef355f425d4cb5e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 46389 } health_report { overall_health: UNKNOWN } } }
I20260806 09:18:14.925349 26417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:14.918204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53444 (local address 127.10.255.67:45265)
0806 09:18:14.918438 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:14.918443 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:14.918463 (+ 20us) server_negotiation.cc:407] Connection header received
0806 09:18:14.918712 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:14.918716 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:14.918804 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:14.919142 (+ 338us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:18:14.919785 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.920745 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.922610 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:14.923061 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:14.923170 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:14.923811 (+ 641us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:18:14.924554 (+ 743us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:18:14.924691 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:14.924893 (+ 202us) server_negotiation.cc:299] Negotiation successful
0806 09:18:14.924982 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260806 09:18:14.935025 26225 raft_consensus.cc:1261] T 611247ba62dd4029b95a109d67ceab05 P d39fb161ad9c4a4daef355f425d4cb5e [term 1 FOLLOWER]: Refusing update from remote peer 7542c0e9e9e244ee85b9067cb8e9bdf7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:18:14.935030 26088 raft_consensus.cc:1261] T 611247ba62dd4029b95a109d67ceab05 P b985b43c6448460a82ed96d6340db7fc [term 1 FOLLOWER]: Refusing update from remote peer 7542c0e9e9e244ee85b9067cb8e9bdf7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:18:14.936326 26432 consensus_queue.cc:1035] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b985b43c6448460a82ed96d6340db7fc" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45939 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:18:14.936833 26430 consensus_queue.cc:1035] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d39fb161ad9c4a4daef355f425d4cb5e" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 46389 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:18:14.953601 26435 mvcc.cc:205] Tried to move back new op lower bound from 7315488337641701376 to 7315488337436958720. Current Snapshot: MvccSnapshot[applied={T|T < 7315488337641701376}]
I20260806 09:18:14.955219 26437 mvcc.cc:205] Tried to move back new op lower bound from 7315488337641701376 to 7315488337436958720. Current Snapshot: MvccSnapshot[applied={T|T < 7315488337641701376}]
I20260806 09:18:14.959754 26436 mvcc.cc:205] Tried to move back new op lower bound from 7315488337641701376 to 7315488337436958720. Current Snapshot: MvccSnapshot[applied={T|T < 7315488337641701376}]
I20260806 09:18:14.984340 25943 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:54652:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:18:14.984731 25943 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:54652:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:18:14.990186 25943 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5: Sending DeleteTablet for 3 replicas of tablet 611247ba62dd4029b95a109d67ceab05
I20260806 09:18:14.992076 26338 tablet_service.cc:1514] Processing DeleteTablet for tablet 611247ba62dd4029b95a109d67ceab05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:18:14 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:53438
I20260806 09:18:14.992373 26067 tablet_service.cc:1514] Processing DeleteTablet for tablet 611247ba62dd4029b95a109d67ceab05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:18:14 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:44776
I20260806 09:18:14.992661 26203 tablet_service.cc:1514] Processing DeleteTablet for tablet 611247ba62dd4029b95a109d67ceab05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:18:14 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:56084
I20260806 09:18:14.994004 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 25981
I20260806 09:18:15.003818 26446 tablet_replica.cc:330] T 611247ba62dd4029b95a109d67ceab05 P b985b43c6448460a82ed96d6340db7fc: stopping tablet replica
I20260806 09:18:15.004765 26447 tablet_replica.cc:330] T 611247ba62dd4029b95a109d67ceab05 P d39fb161ad9c4a4daef355f425d4cb5e: stopping tablet replica
I20260806 09:18:15.005159 26445 tablet_replica.cc:330] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7: stopping tablet replica
I20260806 09:18:15.005759 26445 raft_consensus.cc:2229] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:18:15.006050 26446 raft_consensus.cc:2229] T 611247ba62dd4029b95a109d67ceab05 P b985b43c6448460a82ed96d6340db7fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:18:15.006247 26447 raft_consensus.cc:2229] T 611247ba62dd4029b95a109d67ceab05 P d39fb161ad9c4a4daef355f425d4cb5e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:18:15.006799 26445 raft_consensus.cc:2258] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:18:15.007205 26446 raft_consensus.cc:2258] T 611247ba62dd4029b95a109d67ceab05 P b985b43c6448460a82ed96d6340db7fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:18:15.009810 26447 raft_consensus.cc:2258] T 611247ba62dd4029b95a109d67ceab05 P d39fb161ad9c4a4daef355f425d4cb5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:18:15.009963 26445 ts_tablet_manager.cc:1905] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:18:15.012522 26447 ts_tablet_manager.cc:1905] T 611247ba62dd4029b95a109d67ceab05 P d39fb161ad9c4a4daef355f425d4cb5e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:18:15.013334 26446 ts_tablet_manager.cc:1905] T 611247ba62dd4029b95a109d67ceab05 P b985b43c6448460a82ed96d6340db7fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:18:15.019032 26445 ts_tablet_manager.cc:1918] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:18:15.019392 26445 log.cc:1196] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/611247ba62dd4029b95a109d67ceab05
I20260806 09:18:15.020260 26445 ts_tablet_manager.cc:1939] T 611247ba62dd4029b95a109d67ceab05 P 7542c0e9e9e244ee85b9067cb8e9bdf7: Deleting consensus metadata
I20260806 09:18:15.022841 25931 catalog_manager.cc:4841] TS 7542c0e9e9e244ee85b9067cb8e9bdf7 (127.10.255.67:45265): tablet 611247ba62dd4029b95a109d67ceab05 (table test-table [id=377f321883b649f7ad8d99bf065812b5]) successfully deleted
I20260806 09:18:15.023563 26446 ts_tablet_manager.cc:1918] T 611247ba62dd4029b95a109d67ceab05 P b985b43c6448460a82ed96d6340db7fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:18:15.023818 26446 log.cc:1196] T 611247ba62dd4029b95a109d67ceab05 P b985b43c6448460a82ed96d6340db7fc: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/wal/wals/611247ba62dd4029b95a109d67ceab05
I20260806 09:18:15.024631 26446 ts_tablet_manager.cc:1939] T 611247ba62dd4029b95a109d67ceab05 P b985b43c6448460a82ed96d6340db7fc: Deleting consensus metadata
I20260806 09:18:15.026825 25927 catalog_manager.cc:4841] TS b985b43c6448460a82ed96d6340db7fc (127.10.255.65:45939): tablet 611247ba62dd4029b95a109d67ceab05 (table test-table [id=377f321883b649f7ad8d99bf065812b5]) successfully deleted
I20260806 09:18:15.028151 26447 ts_tablet_manager.cc:1918] T 611247ba62dd4029b95a109d67ceab05 P d39fb161ad9c4a4daef355f425d4cb5e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:18:15.028353 26447 log.cc:1196] T 611247ba62dd4029b95a109d67ceab05 P d39fb161ad9c4a4daef355f425d4cb5e: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/611247ba62dd4029b95a109d67ceab05
I20260806 09:18:15.028964 26447 ts_tablet_manager.cc:1939] T 611247ba62dd4029b95a109d67ceab05 P d39fb161ad9c4a4daef355f425d4cb5e: Deleting consensus metadata
I20260806 09:18:15.030927 25928 catalog_manager.cc:4841] TS d39fb161ad9c4a4daef355f425d4cb5e (127.10.255.66:46389): tablet 611247ba62dd4029b95a109d67ceab05 (table test-table [id=377f321883b649f7ad8d99bf065812b5]) successfully deleted
I20260806 09:18:15.032219 26421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:14.995332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44790 (local address 127.10.255.65:45939)
0806 09:18:14.995557 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:14.995563 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:15.009416 (+ 13853us) server_negotiation.cc:407] Connection header received
0806 09:18:15.009967 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:15.009976 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:15.010070 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:15.010155 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:15.012479 (+ 2324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:15.013781 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:15.016005 (+ 2224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:15.016765 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:15.016884 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:15.021333 (+ 4449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:15.021357 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:15.021402 (+ 45us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:15.021465 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:15.027390 (+ 5925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:15.028564 (+ 1174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:15.028576 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:15.028580 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:15.028801 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:15.029388 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:15.029394 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:15.029397 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:15.029937 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:15.030302 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:15.031432 (+ 1130us) server_negotiation.cc:299] Negotiation successful
0806 09:18:15.031724 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 09:18:15.033018 26129 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:18:15.161722 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 25981
I20260806 09:18:15.186990 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 26139
I20260806 09:18:15.205047 26420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:15.187969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56100 (local address 127.10.255.66:46389)
0806 09:18:15.188173 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:15.188178 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:15.188197 (+ 19us) server_negotiation.cc:407] Connection header received
0806 09:18:15.188377 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:15.188381 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:15.188466 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:15.188554 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:15.190506 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:15.191284 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:15.193317 (+ 2033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:15.193865 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:15.193981 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:15.197803 (+ 3822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:15.197822 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:15.197840 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:15.197880 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:15.201689 (+ 3809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:15.202735 (+ 1046us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:15.202744 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:15.202747 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:15.202899 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:15.203366 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:15.203369 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:15.203371 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:15.203794 (+ 423us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:15.204116 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:15.204490 (+ 374us) server_negotiation.cc:299] Negotiation successful
0806 09:18:15.204708 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 09:18:15.205922 26265 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:18:15.301200 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 26139
I20260806 09:18:15.321421 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 26274
I20260806 09:18:15.337411 26417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:15.322488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53448 (local address 127.10.255.67:45265)
0806 09:18:15.322753 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:15.322760 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:15.322782 (+ 22us) server_negotiation.cc:407] Connection header received
0806 09:18:15.322856 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:15.322860 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:15.322950 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:15.323071 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:15.324687 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:15.325530 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:15.326940 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:15.327406 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:15.327576 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:15.330455 (+ 2879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:15.330470 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:15.330485 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:15.330523 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:15.333953 (+ 3430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:15.334788 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:15.334797 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:15.334800 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:15.334970 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:15.335376 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:15.335388 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:15.335396 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:15.335793 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:15.336240 (+ 447us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:15.336738 (+ 498us) server_negotiation.cc:299] Negotiation successful
0806 09:18:15.336992 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260806 09:18:15.338395 26400 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:18:15.469617 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 26274
I20260806 09:18:15.492105 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 25910
I20260806 09:18:15.493436 25974 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:18:15.614980 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 25910
I20260806 09:18:15.640806 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:42049
--webserver_interface=127.10.255.126
--webserver_port=46821
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:42049
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:18:16.011147 26453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:18:16.011478 26453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:18:16.011579 26453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:18:16.019369 26453 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:18:16.019502 26453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:18:16.019557 26453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:18:16.019614 26453 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:18:16.019667 26453 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:18:16.031432 26453 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:42049
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:42049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=46821
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:18:16.033058 26453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:18:16.034461 26453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:18:16.048568 26459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:16.048512 26461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:16.048735 26458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:18:16.049407 26453 server_base.cc:1034] running on GCE node
I20260806 09:18:16.050314 26453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:18:16.052033 26453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:18:16.053278 26453 hybrid_clock.cc:648] HybridClock initialized: now 1786007896053202 us; error 64 us; skew 500 ppm
I20260806 09:18:16.053679 26453 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:18:16 dist-test-slave-mvvj krb5kdc[25342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007896, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:18:16.057127 26453 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:18:16.058930 26453 webserver.cc:460] Webserver started at http://127.10.255.126:46821/ using document root <none> and password file <none>
I20260806 09:18:16.059671 26453 fs_manager.cc:359] Metadata directory not provided
I20260806 09:18:16.059787 26453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:18:16.066460 26453 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260806 09:18:16.072288 26468 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:16.074277 26453 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260806 09:18:16.074636 26453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "9bb051cfc4104bacab3e1877771537b5"
format_stamp: "Formatted at 2026-08-06 09:18:09 on dist-test-slave-mvvj"
server_key: "d13a559accc778ef1d38694d4ed2055f"
server_key_iv: "b40c0367368f8d245fa9b1ab0cab4f1e"
server_key_version: "encryptionkey@0"
I20260806 09:18:16.075832 26453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:18:16.097743 26453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:18:16.103226 26453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:18:16.103626 26453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:18:16.127825 26453 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:42049
I20260806 09:18:16.127986 26521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:42049 every 8 connection(s)
I20260806 09:18:16.130052 26453 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:18:16.138087 26522 sys_catalog.cc:263] Verifying existing consensus state
I20260806 09:18:16.140453 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 26453
I20260806 09:18:16.141534 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:45939
--local_ip_for_outbound_sockets=127.10.255.65
--tserver_master_addrs=127.10.255.126:42049
--webserver_port=37367
--webserver_interface=127.10.255.65
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:18:16.142689 26522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5: Bootstrap starting.
I20260806 09:18:16.167234 26522 log.cc:824] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5: Log is configured to *not* fsync() on all Append() calls
I20260806 09:18:16.185395 26522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 09:18:16.186015 26522 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5: Bootstrap complete.
I20260806 09:18:16.196175 26522 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bb051cfc4104bacab3e1877771537b5" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42049 } }
I20260806 09:18:16.197172 26522 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bb051cfc4104bacab3e1877771537b5, State: Initialized, Role: FOLLOWER
I20260806 09:18:16.197909 26522 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bb051cfc4104bacab3e1877771537b5" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42049 } }
I20260806 09:18:16.198175 26522 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:18:16.198324 26522 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:18:16.198623 26522 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 2 FOLLOWER]: Advancing to term 3
I20260806 09:18:16.203177 26522 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bb051cfc4104bacab3e1877771537b5" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42049 } }
I20260806 09:18:16.203788 26522 leader_election.cc:302] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9bb051cfc4104bacab3e1877771537b5; no voters:
I20260806 09:18:16.204639 26522 leader_election.cc:288] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 09:18:16.204790 26526 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 3 FOLLOWER]: Leader election won for term 3
I20260806 09:18:16.206123 26526 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [term 3 LEADER]: Becoming Leader. State: Replica: 9bb051cfc4104bacab3e1877771537b5, State: Running, Role: LEADER
I20260806 09:18:16.206827 26526 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bb051cfc4104bacab3e1877771537b5" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42049 } }
I20260806 09:18:16.207361 26522 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:18:16.209723 26528 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9bb051cfc4104bacab3e1877771537b5. Latest consensus state: current_term: 3 leader_uuid: "9bb051cfc4104bacab3e1877771537b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bb051cfc4104bacab3e1877771537b5" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42049 } } }
I20260806 09:18:16.209861 26527 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "9bb051cfc4104bacab3e1877771537b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bb051cfc4104bacab3e1877771537b5" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42049 } } }
I20260806 09:18:16.210392 26527 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [sys.catalog]: This master's current role is: LEADER
I20260806 09:18:16.210410 26528 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bb051cfc4104bacab3e1877771537b5 [sys.catalog]: This master's current role is: LEADER
I20260806 09:18:16.215291 26532 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:18:16.230355 26532 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:18:16.232439 26532 catalog_manager.cc:1259] Loaded cluster ID: b3ffcc36224642cba478bbe7ede84d44
I20260806 09:18:16.232681 26532 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260806 09:18:16.235431 26532 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fac317e59ad google::LogMessage::Fail() at ??:0
@ 0x7fac317e888a google::LogMessage::SendToLog() at ??:0
@ 0x7fac317e54de google::LogMessage::Flush() at ??:0
@ 0x7fac317e6a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
I20260806 09:18:16.249526 26544 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7fac4721c512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fac47219976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fac472a1610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fac472a1439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fac34431345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fac3443491c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fac34434799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fac3440feaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fac376e96db start_thread at ??:0
@ 0x7fac3067f61f clone at ??:0
W20260806 09:18:16.552569 26524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:18:16.552959 26524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:18:16.553164 26524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:18:16.561492 26524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:18:16.561678 26524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:18:16.561880 26524 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:18:16.572830 26524 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:45939
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=37367
--tserver_master_addrs=127.10.255.126:42049
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:18:16.574328 26524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:18:16.575781 26524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:18:16.590430 26563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:16.590425 26564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:16.590425 26566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:18:16.591600 26524 server_base.cc:1034] running on GCE node
I20260806 09:18:16.592393 26524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:18:16.593521 26524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:18:16.594808 26524 hybrid_clock.cc:648] HybridClock initialized: now 1786007896594756 us; error 52 us; skew 500 ppm
I20260806 09:18:16.595185 26524 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:18:16 dist-test-slave-mvvj krb5kdc[25342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007896, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:18:16.598816 26524 init.cc:377] Logged in from keytab as kudu/127.10.255.65@KRBTEST.COM (short username kudu)
I20260806 09:18:16.600638 26524 webserver.cc:460] Webserver started at http://127.10.255.65:37367/ using document root <none> and password file <none>
I20260806 09:18:16.601367 26524 fs_manager.cc:359] Metadata directory not provided
I20260806 09:18:16.601478 26524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:18:16.607899 26524 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 09:18:16.611253 26573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:16.613300 26524 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:18:16.613497 26524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "b985b43c6448460a82ed96d6340db7fc"
format_stamp: "Formatted at 2026-08-06 09:18:10 on dist-test-slave-mvvj"
server_key: "60d397ecd75d2e63e57e4296511214f2"
server_key_iv: "6c5a56d994dce49cee500aeef9839ef9"
server_key_version: "encryptionkey@0"
I20260806 09:18:16.614687 26524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:18:16.628727 26524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:18:16.634116 26524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:18:16.634398 26524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:18:16.635645 26524 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:18:16.637279 26524 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:18:16.637377 26524 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:16.637457 26524 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:18:16.637513 26524 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:16.676343 26524 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:45939
I20260806 09:18:16.676399 26687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:45939 every 8 connection(s)
I20260806 09:18:16.677985 26524 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:18:16.683772 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 26524
I20260806 09:18:16.684450 26690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:16.681521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.65:45191)
0806 09:18:16.682477 (+ 956us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:16.682756 (+ 279us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":362,"threads_started":1}
I20260806 09:18:16.684796 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:46389
--local_ip_for_outbound_sockets=127.10.255.66
--tserver_master_addrs=127.10.255.126:42049
--webserver_port=36767
--webserver_interface=127.10.255.66
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:18:16.685339 26688 heartbeater.cc:644] Failed to heartbeat to 127.10.255.126:42049 (0 consecutive failures): Network error: Failed to ping master at 127.10.255.126:42049: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
I20260806 09:18:16.686673 26690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:16.686197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.65:34361)
0806 09:18:16.686413 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:16.686507 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260806 09:18:16.687742 26690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:16.687347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.65:34137)
0806 09:18:16.687508 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:16.687611 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260806 09:18:16.688094 26688 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 09:18:17.065649 26691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:18:17.065985 26691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:18:17.066087 26691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:18:17.074198 26691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:18:17.074347 26691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:18:17.074467 26691 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:18:17.085049 26691 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:46389
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=36767
--tserver_master_addrs=127.10.255.126:42049
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:18:17.086432 26691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:18:17.087795 26691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:18:17.102288 26696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:17.102365 26699 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:17.102342 26697 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:18:17.102703 26691 server_base.cc:1034] running on GCE node
I20260806 09:18:17.103711 26691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:18:17.104848 26691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:18:17.106110 26691 hybrid_clock.cc:648] HybridClock initialized: now 1786007897106047 us; error 51 us; skew 500 ppm
I20260806 09:18:17.106472 26691 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:18:17 dist-test-slave-mvvj krb5kdc[25342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007897, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:18:17.110313 26691 init.cc:377] Logged in from keytab as kudu/127.10.255.66@KRBTEST.COM (short username kudu)
I20260806 09:18:17.112201 26691 webserver.cc:460] Webserver started at http://127.10.255.66:36767/ using document root <none> and password file <none>
I20260806 09:18:17.113077 26691 fs_manager.cc:359] Metadata directory not provided
I20260806 09:18:17.113237 26691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:18:17.120970 26691 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.001s sys 0.006s
I20260806 09:18:17.124773 26706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:17.126752 26691 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260806 09:18:17.126993 26691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "d39fb161ad9c4a4daef355f425d4cb5e"
format_stamp: "Formatted at 2026-08-06 09:18:10 on dist-test-slave-mvvj"
server_key: "6d7aabd963a29709b3d5f4728c1d96c2"
server_key_iv: "923c07d6eb773c1969d548eb1673f8fd"
server_key_version: "encryptionkey@0"
I20260806 09:18:17.128279 26691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:18:17.191051 26691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:18:17.196697 26691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:18:17.197048 26691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:18:17.198354 26691 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:18:17.200117 26691 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:18:17.200225 26691 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:17.200412 26691 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:18:17.200510 26691 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:17.240983 26691 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:46389
I20260806 09:18:17.241087 26820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:46389 every 8 connection(s)
I20260806 09:18:17.242630 26691 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:18:17.245865 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 26691
I20260806 09:18:17.246749 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:45265
--local_ip_for_outbound_sockets=127.10.255.67
--tserver_master_addrs=127.10.255.126:42049
--webserver_port=32801
--webserver_interface=127.10.255.67
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:38101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:18:17.248941 26824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:17.246388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.66:47037)
0806 09:18:17.247506 (+ 1118us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:17.247789 (+ 283us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":790,"thread_start_us":480,"threads_started":1}
W20260806 09:18:17.249859 26821 heartbeater.cc:644] Failed to heartbeat to 127.10.255.126:42049 (0 consecutive failures): Network error: Failed to ping master at 127.10.255.126:42049: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
I20260806 09:18:17.251107 26824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:17.250631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.66:48273)
0806 09:18:17.250825 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:17.250919 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260806 09:18:17.252215 26824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:17.251804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.66:34447)
0806 09:18:17.252000 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:17.252091 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260806 09:18:17.252569 26821 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 09:18:17.609656 26825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:18:17.609977 26825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:18:17.610078 26825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:18:17.617833 26825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:18:17.617983 26825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:18:17.618104 26825 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:18:17.629135 26825 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:38101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:45265
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=32801
--tserver_master_addrs=127.10.255.126:42049
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:18:17.630532 26825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:18:17.632052 26825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:18:17.646997 26831 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:17.647037 26833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:17.647284 26830 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:18:17.648097 26825 server_base.cc:1034] running on GCE node
I20260806 09:18:17.648813 26825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:18:17.649859 26825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:18:17.651103 26825 hybrid_clock.cc:648] HybridClock initialized: now 1786007897651053 us; error 37 us; skew 500 ppm
I20260806 09:18:17.651523 26825 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:18:17 dist-test-slave-mvvj krb5kdc[25342](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007897, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:18:17.655059 26825 init.cc:377] Logged in from keytab as kudu/127.10.255.67@KRBTEST.COM (short username kudu)
I20260806 09:18:17.656885 26825 webserver.cc:460] Webserver started at http://127.10.255.67:32801/ using document root <none> and password file <none>
I20260806 09:18:17.657645 26825 fs_manager.cc:359] Metadata directory not provided
I20260806 09:18:17.657802 26825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:18:17.663523 26825 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.000s
I20260806 09:18:17.666636 26840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:17.668210 26825 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 09:18:17.668434 26825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "7542c0e9e9e244ee85b9067cb8e9bdf7"
format_stamp: "Formatted at 2026-08-06 09:18:11 on dist-test-slave-mvvj"
server_key: "a3a5118cc0602c2a96e8163a95ff39e2"
server_key_iv: "cfe85997e845992d34cac86609109339"
server_key_version: "encryptionkey@0"
I20260806 09:18:17.669653 26825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:18:17.687240 26825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:18:17.689642 26845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:17.688692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.65:59917)
0806 09:18:17.689272 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:17.689396 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":298,"threads_started":1}
I20260806 09:18:17.692276 26825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:18:17.692586 26825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:18:17.693652 26825 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:18:17.695214 26825 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:18:17.695309 26825 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:17.695485 26825 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:18:17.695574 26825 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:17.731377 26825 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:45265
I20260806 09:18:17.731562 26958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:45265 every 8 connection(s)
I20260806 09:18:17.733144 26825 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:18:17.736029 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 26825
I20260806 09:18:17.739298 26962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:17.736989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.67:33435)
0806 09:18:17.737898 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:17.738311 (+ 413us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":384,"threads_started":1}
W20260806 09:18:17.740222 26959 heartbeater.cc:644] Failed to heartbeat to 127.10.255.126:42049 (0 consecutive failures): Network error: Failed to ping master at 127.10.255.126:42049: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
I20260806 09:18:17.741269 26962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:17.740866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.67:55095)
0806 09:18:17.741044 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:17.741149 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260806 09:18:17.742264 26962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:17.741869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.67:39823)
0806 09:18:17.742031 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:17.742146 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260806 09:18:17.742558 26959 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 09:18:18.255352 26963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:18.253706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.66:32943)
0806 09:18:18.254645 (+ 939us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:18.254866 (+ 221us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":741,"thread_start_us":407,"threads_started":1}
I20260806 09:18:18.692132 26964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:18.691002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.65:46737)
0806 09:18:18.691735 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:18.691911 (+ 176us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":430,"threads_started":1}
I20260806 09:18:18.744460 26965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:18.743367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.67:46361)
0806 09:18:18.744017 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:18.744180 (+ 163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":292,"threads_started":1}
I20260806 09:18:19.257784 26966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:19.256873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.66:38397)
0806 09:18:19.257435 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:19.257557 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":251,"threads_started":1}
I20260806 09:18:19.694339 26967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:19.693432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.65:54143)
0806 09:18:19.694002 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:19.694137 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":288,"threads_started":1}
I20260806 09:18:19.746503 26968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:19.745653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.67:42773)
0806 09:18:19.746213 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:19.746307 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":277,"threads_started":1}
I20260806 09:18:20.259816 26969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:20.258935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.66:56479)
0806 09:18:20.259473 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:20.259587 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":262,"threads_started":1}
I20260806 09:18:20.696528 26970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:20.695574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.65:42671)
0806 09:18:20.696219 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:20.696321 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":377,"threads_started":1}
I20260806 09:18:20.748629 26971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:20.747696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.67:56941)
0806 09:18:20.748324 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:20.748424 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":363,"threads_started":1}
I20260806 09:18:21.261814 26972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:21.261027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.66:56641)
0806 09:18:21.261506 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:21.261640 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":236,"threads_started":1}
I20260806 09:18:21.698936 26973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:21.697990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.65:58269)
0806 09:18:21.698576 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:21.698709 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":291,"threads_started":1}
I20260806 09:18:21.750692 26974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:21.749825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.67:55309)
0806 09:18:21.750373 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:21.750478 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":288,"threads_started":1}
I20260806 09:18:22.264097 26975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:22.263052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.66:38185)
0806 09:18:22.263683 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:22.263882 (+ 199us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":280,"threads_started":1}
I20260806 09:18:22.700927 26976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:22.700098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.65:44147)
0806 09:18:22.700630 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:22.700740 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":262,"threads_started":1}
I20260806 09:18:22.752668 26977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:22.751813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.67:35261)
0806 09:18:22.752385 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:22.752475 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":249,"threads_started":1}
I20260806 09:18:23.266093 26978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:23.265256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.66:45035)
0806 09:18:23.265802 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:23.265907 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":297,"threads_started":1}
I20260806 09:18:23.703209 26979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:23.702135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.65:53041)
0806 09:18:23.702839 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:23.702951 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":346,"threads_started":1}
I20260806 09:18:23.754654 26980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:23.753785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.67:38441)
0806 09:18:23.754375 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:23.754474 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":358,"threads_started":1}
I20260806 09:18:24.268275 26981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:24.267336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.66:45791)
0806 09:18:24.267931 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:24.268044 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":230,"threads_started":1}
I20260806 09:18:24.705431 26982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:24.704558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.65:51647)
0806 09:18:24.705133 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:24.705242 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":304,"threads_started":1}
I20260806 09:18:24.757019 26983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:24.756000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.67:44821)
0806 09:18:24.756693 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:24.756790 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":313,"threads_started":1}
I20260806 09:18:25.270218 26984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:25.269445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.66:34061)
0806 09:18:25.269916 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:25.270009 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":256,"threads_started":1}
I20260806 09:18:25.707755 26985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:25.706792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.65:56027)
0806 09:18:25.707427 (+ 635us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:25.707541 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":276,"threads_started":1}
I20260806 09:18:25.759085 26986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:25.758246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.67:51669)
0806 09:18:25.758770 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:25.758874 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":270,"threads_started":1}
I20260806 09:18:26.272290 26987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:26.271352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.66:43029)
0806 09:18:26.271988 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:26.272089 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":263,"threads_started":1}
I20260806 09:18:26.710242 26988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:26.709335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.65:35845)
0806 09:18:26.709961 (+ 626us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:26.710067 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":365,"threads_started":1}
I20260806 09:18:26.761263 26989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:26.760272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.67:44305)
0806 09:18:26.760952 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:26.761049 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":317,"threads_started":1}
I20260806 09:18:27.274497 26990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:27.273522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.66:35271)
0806 09:18:27.274169 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:27.274262 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":373,"threads_started":1}
I20260806 09:18:27.712975 26991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:27.711702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.65:38101)
0806 09:18:27.712644 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:27.712769 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":719,"thread_start_us":359,"threads_started":1}
I20260806 09:18:27.763657 26992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:27.762792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.67:57327)
0806 09:18:27.763357 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:27.763454 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":325,"threads_started":1}
I20260806 09:18:28.277024 26993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:28.275904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.66:52897)
0806 09:18:28.276647 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:28.276764 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":397,"threads_started":1}
I20260806 09:18:28.715168 26994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:28.714280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.65:41621)
0806 09:18:28.714853 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:28.714998 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":307,"threads_started":1}
I20260806 09:18:28.765733 26995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:28.764893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.67:33455)
0806 09:18:28.765423 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:28.765540 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":264,"threads_started":1}
I20260806 09:18:29.279126 26996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:29.278164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.66:43229)
0806 09:18:29.278788 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:29.278903 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":302,"threads_started":1}
I20260806 09:18:29.717402 26997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:29.716430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.65:39601)
0806 09:18:29.717077 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:29.717212 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":369,"threads_started":1}
I20260806 09:18:29.767807 26998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:29.766982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.67:47227)
0806 09:18:29.767532 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:29.767638 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":281,"threads_started":1}
I20260806 09:18:30.281878 26999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:30.280678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.66:53307)
0806 09:18:30.281456 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:30.281654 (+ 198us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":447,"threads_started":1}
I20260806 09:18:30.719942 27000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:30.718717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.65:59625)
0806 09:18:30.719407 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:30.719625 (+ 218us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":420,"threads_started":1}
I20260806 09:18:30.769763 27002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:30.768958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.67:42785)
0806 09:18:30.769458 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:30.769564 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":263,"threads_started":1}
I20260806 09:18:31.284431 27003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:31.283340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.66:37533)
0806 09:18:31.283948 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:31.284085 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":252,"threads_started":1}
I20260806 09:18:31.722435 27004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:31.721468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.65:36141)
0806 09:18:31.722077 (+ 609us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:31.722207 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":363,"threads_started":1}
I20260806 09:18:31.771979 27005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:31.770932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.67:48101)
0806 09:18:31.771646 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:31.771745 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":435,"threads_started":1}
I20260806 09:18:32.286613 27006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:32.285770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.66:42207)
0806 09:18:32.286290 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:32.286405 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":262,"threads_started":1}
I20260806 09:18:32.725003 27007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:32.724144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.65:40825)
0806 09:18:32.724708 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:32.724827 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":327,"threads_started":1}
I20260806 09:18:32.743875 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 26524
I20260806 09:18:32.774024 27008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:32.745752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46630 (local address 127.10.255.65:45939)
0806 09:18:32.746537 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:32.746560 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:32.746619 (+ 59us) server_negotiation.cc:407] Connection header received
0806 09:18:32.748745 (+ 2126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:32.748757 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:32.749259 (+ 502us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:32.749673 (+ 414us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:32.751688 (+ 2015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:32.753144 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:32.754589 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:32.755392 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:32.755704 (+ 312us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:32.766202 (+ 10498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:32.766213 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:32.766235 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:32.766296 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:32.769854 (+ 3558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:32.770803 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:32.770812 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:32.770820 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:32.771014 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:32.771456 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:32.771461 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:32.771466 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:32.772199 (+ 733us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:32.772541 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:32.773045 (+ 504us) server_negotiation.cc:299] Negotiation successful
0806 09:18:32.773589 (+ 544us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":413,"threads_started":1}
I20260806 09:18:32.774283 27009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:32.773189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42049 (local address 127.10.255.67:53295)
0806 09:18:32.773831 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:32.773951 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:42049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":394,"threads_started":1}
I20260806 09:18:32.776145 26683 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:18:32.869915 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 26524
I20260806 09:18:32.889719 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 26691
I20260806 09:18:32.911754 27011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:32.890808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58300 (local address 127.10.255.66:46389)
0806 09:18:32.891344 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:32.891359 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:32.891401 (+ 42us) server_negotiation.cc:407] Connection header received
0806 09:18:32.893203 (+ 1802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:32.893215 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:32.893761 (+ 546us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:32.894102 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:32.895623 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:32.897240 (+ 1617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:32.899522 (+ 2282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:32.900574 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:32.900755 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:32.903813 (+ 3058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:32.903824 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:32.903922 (+ 98us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:32.903988 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:32.907499 (+ 3511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:32.908602 (+ 1103us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:32.908620 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:32.908629 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:32.908857 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:32.909283 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:32.909287 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:32.909289 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:32.910092 (+ 803us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:32.910383 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:32.910900 (+ 517us) server_negotiation.cc:299] Negotiation successful
0806 09:18:32.911433 (+ 533us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":250,"threads_started":1}
I20260806 09:18:32.913525 26816 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:18:33.005254 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 26691
I20260806 09:18:33.026667 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 26825
I20260806 09:18:33.048849 27013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:33.028106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59918 (local address 127.10.255.67:45265)
0806 09:18:33.028897 (+ 791us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:33.028913 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:33.028963 (+ 50us) server_negotiation.cc:407] Connection header received
0806 09:18:33.030793 (+ 1830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:33.030806 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:33.031324 (+ 518us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:33.031684 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:33.033534 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:33.034916 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:33.036488 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:33.037212 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:33.037364 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:33.040620 (+ 3256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:33.040631 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:33.040652 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:33.040711 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:33.044745 (+ 4034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:33.045672 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:33.045680 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:33.045688 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:33.045910 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:33.046367 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:33.046372 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:33.046374 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:33.047128 (+ 754us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:33.047575 (+ 447us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:33.047968 (+ 393us) server_negotiation.cc:299] Negotiation successful
0806 09:18:33.048503 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":403,"threads_started":1}
I20260806 09:18:33.050568 26954 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:18:33.143977 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 26825
2026-08-06T09:18:33Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (25702 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:18:33 dist-test-slave-mvvj krb5kdc[27017](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:18:33 dist-test-slave-mvvj krb5kdc[27017](info): set up 2 sockets
Aug 06 09:18:33 dist-test-slave-mvvj krb5kdc[27017](info): commencing operation
krb5kdc: starting...
W20260806 09:18:34.320257 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.131s user 0.006s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:18:34 dist-test-slave-mvvj krb5kdc[27017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:18:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:18:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:18:34.605023 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:32837
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:39373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:32837
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:18:35.003994 27030 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:18:35.004357 27030 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:18:35.004555 27030 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:18:35.013219 27030 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 09:18:35.013348 27030 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 09:18:35.013434 27030 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 09:18:35.013522 27030 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:18:35.013633 27030 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:18:35.013741 27030 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:18:35.013823 27030 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:18:35.013926 27030 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:18:35.025811 27030 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:39373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:32837
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:32837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:18:35.027423 27030 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:18:35.028932 27030 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:18:35.042873 27036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:35.042788 27038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:35.043183 27035 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:18:35.043242 27030 server_base.cc:1034] running on GCE node
I20260806 09:18:35.044553 27030 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:18:35.046319 27030 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:18:35.047696 27030 hybrid_clock.cc:648] HybridClock initialized: now 1786007915047576 us; error 98 us; skew 500 ppm
I20260806 09:18:35.048168 27030 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:18:35 dist-test-slave-mvvj krb5kdc[27017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007915, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:18:35.052109 27030 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:18:35.054047 27030 webserver.cc:460] Webserver started at http://127.10.255.126:43077/ using document root <none> and password file <none>
I20260806 09:18:35.054857 27030 fs_manager.cc:359] Metadata directory not provided
I20260806 09:18:35.054970 27030 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:18:35.055281 27030 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:18:35.058873 27030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "54addc5e405f4d1eb2d4d8dd79121ee0"
format_stamp: "Formatted at 2026-08-06 09:18:35 on dist-test-slave-mvvj"
server_key: "0dcbfc8e9addc76f0012b478c0439160"
server_key_iv: "cdbd53fc2a5400b39bbb80ba89ef4ac3"
server_key_version: "encryptionkey@0"
I20260806 09:18:35.059800 27030 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "54addc5e405f4d1eb2d4d8dd79121ee0"
format_stamp: "Formatted at 2026-08-06 09:18:35 on dist-test-slave-mvvj"
server_key: "0dcbfc8e9addc76f0012b478c0439160"
server_key_iv: "cdbd53fc2a5400b39bbb80ba89ef4ac3"
server_key_version: "encryptionkey@0"
I20260806 09:18:35.066598 27030 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 09:18:35.070828 27045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:35.073067 27030 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 09:18:35.073284 27030 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "54addc5e405f4d1eb2d4d8dd79121ee0"
format_stamp: "Formatted at 2026-08-06 09:18:35 on dist-test-slave-mvvj"
server_key: "0dcbfc8e9addc76f0012b478c0439160"
server_key_iv: "cdbd53fc2a5400b39bbb80ba89ef4ac3"
server_key_version: "encryptionkey@0"
I20260806 09:18:35.073622 27030 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:18:35.110936 27030 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:18:35.115933 27030 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:18:35.116228 27030 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:18:35.138329 27030 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:32837
I20260806 09:18:35.138350 27096 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:32837 every 8 connection(s)
I20260806 09:18:35.139946 27030 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:18:35.144482 27097 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:18:35.145556 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 27030
I20260806 09:18:35.145828 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:18:35.146972 11261 external_mini_cluster.cc:1428] Setting key 27e1d6a4b0f7ed452a389e52ea69bb4a
I20260806 09:18:35.162004 27097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0: Bootstrap starting.
Aug 06 09:18:35 dist-test-slave-mvvj krb5kdc[27017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:18:35.166698 27097 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0: Neither blocks nor log segments found. Creating new log.
I20260806 09:18:35.168131 27097 log.cc:824] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0: Log is configured to *not* fsync() on all Append() calls
I20260806 09:18:35.172042 27097 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0: No bootstrap required, opened a new log
I20260806 09:18:35.176724 27100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:35.149802 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54562 (local address 127.10.255.126:32837)
0806 09:18:35.150779 (+ 977us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:35.150792 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:35.150843 (+ 51us) server_negotiation.cc:407] Connection header received
0806 09:18:35.152767 (+ 1924us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:35.152800 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:35.153313 (+ 513us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:35.153718 (+ 405us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:35.155792 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:35.157425 (+ 1633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:35.159609 (+ 2184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:35.160500 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:35.160682 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:35.166627 (+ 5945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:35.166638 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:35.166656 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:35.166716 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:35.170890 (+ 4174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:35.172041 (+ 1151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:35.172052 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:35.172063 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:35.172307 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:35.172820 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:35.172825 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:35.172832 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:35.173654 (+ 822us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:35.173965 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:35.174533 (+ 568us) server_negotiation.cc:299] Negotiation successful
0806 09:18:35.175072 (+ 539us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":715,"thread_start_us":447,"threads_started":1}
I20260806 09:18:35.182216 27097 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54addc5e405f4d1eb2d4d8dd79121ee0" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 32837 } }
I20260806 09:18:35.182650 27097 raft_consensus.cc:374] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:18:35.182731 27097 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54addc5e405f4d1eb2d4d8dd79121ee0, State: Initialized, Role: FOLLOWER
I20260806 09:18:35.183502 27097 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54addc5e405f4d1eb2d4d8dd79121ee0" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 32837 } }
I20260806 09:18:35.183951 27097 raft_consensus.cc:388] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:18:35.184136 27097 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:18:35.184343 27097 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:18:35.186661 27097 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54addc5e405f4d1eb2d4d8dd79121ee0" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 32837 } }
I20260806 09:18:35.187260 27097 leader_election.cc:302] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 54addc5e405f4d1eb2d4d8dd79121ee0; no voters:
I20260806 09:18:35.188040 27097 leader_election.cc:288] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:18:35.188351 27102 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:18:35.189219 27102 raft_consensus.cc:686] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 1 LEADER]: Becoming Leader. State: Replica: 54addc5e405f4d1eb2d4d8dd79121ee0, State: Running, Role: LEADER
I20260806 09:18:35.189873 27102 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54addc5e405f4d1eb2d4d8dd79121ee0" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 32837 } }
I20260806 09:18:35.190454 27097 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:18:35.193291 27104 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54addc5e405f4d1eb2d4d8dd79121ee0. Latest consensus state: current_term: 1 leader_uuid: "54addc5e405f4d1eb2d4d8dd79121ee0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54addc5e405f4d1eb2d4d8dd79121ee0" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 32837 } } }
I20260806 09:18:35.193128 27103 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "54addc5e405f4d1eb2d4d8dd79121ee0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54addc5e405f4d1eb2d4d8dd79121ee0" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 32837 } } }
I20260806 09:18:35.193667 27103 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [sys.catalog]: This master's current role is: LEADER
I20260806 09:18:35.193665 27104 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [sys.catalog]: This master's current role is: LEADER
I20260806 09:18:35.196837 27110 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:18:35.203117 27110 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:18:35.214573 27110 catalog_manager.cc:1347] Generated new cluster ID: 9f3a2c687f4445dcbfcaa13d31feefb3
I20260806 09:18:35.214722 27110 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:18:35.268366 27110 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:18:35.270112 27110 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:18:35.280658 27110 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0: Generated new TSK 0
I20260806 09:18:35.281687 27110 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.255.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
I20260806 09:18:35.357030 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:32837
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:39373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:18:35.753556 27123 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:18:35.753885 27123 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:18:35.754046 27123 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:18:35.762090 27123 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:18:35.762233 27123 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:18:35.762439 27123 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:18:35.773106 27123 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:39373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:32837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:18:35.774585 27123 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:18:35.776144 27123 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:18:35.792614 27129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:35.792639 27128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:35.792547 27131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:18:35.794030 27123 server_base.cc:1034] running on GCE node
I20260806 09:18:35.794866 27123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:18:35.796054 27123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:18:35.797363 27123 hybrid_clock.cc:648] HybridClock initialized: now 1786007915797295 us; error 63 us; skew 500 ppm
I20260806 09:18:35.797920 27123 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:18:35 dist-test-slave-mvvj krb5kdc[27017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007915, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:18:35.802167 27123 init.cc:377] Logged in from keytab as kudu/127.10.255.65@KRBTEST.COM (short username kudu)
I20260806 09:18:35.804164 27123 webserver.cc:460] Webserver started at http://127.10.255.65:40897/ using document root <none> and password file <none>
I20260806 09:18:35.805210 27123 fs_manager.cc:359] Metadata directory not provided
I20260806 09:18:35.805377 27123 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:18:35.805774 27123 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:18:35.809428 27123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "6f77142000ec42f5beefb6277cc750c9"
format_stamp: "Formatted at 2026-08-06 09:18:35 on dist-test-slave-mvvj"
server_key: "82232122e55ae6d44d77bd5c3a99a6c2"
server_key_iv: "c5cbc7b027ea347e20adb2617722fd59"
server_key_version: "encryptionkey@0"
I20260806 09:18:35.810581 27123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "6f77142000ec42f5beefb6277cc750c9"
format_stamp: "Formatted at 2026-08-06 09:18:35 on dist-test-slave-mvvj"
server_key: "82232122e55ae6d44d77bd5c3a99a6c2"
server_key_iv: "c5cbc7b027ea347e20adb2617722fd59"
server_key_version: "encryptionkey@0"
I20260806 09:18:35.817678 27123 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260806 09:18:35.822330 27138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:35.824261 27123 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 09:18:35.824540 27123 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "6f77142000ec42f5beefb6277cc750c9"
format_stamp: "Formatted at 2026-08-06 09:18:35 on dist-test-slave-mvvj"
server_key: "82232122e55ae6d44d77bd5c3a99a6c2"
server_key_iv: "c5cbc7b027ea347e20adb2617722fd59"
server_key_version: "encryptionkey@0"
I20260806 09:18:35.824821 27123 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:18:35.838188 27123 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:18:35.843262 27123 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:18:35.843649 27123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:18:35.844888 27123 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:18:35.846755 27123 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:18:35.846896 27123 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:35.847085 27123 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:18:35.847167 27123 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:35.884897 27123 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:35047
I20260806 09:18:35.884996 27253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:35047 every 8 connection(s)
I20260806 09:18:35.886336 27123 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:18:35.894093 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 27123
I20260806 09:18:35.894344 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:18:35.895078 11261 external_mini_cluster.cc:1428] Setting key a8090b08cf70ccfe675d977610b38ce8
Aug 06 09:18:35 dist-test-slave-mvvj krb5kdc[27017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007915, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:18:35.912371 27256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:35.889370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:53493 (local address 127.10.255.126:32837)
0806 09:18:35.889958 (+ 588us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:35.889965 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:35.891410 (+ 1445us) server_negotiation.cc:407] Connection header received
0806 09:18:35.893758 (+ 2348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:35.893765 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:35.893889 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:35.894034 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:35.896235 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:35.897379 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:35.899546 (+ 2167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:35.900112 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:35.900288 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:35.904908 (+ 4620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:35.904915 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:35.904919 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:35.904963 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:35.908144 (+ 3181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:35.909318 (+ 1174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:35.909324 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:35.909326 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:35.909532 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:35.910120 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:35.910132 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:35.910135 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:35.910461 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:35.910717 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:35.911572 (+ 855us) server_negotiation.cc:299] Negotiation successful
0806 09:18:35.911926 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":321,"threads_started":1}
I20260806 09:18:35.913471 27257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:35.890078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.65:53493)
0806 09:18:35.891194 (+ 1116us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:35.891246 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:35.893336 (+ 2090us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:35.894390 (+ 1054us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:35.894402 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:35.895107 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:18:35.895974 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:35.895999 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:35.897609 (+ 1610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:35.897614 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:35.899332 (+ 1718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:35.899351 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:35.900424 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:35.900433 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:35.900899 (+ 466us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:35.901744 (+ 845us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:18:35.901773 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:18:35.904561 (+ 2788us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:18:35.908366 (+ 3805us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:35.908378 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:35.908410 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:35.909109 (+ 699us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:35.909692 (+ 583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:35.909698 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:35.909702 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:35.909958 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:35.910656 (+ 698us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:18:35.910666 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:18:35.911113 (+ 447us) client_negotiation.cc:769] Sending connection context
0806 09:18:35.911435 (+ 322us) client_negotiation.cc:240] Negotiation successful
0806 09:18:35.912132 (+ 697us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":816,"thread_start_us":404,"threads_started":1}
I20260806 09:18:35.915566 27254 heartbeater.cc:347] Connected to a master server at 127.10.255.126:32837
I20260806 09:18:35.916093 27254 heartbeater.cc:464] Registering TS with master...
I20260806 09:18:35.917057 27254 heartbeater.cc:511] Master 127.10.255.126:32837 requested a full tablet report, sending...
I20260806 09:18:35.920279 27062 ts_manager.cc:194] Registered new tserver with Master: 6f77142000ec42f5beefb6277cc750c9 (127.10.255.65:35047)
WARNING: no policy specified for kudu/127.10.255.66@KRBTEST.COM; defaulting to no policy
I20260806 09:18:35.922590 27062 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.65@KRBTEST.COM'} at 127.10.255.65:53493
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
I20260806 09:18:35.961771 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:32837
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:39373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:18:36.342159 27260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:18:36.342574 27260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:18:36.342761 27260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:18:36.350419 27260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:18:36.350646 27260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:18:36.350857 27260 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:18:36.361388 27260 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:39373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:32837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:18:36.362947 27260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:18:36.364455 27260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:18:36.379382 27268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:36.379489 27266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:36.379513 27265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:18:36.380963 27260 server_base.cc:1034] running on GCE node
I20260806 09:18:36.381735 27260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:18:36.382910 27260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:18:36.384163 27260 hybrid_clock.cc:648] HybridClock initialized: now 1786007916384112 us; error 52 us; skew 500 ppm
I20260806 09:18:36.384541 27260 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:18:36 dist-test-slave-mvvj krb5kdc[27017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007916, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:18:36.388461 27260 init.cc:377] Logged in from keytab as kudu/127.10.255.66@KRBTEST.COM (short username kudu)
I20260806 09:18:36.390444 27260 webserver.cc:460] Webserver started at http://127.10.255.66:37343/ using document root <none> and password file <none>
I20260806 09:18:36.391281 27260 fs_manager.cc:359] Metadata directory not provided
I20260806 09:18:36.391440 27260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:18:36.391824 27260 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:18:36.395120 27260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "8d973a7ac836440d81273a3a0901e849"
format_stamp: "Formatted at 2026-08-06 09:18:36 on dist-test-slave-mvvj"
server_key: "2f019c8e919db77081b2ed6508b88975"
server_key_iv: "25de4a7120356eabc8307b0db7afb7d0"
server_key_version: "encryptionkey@0"
I20260806 09:18:36.396106 27260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "8d973a7ac836440d81273a3a0901e849"
format_stamp: "Formatted at 2026-08-06 09:18:36 on dist-test-slave-mvvj"
server_key: "2f019c8e919db77081b2ed6508b88975"
server_key_iv: "25de4a7120356eabc8307b0db7afb7d0"
server_key_version: "encryptionkey@0"
I20260806 09:18:36.402309 27260 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 09:18:36.406584 27275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:36.408468 27260 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:18:36.408721 27260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "8d973a7ac836440d81273a3a0901e849"
format_stamp: "Formatted at 2026-08-06 09:18:36 on dist-test-slave-mvvj"
server_key: "2f019c8e919db77081b2ed6508b88975"
server_key_iv: "25de4a7120356eabc8307b0db7afb7d0"
server_key_version: "encryptionkey@0"
I20260806 09:18:36.408995 27260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:18:36.424224 27260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:18:36.429615 27260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:18:36.430040 27260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:18:36.431342 27260 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:18:36.432972 27260 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:18:36.433090 27260 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:36.433266 27260 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:18:36.433351 27260 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:36.472712 27260 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:45649
I20260806 09:18:36.472783 27388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:45649 every 8 connection(s)
I20260806 09:18:36.474303 27260 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:18:36.481427 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 27260
I20260806 09:18:36.481669 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:18:36.482201 11261 external_mini_cluster.cc:1428] Setting key 052bb6a4bbb79d5aab98c74f2292a35f
Aug 06 09:18:36 dist-test-slave-mvvj krb5kdc[27017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007916, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:18:36.500979 27391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:36.477452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:46917 (local address 127.10.255.126:32837)
0806 09:18:36.478063 (+ 611us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:36.478068 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:36.479367 (+ 1299us) server_negotiation.cc:407] Connection header received
0806 09:18:36.481474 (+ 2107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:36.481480 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:36.481613 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:36.481739 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:36.483718 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:36.484744 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:36.486531 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:36.487011 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:36.487183 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:36.492334 (+ 5151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:36.492340 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:36.492344 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:36.492386 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:36.496367 (+ 3981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:36.497621 (+ 1254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:36.497628 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:36.497636 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:36.497861 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:36.498483 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:36.498492 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:36.498498 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:36.498961 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:36.499144 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:36.500155 (+ 1011us) server_negotiation.cc:299] Negotiation successful
0806 09:18:36.500471 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":329,"threads_started":1}
I20260806 09:18:36.501868 27392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:36.478212 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.66:46917)
0806 09:18:36.479167 (+ 955us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:36.479210 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:36.481146 (+ 1936us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:36.482030 (+ 884us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:36.482040 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:36.482705 (+ 665us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:18:36.483515 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:36.483540 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:36.484932 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:36.484937 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:36.486317 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:36.486333 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:36.487303 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:36.487311 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:36.487581 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:36.488529 (+ 948us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:18:36.488568 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:18:36.492006 (+ 3438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:18:36.496633 (+ 4627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:36.496644 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:36.496661 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:36.497297 (+ 636us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:36.498044 (+ 747us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:36.498048 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:36.498050 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:36.498314 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:36.499154 (+ 840us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:18:36.499163 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:18:36.499652 (+ 489us) client_negotiation.cc:769] Sending connection context
0806 09:18:36.500008 (+ 356us) client_negotiation.cc:240] Negotiation successful
0806 09:18:36.500514 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":690,"thread_start_us":389,"threads_started":1}
I20260806 09:18:36.504153 27389 heartbeater.cc:347] Connected to a master server at 127.10.255.126:32837
I20260806 09:18:36.504731 27389 heartbeater.cc:464] Registering TS with master...
I20260806 09:18:36.505888 27389 heartbeater.cc:511] Master 127.10.255.126:32837 requested a full tablet report, sending...
I20260806 09:18:36.507901 27062 ts_manager.cc:194] Registered new tserver with Master: 8d973a7ac836440d81273a3a0901e849 (127.10.255.66:45649)
I20260806 09:18:36.509333 27062 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.66@KRBTEST.COM'} at 127.10.255.66:46917
WARNING: no policy specified for kudu/127.10.255.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
I20260806 09:18:36.552942 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:32837
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:39373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:18:36.927008 27254 heartbeater.cc:503] Master 127.10.255.126:32837 was elected leader, sending a full tablet report...
W20260806 09:18:36.929322 27395 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:18:36.929744 27395 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:18:36.929908 27395 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:18:36.937808 27395 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:18:36.938007 27395 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:18:36.938189 27395 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:18:36.948642 27395 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:39373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:32837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:18:36.950174 27395 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:18:36.951624 27395 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:18:36.967043 27400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:36.967016 27401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:36.966980 27403 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:18:36.968247 27395 server_base.cc:1034] running on GCE node
I20260806 09:18:36.969049 27395 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:18:36.970314 27395 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:18:36.971597 27395 hybrid_clock.cc:648] HybridClock initialized: now 1786007916971606 us; error 99 us; skew 500 ppm
I20260806 09:18:36.972064 27395 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:18:36 dist-test-slave-mvvj krb5kdc[27017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007916, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:18:36.975757 27395 init.cc:377] Logged in from keytab as kudu/127.10.255.67@KRBTEST.COM (short username kudu)
I20260806 09:18:36.978022 27395 webserver.cc:460] Webserver started at http://127.10.255.67:42367/ using document root <none> and password file <none>
I20260806 09:18:36.978981 27395 fs_manager.cc:359] Metadata directory not provided
I20260806 09:18:36.979164 27395 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:18:36.979523 27395 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:18:36.983002 27395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "9f0a081f13ec454e9f73d3c924b5b532"
format_stamp: "Formatted at 2026-08-06 09:18:36 on dist-test-slave-mvvj"
server_key: "5aa34323f5151a8f6b1da3c831bbc402"
server_key_iv: "71401f6bcbd676f30ab630807fa4b6d5"
server_key_version: "encryptionkey@0"
I20260806 09:18:36.984000 27395 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "9f0a081f13ec454e9f73d3c924b5b532"
format_stamp: "Formatted at 2026-08-06 09:18:36 on dist-test-slave-mvvj"
server_key: "5aa34323f5151a8f6b1da3c831bbc402"
server_key_iv: "71401f6bcbd676f30ab630807fa4b6d5"
server_key_version: "encryptionkey@0"
I20260806 09:18:36.990131 27395 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 09:18:36.994488 27411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:36.996290 27395 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260806 09:18:36.996495 27395 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "9f0a081f13ec454e9f73d3c924b5b532"
format_stamp: "Formatted at 2026-08-06 09:18:36 on dist-test-slave-mvvj"
server_key: "5aa34323f5151a8f6b1da3c831bbc402"
server_key_iv: "71401f6bcbd676f30ab630807fa4b6d5"
server_key_version: "encryptionkey@0"
I20260806 09:18:36.996726 27395 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:18:37.012388 27395 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:18:37.017880 27395 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:18:37.018242 27395 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:18:37.019376 27395 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:18:37.021047 27395 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:18:37.021148 27395 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:37.021288 27395 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:18:37.021347 27395 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:37.058266 27395 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:42347
I20260806 09:18:37.058323 27527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:42347 every 8 connection(s)
I20260806 09:18:37.059715 27395 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:18:37.063688 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 27395
I20260806 09:18:37.063957 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:18:37.064608 11261 external_mini_cluster.cc:1428] Setting key 70896909df3f30a5413789e21b91ee28
Aug 06 09:18:37 dist-test-slave-mvvj krb5kdc[27017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007916, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:18:37.084616 27530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:37.062953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:54875 (local address 127.10.255.126:32837)
0806 09:18:37.063619 (+ 666us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:37.063696 (+ 77us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:37.064916 (+ 1220us) server_negotiation.cc:407] Connection header received
0806 09:18:37.067476 (+ 2560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:37.067480 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:37.067557 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:37.067668 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:37.069647 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.070468 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.072466 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.072954 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.073072 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:37.077135 (+ 4063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:37.077142 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:37.077145 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:37.077185 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:37.080841 (+ 3656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:37.081866 (+ 1025us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:37.081870 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:37.081872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:37.082014 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:37.082556 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:37.082560 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:37.082562 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:37.082974 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:37.083107 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:37.084102 (+ 995us) server_negotiation.cc:299] Negotiation successful
0806 09:18:37.084320 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":520,"thread_start_us":319,"threads_started":1}
I20260806 09:18:37.085821 27531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:37.063602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.67:54875)
0806 09:18:37.064623 (+ 1021us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:37.064751 (+ 128us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:37.067030 (+ 2279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:37.068043 (+ 1013us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:37.068057 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:37.068800 (+ 743us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:18:37.069436 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:37.069455 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.070712 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.070716 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:37.072212 (+ 1496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:37.072228 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.073195 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.073200 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:37.073416 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:37.074194 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:18:37.074219 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:18:37.076827 (+ 2608us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:18:37.081069 (+ 4242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:37.081079 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:37.081095 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:37.081730 (+ 635us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:37.082150 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:37.082154 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:37.082156 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:37.082382 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:37.083127 (+ 745us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:18:37.083135 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:18:37.083621 (+ 486us) client_negotiation.cc:769] Sending connection context
0806 09:18:37.083965 (+ 344us) client_negotiation.cc:240] Negotiation successful
0806 09:18:37.084568 (+ 603us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":702,"thread_start_us":450,"threads_started":1}
I20260806 09:18:37.087574 27528 heartbeater.cc:347] Connected to a master server at 127.10.255.126:32837
I20260806 09:18:37.088016 27528 heartbeater.cc:464] Registering TS with master...
I20260806 09:18:37.088889 27528 heartbeater.cc:511] Master 127.10.255.126:32837 requested a full tablet report, sending...
I20260806 09:18:37.090806 27062 ts_manager.cc:194] Registered new tserver with Master: 9f0a081f13ec454e9f73d3c924b5b532 (127.10.255.67:42347)
I20260806 09:18:37.092020 27062 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.67@KRBTEST.COM'} at 127.10.255.67:54875
I20260806 09:18:37.094537 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 09:18:37.114730 27530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:37.099593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34188 (local address 127.10.255.126:32837)
0806 09:18:37.099777 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:37.099782 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:37.100280 (+ 498us) server_negotiation.cc:407] Connection header received
0806 09:18:37.100433 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:37.100437 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:37.100563 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:37.100720 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:37.102374 (+ 1654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.103119 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.104906 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.105397 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.105587 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:37.108431 (+ 2844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:37.108437 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:37.108440 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:37.108483 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:37.111497 (+ 3014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:37.112446 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:37.112451 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:37.112454 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:37.112602 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:37.113149 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:37.113154 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:37.113156 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:37.113516 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:37.113756 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:37.114139 (+ 383us) server_negotiation.cc:299] Negotiation successful
0806 09:18:37.114342 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 09:18:37.119938 27062 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34188:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:18:37.128512 27062 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:18:37.178965 27545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:37.144577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39162 (local address 127.10.255.65:35047)
0806 09:18:37.167273 (+ 22696us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:37.167287 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:37.169084 (+ 1797us) server_negotiation.cc:407] Connection header received
0806 09:18:37.169201 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:37.169212 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:37.169520 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:37.169740 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:18:37.171076 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.172814 (+ 1738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.176218 (+ 3404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.177799 (+ 1581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.177955 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:37.178188 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:37.178419 (+ 231us) server_negotiation.cc:299] Negotiation successful
0806 09:18:37.178594 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22407,"thread_start_us":22205,"threads_started":1}
I20260806 09:18:37.179098 27542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:37.143809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:35047 (local address 127.0.0.1:39162)
0806 09:18:37.168488 (+ 24679us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:37.168543 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:37.168785 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:37.170080 (+ 1295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:37.170087 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:37.170120 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:18:37.170644 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:37.170666 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.173000 (+ 2334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.173005 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:37.175988 (+ 2983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:37.176011 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.178048 (+ 2037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.178055 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:37.178215 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:37.178247 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 09:18:37.178339 (+ 92us) client_negotiation.cc:240] Negotiation successful
0806 09:18:37.178536 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24391,"mutex_wait_us":28,"thread_start_us":25618,"threads_started":1}
I20260806 09:18:37.179499 27544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:37.144470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55398 (local address 127.10.255.66:45649)
0806 09:18:37.167749 (+ 23279us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:37.167756 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:37.170110 (+ 2354us) server_negotiation.cc:407] Connection header received
0806 09:18:37.170227 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:37.170238 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:37.170486 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:37.170818 (+ 332us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:18:37.171523 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.173373 (+ 1850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.175603 (+ 2230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.177148 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.177316 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:37.177548 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:37.178170 (+ 622us) server_negotiation.cc:299] Negotiation successful
0806 09:18:37.178414 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23108,"thread_start_us":22996,"threads_started":1}
I20260806 09:18:37.179055 27541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:37.143941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:45649 (local address 127.0.0.1:55398)
0806 09:18:37.169782 (+ 25841us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:37.169804 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:37.169949 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:37.170714 (+ 765us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:37.170718 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:37.170744 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:18:37.171261 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:37.171276 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.173517 (+ 2241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.173524 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:37.175421 (+ 1897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:37.175436 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.177366 (+ 1930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.177372 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:37.177705 (+ 333us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:37.177776 (+ 71us) client_negotiation.cc:769] Sending connection context
0806 09:18:37.177954 (+ 178us) client_negotiation.cc:240] Negotiation successful
0806 09:18:37.178720 (+ 766us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25689,"thread_start_us":24081,"threads_started":1}
I20260806 09:18:37.180411 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:37.144425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:42347 (local address 127.0.0.1:36934)
0806 09:18:37.170162 (+ 25737us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:37.170182 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:37.170346 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:37.171165 (+ 819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:37.171170 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:37.171206 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:18:37.172260 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:37.172274 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.174502 (+ 2228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.174512 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:37.177141 (+ 2629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:37.177156 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.179363 (+ 2207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.179371 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:37.179663 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:37.179696 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 09:18:37.179859 (+ 163us) client_negotiation.cc:240] Negotiation successful
0806 09:18:37.179993 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25604,"mutex_wait_us":1,"thread_start_us":25748,"threads_started":1}
I20260806 09:18:37.181514 27546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:37.144959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36934 (local address 127.10.255.67:42347)
0806 09:18:37.170134 (+ 25175us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:37.170145 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:37.170480 (+ 335us) server_negotiation.cc:407] Connection header received
0806 09:18:37.170583 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:37.170593 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:37.170816 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:37.171037 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:18:37.172484 (+ 1447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.174278 (+ 1794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.177358 (+ 3080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.178948 (+ 1590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.180614 (+ 1666us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:37.180880 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:37.180987 (+ 107us) server_negotiation.cc:299] Negotiation successful
0806 09:18:37.181172 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24970,"thread_start_us":25417,"threads_started":1}
I20260806 09:18:37.183725 27188 tablet_service.cc:1467] Processing CreateTablet for tablet 4ea6740286a341beb2f22b74905b7997 (DEFAULT_TABLE table=test-table [id=6241b09324ef4f5c9e09bdf3f0917f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:18:37.184638 27324 tablet_service.cc:1467] Processing CreateTablet for tablet 4ea6740286a341beb2f22b74905b7997 (DEFAULT_TABLE table=test-table [id=6241b09324ef4f5c9e09bdf3f0917f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:18:37.184792 27461 tablet_service.cc:1467] Processing CreateTablet for tablet 4ea6740286a341beb2f22b74905b7997 (DEFAULT_TABLE table=test-table [id=6241b09324ef4f5c9e09bdf3f0917f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:18:37.185497 27188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ea6740286a341beb2f22b74905b7997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:18:37.186028 27324 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ea6740286a341beb2f22b74905b7997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:18:37.186587 27461 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ea6740286a341beb2f22b74905b7997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:18:37.204504 27549 tablet_bootstrap.cc:492] T 4ea6740286a341beb2f22b74905b7997 P 6f77142000ec42f5beefb6277cc750c9: Bootstrap starting.
I20260806 09:18:37.204867 27547 tablet_bootstrap.cc:492] T 4ea6740286a341beb2f22b74905b7997 P 9f0a081f13ec454e9f73d3c924b5b532: Bootstrap starting.
I20260806 09:18:37.207623 27548 tablet_bootstrap.cc:492] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849: Bootstrap starting.
I20260806 09:18:37.208595 27547 tablet_bootstrap.cc:654] T 4ea6740286a341beb2f22b74905b7997 P 9f0a081f13ec454e9f73d3c924b5b532: Neither blocks nor log segments found. Creating new log.
I20260806 09:18:37.210531 27547 log.cc:824] T 4ea6740286a341beb2f22b74905b7997 P 9f0a081f13ec454e9f73d3c924b5b532: Log is configured to *not* fsync() on all Append() calls
I20260806 09:18:37.210852 27549 tablet_bootstrap.cc:654] T 4ea6740286a341beb2f22b74905b7997 P 6f77142000ec42f5beefb6277cc750c9: Neither blocks nor log segments found. Creating new log.
I20260806 09:18:37.211547 27548 tablet_bootstrap.cc:654] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849: Neither blocks nor log segments found. Creating new log.
I20260806 09:18:37.212564 27549 log.cc:824] T 4ea6740286a341beb2f22b74905b7997 P 6f77142000ec42f5beefb6277cc750c9: Log is configured to *not* fsync() on all Append() calls
I20260806 09:18:37.213232 27548 log.cc:824] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849: Log is configured to *not* fsync() on all Append() calls
I20260806 09:18:37.214658 27547 tablet_bootstrap.cc:492] T 4ea6740286a341beb2f22b74905b7997 P 9f0a081f13ec454e9f73d3c924b5b532: No bootstrap required, opened a new log
I20260806 09:18:37.214999 27547 ts_tablet_manager.cc:1397] T 4ea6740286a341beb2f22b74905b7997 P 9f0a081f13ec454e9f73d3c924b5b532: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260806 09:18:37.216830 27548 tablet_bootstrap.cc:492] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849: No bootstrap required, opened a new log
I20260806 09:18:37.217159 27548 ts_tablet_manager.cc:1397] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.001s
I20260806 09:18:37.217203 27549 tablet_bootstrap.cc:492] T 4ea6740286a341beb2f22b74905b7997 P 6f77142000ec42f5beefb6277cc750c9: No bootstrap required, opened a new log
I20260806 09:18:37.217482 27549 ts_tablet_manager.cc:1397] T 4ea6740286a341beb2f22b74905b7997 P 6f77142000ec42f5beefb6277cc750c9: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.003s
I20260806 09:18:37.225529 27548 raft_consensus.cc:348] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f77142000ec42f5beefb6277cc750c9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35047 } } peers { permanent_uuid: "8d973a7ac836440d81273a3a0901e849" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 45649 } } peers { permanent_uuid: "9f0a081f13ec454e9f73d3c924b5b532" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 42347 } }
I20260806 09:18:37.226035 27548 raft_consensus.cc:374] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:18:37.226150 27548 raft_consensus.cc:729] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d973a7ac836440d81273a3a0901e849, State: Initialized, Role: FOLLOWER
I20260806 09:18:37.226881 27548 consensus_queue.cc:260] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f77142000ec42f5beefb6277cc750c9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35047 } } peers { permanent_uuid: "8d973a7ac836440d81273a3a0901e849" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 45649 } } peers { permanent_uuid: "9f0a081f13ec454e9f73d3c924b5b532" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 42347 } }
I20260806 09:18:37.227209 27547 raft_consensus.cc:348] T 4ea6740286a341beb2f22b74905b7997 P 9f0a081f13ec454e9f73d3c924b5b532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f77142000ec42f5beefb6277cc750c9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35047 } } peers { permanent_uuid: "8d973a7ac836440d81273a3a0901e849" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 45649 } } peers { permanent_uuid: "9f0a081f13ec454e9f73d3c924b5b532" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 42347 } }
I20260806 09:18:37.227738 27547 raft_consensus.cc:374] T 4ea6740286a341beb2f22b74905b7997 P 9f0a081f13ec454e9f73d3c924b5b532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:18:37.227890 27547 raft_consensus.cc:729] T 4ea6740286a341beb2f22b74905b7997 P 9f0a081f13ec454e9f73d3c924b5b532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0a081f13ec454e9f73d3c924b5b532, State: Initialized, Role: FOLLOWER
I20260806 09:18:37.228354 27389 heartbeater.cc:503] Master 127.10.255.126:32837 was elected leader, sending a full tablet report...
I20260806 09:18:37.228736 27547 consensus_queue.cc:260] T 4ea6740286a341beb2f22b74905b7997 P 9f0a081f13ec454e9f73d3c924b5b532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f77142000ec42f5beefb6277cc750c9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35047 } } peers { permanent_uuid: "8d973a7ac836440d81273a3a0901e849" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 45649 } } peers { permanent_uuid: "9f0a081f13ec454e9f73d3c924b5b532" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 42347 } }
I20260806 09:18:37.229025 27548 ts_tablet_manager.cc:1428] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849: Time spent starting tablet: real 0.012s user 0.009s sys 0.003s
I20260806 09:18:37.230381 27528 heartbeater.cc:503] Master 127.10.255.126:32837 was elected leader, sending a full tablet report...
I20260806 09:18:37.230484 27549 raft_consensus.cc:348] T 4ea6740286a341beb2f22b74905b7997 P 6f77142000ec42f5beefb6277cc750c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f77142000ec42f5beefb6277cc750c9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35047 } } peers { permanent_uuid: "8d973a7ac836440d81273a3a0901e849" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 45649 } } peers { permanent_uuid: "9f0a081f13ec454e9f73d3c924b5b532" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 42347 } }
I20260806 09:18:37.231050 27549 raft_consensus.cc:374] T 4ea6740286a341beb2f22b74905b7997 P 6f77142000ec42f5beefb6277cc750c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:18:37.231194 27549 raft_consensus.cc:729] T 4ea6740286a341beb2f22b74905b7997 P 6f77142000ec42f5beefb6277cc750c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f77142000ec42f5beefb6277cc750c9, State: Initialized, Role: FOLLOWER
I20260806 09:18:37.231945 27549 consensus_queue.cc:260] T 4ea6740286a341beb2f22b74905b7997 P 6f77142000ec42f5beefb6277cc750c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f77142000ec42f5beefb6277cc750c9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35047 } } peers { permanent_uuid: "8d973a7ac836440d81273a3a0901e849" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 45649 } } peers { permanent_uuid: "9f0a081f13ec454e9f73d3c924b5b532" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 42347 } }
I20260806 09:18:37.232916 27547 ts_tablet_manager.cc:1428] T 4ea6740286a341beb2f22b74905b7997 P 9f0a081f13ec454e9f73d3c924b5b532: Time spent starting tablet: real 0.018s user 0.016s sys 0.000s
I20260806 09:18:37.234721 27549 ts_tablet_manager.cc:1428] T 4ea6740286a341beb2f22b74905b7997 P 6f77142000ec42f5beefb6277cc750c9: Time spent starting tablet: real 0.017s user 0.016s sys 0.001s
I20260806 09:18:37.253492 27553 raft_consensus.cc:482] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:18:37.253856 27553 raft_consensus.cc:504] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f77142000ec42f5beefb6277cc750c9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35047 } } peers { permanent_uuid: "8d973a7ac836440d81273a3a0901e849" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 45649 } } peers { permanent_uuid: "9f0a081f13ec454e9f73d3c924b5b532" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 42347 } }
I20260806 09:18:37.255815 27553 leader_election.cc:288] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f77142000ec42f5beefb6277cc750c9 (127.10.255.65:35047), 9f0a081f13ec454e9f73d3c924b5b532 (127.10.255.67:42347)
I20260806 09:18:37.263819 27546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:37.256466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:42445 (local address 127.10.255.67:42347)
0806 09:18:37.256715 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:37.256725 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:37.257627 (+ 902us) server_negotiation.cc:407] Connection header received
0806 09:18:37.257873 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:37.257883 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:37.257948 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:37.258028 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:18:37.258783 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.259557 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.261757 (+ 2200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.262617 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.262760 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:37.262870 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:37.263377 (+ 507us) server_negotiation.cc:299] Negotiation successful
0806 09:18:37.263522 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260806 09:18:37.263904 27545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:37.256337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:37623 (local address 127.10.255.65:35047)
0806 09:18:37.256615 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:37.256625 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:37.257709 (+ 1084us) server_negotiation.cc:407] Connection header received
0806 09:18:37.257911 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:37.257915 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:37.257985 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:37.258126 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:18:37.258889 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.259606 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.261847 (+ 2241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.262701 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.262879 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:37.262961 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:37.263386 (+ 425us) server_negotiation.cc:299] Negotiation successful
0806 09:18:37.263534 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260806 09:18:37.264004 27557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:37.256386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:35047 (local address 127.10.255.66:37623)
0806 09:18:37.257540 (+ 1154us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:37.257556 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:37.257732 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:37.258154 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:37.258159 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:37.258190 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:18:37.258673 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:37.258706 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.259853 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.259857 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:37.261624 (+ 1767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:37.261677 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.262961 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.262966 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:37.263183 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:37.263223 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 09:18:37.263341 (+ 118us) client_negotiation.cc:240] Negotiation successful
0806 09:18:37.263523 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1020,"mutex_wait_us":161,"thread_start_us":539,"threads_started":1}
I20260806 09:18:37.264524 27558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:37.256319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:42347 (local address 127.10.255.66:42445)
0806 09:18:37.257479 (+ 1160us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:37.257497 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:37.257693 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:37.258085 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:37.258094 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:37.258123 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:18:37.258607 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:37.258621 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.259717 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.259726 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:37.261560 (+ 1834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:37.261577 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.262867 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.262963 (+ 96us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:37.263186 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:37.263226 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 09:18:37.263341 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 09:18:37.263535 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1000,"mutex_wait_us":67,"thread_start_us":809,"threads_started":1}
I20260806 09:18:37.265256 27209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ea6740286a341beb2f22b74905b7997" candidate_uuid: "8d973a7ac836440d81273a3a0901e849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f77142000ec42f5beefb6277cc750c9" is_pre_election: true
I20260806 09:18:37.265542 27482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ea6740286a341beb2f22b74905b7997" candidate_uuid: "8d973a7ac836440d81273a3a0901e849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0a081f13ec454e9f73d3c924b5b532" is_pre_election: true
I20260806 09:18:37.265836 27209 raft_consensus.cc:2454] T 4ea6740286a341beb2f22b74905b7997 P 6f77142000ec42f5beefb6277cc750c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d973a7ac836440d81273a3a0901e849 in term 0.
I20260806 09:18:37.266144 27482 raft_consensus.cc:2454] T 4ea6740286a341beb2f22b74905b7997 P 9f0a081f13ec454e9f73d3c924b5b532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d973a7ac836440d81273a3a0901e849 in term 0.
I20260806 09:18:37.266650 27278 leader_election.cc:302] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f77142000ec42f5beefb6277cc750c9, 8d973a7ac836440d81273a3a0901e849; no voters:
I20260806 09:18:37.267180 27553 raft_consensus.cc:2781] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:18:37.267341 27553 raft_consensus.cc:482] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:18:37.267581 27553 raft_consensus.cc:3037] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:18:37.270035 27553 raft_consensus.cc:504] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f77142000ec42f5beefb6277cc750c9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35047 } } peers { permanent_uuid: "8d973a7ac836440d81273a3a0901e849" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 45649 } } peers { permanent_uuid: "9f0a081f13ec454e9f73d3c924b5b532" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 42347 } }
I20260806 09:18:37.270747 27553 leader_election.cc:288] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849 [CANDIDATE]: Term 1 election: Requested vote from peers 6f77142000ec42f5beefb6277cc750c9 (127.10.255.65:35047), 9f0a081f13ec454e9f73d3c924b5b532 (127.10.255.67:42347)
I20260806 09:18:37.271416 27482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ea6740286a341beb2f22b74905b7997" candidate_uuid: "8d973a7ac836440d81273a3a0901e849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0a081f13ec454e9f73d3c924b5b532"
I20260806 09:18:37.271397 27209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ea6740286a341beb2f22b74905b7997" candidate_uuid: "8d973a7ac836440d81273a3a0901e849" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f77142000ec42f5beefb6277cc750c9"
I20260806 09:18:37.271669 27209 raft_consensus.cc:3037] T 4ea6740286a341beb2f22b74905b7997 P 6f77142000ec42f5beefb6277cc750c9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:18:37.271651 27482 raft_consensus.cc:3037] T 4ea6740286a341beb2f22b74905b7997 P 9f0a081f13ec454e9f73d3c924b5b532 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:18:37.274542 27482 raft_consensus.cc:2454] T 4ea6740286a341beb2f22b74905b7997 P 9f0a081f13ec454e9f73d3c924b5b532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d973a7ac836440d81273a3a0901e849 in term 1.
I20260806 09:18:37.274612 27209 raft_consensus.cc:2454] T 4ea6740286a341beb2f22b74905b7997 P 6f77142000ec42f5beefb6277cc750c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d973a7ac836440d81273a3a0901e849 in term 1.
I20260806 09:18:37.275190 27276 leader_election.cc:302] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 6f77142000ec42f5beefb6277cc750c9, 8d973a7ac836440d81273a3a0901e849, 9f0a081f13ec454e9f73d3c924b5b532; no voters:
I20260806 09:18:37.275651 27553 raft_consensus.cc:2781] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:18:37.276283 27553 raft_consensus.cc:686] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849 [term 1 LEADER]: Becoming Leader. State: Replica: 8d973a7ac836440d81273a3a0901e849, State: Running, Role: LEADER
I20260806 09:18:37.276816 27553 consensus_queue.cc:237] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f77142000ec42f5beefb6277cc750c9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35047 } } peers { permanent_uuid: "8d973a7ac836440d81273a3a0901e849" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 45649 } } peers { permanent_uuid: "9f0a081f13ec454e9f73d3c924b5b532" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 42347 } }
I20260806 09:18:37.282210 27062 catalog_manager.cc:5495] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d973a7ac836440d81273a3a0901e849 (127.10.255.66). New cstate: current_term: 1 leader_uuid: "8d973a7ac836440d81273a3a0901e849" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f77142000ec42f5beefb6277cc750c9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d973a7ac836440d81273a3a0901e849" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 45649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f0a081f13ec454e9f73d3c924b5b532" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 42347 } health_report { overall_health: UNKNOWN } } }
W20260806 09:18:37.311919 27529 tablet.cc:2369] T 4ea6740286a341beb2f22b74905b7997 P 9f0a081f13ec454e9f73d3c924b5b532: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:18:37.314873 27544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:37.306820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55414 (local address 127.10.255.66:45649)
0806 09:18:37.307040 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:37.307045 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:37.307147 (+ 102us) server_negotiation.cc:407] Connection header received
0806 09:18:37.307342 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:37.307345 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:37.307434 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:37.307582 (+ 148us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:18:37.308070 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.308915 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.310847 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.311338 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.311465 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:37.313028 (+ 1563us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:18:37.313900 (+ 872us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:18:37.314085 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:37.314349 (+ 264us) server_negotiation.cc:299] Negotiation successful
0806 09:18:37.314479 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 09:18:37.324535 27209 raft_consensus.cc:1261] T 4ea6740286a341beb2f22b74905b7997 P 6f77142000ec42f5beefb6277cc750c9 [term 1 FOLLOWER]: Refusing update from remote peer 8d973a7ac836440d81273a3a0901e849: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:18:37.324535 27482 raft_consensus.cc:1261] T 4ea6740286a341beb2f22b74905b7997 P 9f0a081f13ec454e9f73d3c924b5b532 [term 1 FOLLOWER]: Refusing update from remote peer 8d973a7ac836440d81273a3a0901e849: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:18:37.325743 27553 consensus_queue.cc:1035] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f77142000ec42f5beefb6277cc750c9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:18:37.326066 27559 consensus_queue.cc:1035] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f0a081f13ec454e9f73d3c924b5b532" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 42347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:18:37.340761 27562 mvcc.cc:205] Tried to move back new op lower bound from 7315488429349179392 to 7315488429169549312. Current Snapshot: MvccSnapshot[applied={T|T < 7315488429349179392}]
I20260806 09:18:37.356647 27060 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34188:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:18:37.357105 27060 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34188:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:18:37.362293 27060 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0: Sending DeleteTablet for 3 replicas of tablet 4ea6740286a341beb2f22b74905b7997
I20260806 09:18:37.363754 27324 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ea6740286a341beb2f22b74905b7997 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:18:37 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:55398
I20260806 09:18:37.363752 27188 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ea6740286a341beb2f22b74905b7997 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:18:37 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:39162
I20260806 09:18:37.364081 27461 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ea6740286a341beb2f22b74905b7997 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:18:37 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:36934
I20260806 09:18:37.364845 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 27123
I20260806 09:18:37.379347 27574 tablet_replica.cc:330] T 4ea6740286a341beb2f22b74905b7997 P 9f0a081f13ec454e9f73d3c924b5b532: stopping tablet replica
I20260806 09:18:37.380625 27572 tablet_replica.cc:330] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849: stopping tablet replica
I20260806 09:18:37.381052 27574 raft_consensus.cc:2229] T 4ea6740286a341beb2f22b74905b7997 P 9f0a081f13ec454e9f73d3c924b5b532 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:18:37.381119 27572 raft_consensus.cc:2229] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849 [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:18:37.381809 27574 raft_consensus.cc:2258] T 4ea6740286a341beb2f22b74905b7997 P 9f0a081f13ec454e9f73d3c924b5b532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:18:37.381876 27572 raft_consensus.cc:2258] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:18:37.382733 27573 tablet_replica.cc:330] T 4ea6740286a341beb2f22b74905b7997 P 6f77142000ec42f5beefb6277cc750c9: stopping tablet replica
I20260806 09:18:37.383226 27573 raft_consensus.cc:2229] T 4ea6740286a341beb2f22b74905b7997 P 6f77142000ec42f5beefb6277cc750c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:18:37.383908 27573 raft_consensus.cc:2258] T 4ea6740286a341beb2f22b74905b7997 P 6f77142000ec42f5beefb6277cc750c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:18:37.386631 27573 ts_tablet_manager.cc:1905] T 4ea6740286a341beb2f22b74905b7997 P 6f77142000ec42f5beefb6277cc750c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:18:37.386647 27572 ts_tablet_manager.cc:1905] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:18:37.388727 27574 ts_tablet_manager.cc:1905] T 4ea6740286a341beb2f22b74905b7997 P 9f0a081f13ec454e9f73d3c924b5b532: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 06 09:18:37 dist-test-slave-mvvj krb5kdc[27017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.65@KRBTEST.COM
I20260806 09:18:37.395743 27572 ts_tablet_manager.cc:1918] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:18:37.395741 27573 ts_tablet_manager.cc:1918] T 4ea6740286a341beb2f22b74905b7997 P 6f77142000ec42f5beefb6277cc750c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:18:37.396011 27573 log.cc:1196] T 4ea6740286a341beb2f22b74905b7997 P 6f77142000ec42f5beefb6277cc750c9: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/wal/wals/4ea6740286a341beb2f22b74905b7997
I20260806 09:18:37.396149 27572 log.cc:1196] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/4ea6740286a341beb2f22b74905b7997
I20260806 09:18:37.396791 27573 ts_tablet_manager.cc:1939] T 4ea6740286a341beb2f22b74905b7997 P 6f77142000ec42f5beefb6277cc750c9: Deleting consensus metadata
I20260806 09:18:37.396941 27572 ts_tablet_manager.cc:1939] T 4ea6740286a341beb2f22b74905b7997 P 8d973a7ac836440d81273a3a0901e849: Deleting consensus metadata
I20260806 09:18:37.399199 27049 catalog_manager.cc:4841] TS 8d973a7ac836440d81273a3a0901e849 (127.10.255.66:45649): tablet 4ea6740286a341beb2f22b74905b7997 (table test-table [id=6241b09324ef4f5c9e09bdf3f0917f86]) successfully deleted
I20260806 09:18:37.399935 27048 catalog_manager.cc:4841] TS 6f77142000ec42f5beefb6277cc750c9 (127.10.255.65:35047): tablet 4ea6740286a341beb2f22b74905b7997 (table test-table [id=6241b09324ef4f5c9e09bdf3f0917f86]) successfully deleted
I20260806 09:18:37.402539 27574 ts_tablet_manager.cc:1918] T 4ea6740286a341beb2f22b74905b7997 P 9f0a081f13ec454e9f73d3c924b5b532: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:18:37.402833 27574 log.cc:1196] T 4ea6740286a341beb2f22b74905b7997 P 9f0a081f13ec454e9f73d3c924b5b532: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/4ea6740286a341beb2f22b74905b7997
I20260806 09:18:37.403478 27574 ts_tablet_manager.cc:1939] T 4ea6740286a341beb2f22b74905b7997 P 9f0a081f13ec454e9f73d3c924b5b532: Deleting consensus metadata
I20260806 09:18:37.405759 27046 catalog_manager.cc:4841] TS 9f0a081f13ec454e9f73d3c924b5b532 (127.10.255.67:42347): tablet 4ea6740286a341beb2f22b74905b7997 (table test-table [id=6241b09324ef4f5c9e09bdf3f0917f86]) successfully deleted
I20260806 09:18:37.408869 27545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:37.366511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39172 (local address 127.10.255.65:35047)
0806 09:18:37.366767 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:37.366778 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:37.379816 (+ 13038us) server_negotiation.cc:407] Connection header received
0806 09:18:37.380083 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:37.380091 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:37.380213 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:37.380342 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:37.382723 (+ 2381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.384019 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.386379 (+ 2360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.387078 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.387192 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:37.400185 (+ 12993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:37.400202 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:37.400224 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:37.400287 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:37.404967 (+ 4680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:37.406145 (+ 1178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:37.406154 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:37.406157 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:37.406325 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:37.406824 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:37.406829 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:37.406831 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:37.407277 (+ 446us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:37.407540 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:37.408126 (+ 586us) server_negotiation.cc:299] Negotiation successful
0806 09:18:37.408417 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260806 09:18:37.409708 27249 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:18:37.526046 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 27123
I20260806 09:18:37.546314 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 27260
Aug 06 09:18:37 dist-test-slave-mvvj krb5kdc[27017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.66@KRBTEST.COM
I20260806 09:18:37.567106 27544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:37.547328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55422 (local address 127.10.255.66:45649)
0806 09:18:37.547548 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:37.547555 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:37.547580 (+ 25us) server_negotiation.cc:407] Connection header received
0806 09:18:37.547716 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:37.547722 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:37.547810 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:37.547974 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:37.549367 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.550646 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.552574 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.553301 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.553450 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:37.558712 (+ 5262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:37.558739 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:37.558761 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:37.558821 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:37.563533 (+ 4712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:37.564602 (+ 1069us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:37.564614 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:37.564618 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:37.564790 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:37.565278 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:37.565286 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:37.565293 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:37.565828 (+ 535us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:37.566175 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:37.566407 (+ 232us) server_negotiation.cc:299] Negotiation successful
0806 09:18:37.566689 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 09:18:37.568146 27384 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:18:37.690635 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 27260
I20260806 09:18:37.713456 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 27395
Aug 06 09:18:37 dist-test-slave-mvvj krb5kdc[27017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.67@KRBTEST.COM
I20260806 09:18:37.734159 27546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:37.714500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36944 (local address 127.10.255.67:42347)
0806 09:18:37.714820 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:37.714825 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:37.714848 (+ 23us) server_negotiation.cc:407] Connection header received
0806 09:18:37.715197 (+ 349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:37.715203 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:37.715285 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:37.715388 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:37.717090 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.717889 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.719476 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:37.720069 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:37.720224 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:37.726122 (+ 5898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:37.726143 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:37.726160 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:37.726215 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:37.730111 (+ 3896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:37.731353 (+ 1242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:37.731363 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:37.731366 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:37.731579 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:37.732191 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:37.732196 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:37.732198 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:37.732703 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:37.732975 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:37.733317 (+ 342us) server_negotiation.cc:299] Negotiation successful
0806 09:18:37.733545 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140}
I20260806 09:18:37.734869 27523 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:18:37.829746 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 27395
I20260806 09:18:37.852172 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 27030
I20260806 09:18:37.853523 27092 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:18:37.975091 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 27030
I20260806 09:18:57.999168 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:32837
--webserver_interface=127.10.255.126
--webserver_port=43077
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:39373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:32837
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:18:58.368041 27580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:18:58.368381 27580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:18:58.368551 27580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:18:58.376500 27580 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 09:18:58.376626 27580 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 09:18:58.376668 27580 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 09:18:58.376754 27580 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:18:58.376866 27580 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:18:58.376988 27580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:18:58.377058 27580 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:18:58.377135 27580 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:18:58.387920 27580 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:39373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:32837
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:32837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=43077
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:18:58.389355 27580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:18:58.390800 27580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:18:58.419210 27586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:58.419186 27589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:58.419248 27587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:18:58.420334 27580 server_base.cc:1034] running on GCE node
I20260806 09:18:58.421344 27580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:18:58.423185 27580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:18:58.424448 27580 hybrid_clock.cc:648] HybridClock initialized: now 1786007938424371 us; error 52 us; skew 500 ppm
I20260806 09:18:58.424958 27580 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:18:58 dist-test-slave-mvvj krb5kdc[27017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007938, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:18:58.429327 27580 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:18:58.431491 27580 webserver.cc:460] Webserver started at http://127.10.255.126:43077/ using document root <none> and password file <none>
I20260806 09:18:58.432507 27580 fs_manager.cc:359] Metadata directory not provided
I20260806 09:18:58.432696 27580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:18:58.440230 27580 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 09:18:58.443905 27596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:58.445672 27580 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:18:58.445917 27580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "54addc5e405f4d1eb2d4d8dd79121ee0"
format_stamp: "Formatted at 2026-08-06 09:18:35 on dist-test-slave-mvvj"
server_key: "0dcbfc8e9addc76f0012b478c0439160"
server_key_iv: "cdbd53fc2a5400b39bbb80ba89ef4ac3"
server_key_version: "encryptionkey@0"
I20260806 09:18:58.447118 27580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:18:58.460938 27580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:18:58.466531 27580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:18:58.466907 27580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:18:58.490046 27580 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:32837
I20260806 09:18:58.490091 27649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:32837 every 8 connection(s)
I20260806 09:18:58.492179 27580 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:18:58.494968 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 27580
I20260806 09:18:58.495976 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:35047
--local_ip_for_outbound_sockets=127.10.255.65
--tserver_master_addrs=127.10.255.126:32837
--webserver_port=40897
--webserver_interface=127.10.255.65
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:39373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:18:58.500725 27650 sys_catalog.cc:263] Verifying existing consensus state
I20260806 09:18:58.504807 27650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0: Bootstrap starting.
I20260806 09:18:58.537473 27650 log.cc:824] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0: Log is configured to *not* fsync() on all Append() calls
I20260806 09:18:58.554844 27650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 09:18:58.555702 27650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0: Bootstrap complete.
I20260806 09:18:58.571446 27650 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54addc5e405f4d1eb2d4d8dd79121ee0" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 32837 } }
I20260806 09:18:58.573201 27650 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54addc5e405f4d1eb2d4d8dd79121ee0, State: Initialized, Role: FOLLOWER
I20260806 09:18:58.574214 27650 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54addc5e405f4d1eb2d4d8dd79121ee0" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 32837 } }
I20260806 09:18:58.574548 27650 raft_consensus.cc:388] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:18:58.574676 27650 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:18:58.574877 27650 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 1 FOLLOWER]: Advancing to term 2
I20260806 09:18:58.582158 27650 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54addc5e405f4d1eb2d4d8dd79121ee0" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 32837 } }
I20260806 09:18:58.582926 27650 leader_election.cc:302] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 54addc5e405f4d1eb2d4d8dd79121ee0; no voters:
I20260806 09:18:58.583705 27650 leader_election.cc:288] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 09:18:58.583916 27654 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 09:18:58.585204 27654 raft_consensus.cc:686] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 2 LEADER]: Becoming Leader. State: Replica: 54addc5e405f4d1eb2d4d8dd79121ee0, State: Running, Role: LEADER
I20260806 09:18:58.585872 27654 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54addc5e405f4d1eb2d4d8dd79121ee0" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 32837 } }
I20260806 09:18:58.586162 27650 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:18:58.588455 27656 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54addc5e405f4d1eb2d4d8dd79121ee0. Latest consensus state: current_term: 2 leader_uuid: "54addc5e405f4d1eb2d4d8dd79121ee0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54addc5e405f4d1eb2d4d8dd79121ee0" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 32837 } } }
I20260806 09:18:58.588901 27656 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [sys.catalog]: This master's current role is: LEADER
I20260806 09:18:58.589577 27655 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "54addc5e405f4d1eb2d4d8dd79121ee0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54addc5e405f4d1eb2d4d8dd79121ee0" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 32837 } } }
I20260806 09:18:58.589964 27655 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [sys.catalog]: This master's current role is: LEADER
I20260806 09:18:58.594419 27660 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:18:58.603773 27660 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:18:58.605504 27660 catalog_manager.cc:1259] Loaded cluster ID: 9f3a2c687f4445dcbfcaa13d31feefb3
I20260806 09:18:58.605711 27660 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:18:58.613974 27660 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:18:58.616634 27660 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0: Loaded TSK: 0
I20260806 09:18:58.657712 27660 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0: Generated new TSK 1
I20260806 09:18:58.658208 27660 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 09:18:58.926332 27652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:18:58.926681 27652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:18:58.926836 27652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:18:58.934772 27652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:18:58.934911 27652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:18:58.935096 27652 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:18:58.946525 27652 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:39373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:35047
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=40897
--tserver_master_addrs=127.10.255.126:32837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:18:58.948068 27652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:18:58.949571 27652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:18:58.965128 27678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:58.965317 27680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:58.965526 27682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:18:58.966488 27652 server_base.cc:1034] running on GCE node
I20260806 09:18:58.967248 27652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:18:58.968513 27652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:18:58.969846 27652 hybrid_clock.cc:648] HybridClock initialized: now 1786007938969797 us; error 38 us; skew 500 ppm
I20260806 09:18:58.970329 27652 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:18:58 dist-test-slave-mvvj krb5kdc[27017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007938, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:18:58.974732 27652 init.cc:377] Logged in from keytab as kudu/127.10.255.65@KRBTEST.COM (short username kudu)
I20260806 09:18:58.976648 27652 webserver.cc:460] Webserver started at http://127.10.255.65:40897/ using document root <none> and password file <none>
I20260806 09:18:58.977459 27652 fs_manager.cc:359] Metadata directory not provided
I20260806 09:18:58.977630 27652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:18:58.984629 27652 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.002s sys 0.001s
I20260806 09:18:58.988238 27690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:58.990159 27652 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:18:58.990404 27652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "6f77142000ec42f5beefb6277cc750c9"
format_stamp: "Formatted at 2026-08-06 09:18:35 on dist-test-slave-mvvj"
server_key: "82232122e55ae6d44d77bd5c3a99a6c2"
server_key_iv: "c5cbc7b027ea347e20adb2617722fd59"
server_key_version: "encryptionkey@0"
I20260806 09:18:58.991698 27652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:18:59.014864 27652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:18:59.020680 27652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:18:59.021018 27652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:18:59.022156 27652 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:18:59.023727 27652 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:18:59.023895 27652 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:59.024041 27652 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:18:59.024145 27652 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:59.061623 27652 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:35047
I20260806 09:18:59.061678 27805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:35047 every 8 connection(s)
I20260806 09:18:59.063253 27652 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:18:59.072189 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 27652
I20260806 09:18:59.072944 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:45649
--local_ip_for_outbound_sockets=127.10.255.66
--tserver_master_addrs=127.10.255.126:32837
--webserver_port=37343
--webserver_interface=127.10.255.66
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:39373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 09:18:59 dist-test-slave-mvvj krb5kdc[27017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007938, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:18:59.092722 27809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:59.066788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.65:51103)
0806 09:18:59.067716 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:59.067764 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:59.069751 (+ 1987us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:59.071694 (+ 1943us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:59.071702 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:59.072378 (+ 676us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:18:59.073014 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:59.073036 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:59.074875 (+ 1839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:59.074879 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:59.076244 (+ 1365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:59.076259 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:59.077402 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:59.077410 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:59.077700 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:59.078464 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:18:59.078495 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:18:59.081308 (+ 2813us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:18:59.087034 (+ 5726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:59.087045 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:59.087061 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:59.088000 (+ 939us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:59.088713 (+ 713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:59.088717 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:59.088720 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:59.089085 (+ 365us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:59.090196 (+ 1111us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:18:59.090204 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:18:59.090603 (+ 399us) client_negotiation.cc:769] Sending connection context
0806 09:18:59.090902 (+ 299us) client_negotiation.cc:240] Negotiation successful
0806 09:18:59.091471 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"thread_start_us":392,"threads_started":1}
I20260806 09:18:59.093552 27808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:59.066511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:51103 (local address 127.10.255.126:32837)
0806 09:18:59.067110 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:59.067122 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:59.067971 (+ 849us) server_negotiation.cc:407] Connection header received
0806 09:18:59.070573 (+ 2602us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:59.070588 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:59.071103 (+ 515us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:59.071531 (+ 428us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:59.073352 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:59.074653 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:59.076415 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:59.077112 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:59.077345 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:59.081747 (+ 4402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:59.081761 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:59.081788 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:59.081864 (+ 76us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:59.086780 (+ 4916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:59.088223 (+ 1443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:59.088237 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:59.088247 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:59.088506 (+ 259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:59.089231 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:59.089239 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:59.089245 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:59.090017 (+ 772us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:59.090253 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:59.091346 (+ 1093us) server_negotiation.cc:299] Negotiation successful
0806 09:18:59.091999 (+ 653us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":257,"threads_started":1}
I20260806 09:18:59.096748 27806 heartbeater.cc:347] Connected to a master server at 127.10.255.126:32837
I20260806 09:18:59.097128 27806 heartbeater.cc:464] Registering TS with master...
I20260806 09:18:59.098122 27806 heartbeater.cc:511] Master 127.10.255.126:32837 requested a full tablet report, sending...
I20260806 09:18:59.100781 27614 ts_manager.cc:194] Registered new tserver with Master: 6f77142000ec42f5beefb6277cc750c9 (127.10.255.65:35047)
I20260806 09:18:59.102473 27614 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.65@KRBTEST.COM'} at 127.10.255.65:51103
W20260806 09:18:59.450941 27810 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:18:59.451270 27810 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:18:59.451435 27810 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:18:59.462723 27810 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:18:59.462899 27810 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:18:59.463084 27810 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:18:59.474351 27810 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:39373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:45649
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=37343
--tserver_master_addrs=127.10.255.126:32837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:18:59.475766 27810 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:18:59.477197 27810 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:18:59.493716 27816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:59.493445 27815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:18:59.494323 27818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:18:59.494889 27810 server_base.cc:1034] running on GCE node
I20260806 09:18:59.495822 27810 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:18:59.497265 27810 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:18:59.498557 27810 hybrid_clock.cc:648] HybridClock initialized: now 1786007939498507 us; error 100 us; skew 500 ppm
I20260806 09:18:59.498940 27810 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:18:59 dist-test-slave-mvvj krb5kdc[27017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007939, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:18:59.503337 27810 init.cc:377] Logged in from keytab as kudu/127.10.255.66@KRBTEST.COM (short username kudu)
I20260806 09:18:59.505271 27810 webserver.cc:460] Webserver started at http://127.10.255.66:37343/ using document root <none> and password file <none>
I20260806 09:18:59.506079 27810 fs_manager.cc:359] Metadata directory not provided
I20260806 09:18:59.506386 27810 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:18:59.513303 27810 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.002s sys 0.002s
I20260806 09:18:59.516829 27825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:59.518713 27810 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:18:59.518957 27810 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "8d973a7ac836440d81273a3a0901e849"
format_stamp: "Formatted at 2026-08-06 09:18:36 on dist-test-slave-mvvj"
server_key: "2f019c8e919db77081b2ed6508b88975"
server_key_iv: "25de4a7120356eabc8307b0db7afb7d0"
server_key_version: "encryptionkey@0"
I20260806 09:18:59.520233 27810 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:18:59.554884 27810 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:18:59.560202 27810 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:18:59.560644 27810 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:18:59.561889 27810 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:18:59.563520 27810 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:18:59.563669 27810 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:18:59.563864 27810 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:18:59.563972 27810 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260806 09:18:59.604405 27810 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:45649
I20260806 09:18:59.604462 27938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:45649 every 8 connection(s)
I20260806 09:18:59.606055 27810 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:18:59.607036 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 27810
I20260806 09:18:59.608040 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:42347
--local_ip_for_outbound_sockets=127.10.255.67
--tserver_master_addrs=127.10.255.126:32837
--webserver_port=42367
--webserver_interface=127.10.255.67
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:39373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 09:18:59 dist-test-slave-mvvj krb5kdc[27017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007939, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:18:59.633387 27941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:59.610069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:43451 (local address 127.10.255.126:32837)
0806 09:18:59.610634 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0806 09:18:59.610641 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:18:59.611869 (+ 1228us) server_negotiation.cc:407] Connection header received
0806 09:18:59.615145 (+ 3276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:18:59.615151 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:18:59.615261 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:18:59.615438 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:18:59.617518 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:59.618330 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:59.620369 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:18:59.620870 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:18:59.621069 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:59.625961 (+ 4892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:18:59.625967 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:18:59.625971 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:18:59.626023 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:18:59.629357 (+ 3334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:59.630406 (+ 1049us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:59.630411 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:59.630414 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:59.630568 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:18:59.631125 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:18:59.631130 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:18:59.631132 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:18:59.631471 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:18:59.631669 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0806 09:18:59.632641 (+ 972us) server_negotiation.cc:299] Negotiation successful
0806 09:18:59.632958 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":262,"threads_started":1}
I20260806 09:18:59.634529 27942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:18:59.610628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.66:43451)
0806 09:18:59.611625 (+ 997us) negotiation.cc:107] Waiting for socket to connect
0806 09:18:59.611691 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0806 09:18:59.614714 (+ 3023us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:18:59.615763 (+ 1049us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:18:59.615784 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:18:59.616576 (+ 792us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:18:59.617276 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:59.617299 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:59.618585 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:59.618591 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:59.620167 (+ 1576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:18:59.620184 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:18:59.621199 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:18:59.621209 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:18:59.621508 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:18:59.622353 (+ 845us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:18:59.622385 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:18:59.625588 (+ 3203us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:18:59.629591 (+ 4003us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:59.629612 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:59.629630 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:59.630214 (+ 584us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:59.630709 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:18:59.630714 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:18:59.630719 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:18:59.630961 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:18:59.631641 (+ 680us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:18:59.631651 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:18:59.632159 (+ 508us) client_negotiation.cc:769] Sending connection context
0806 09:18:59.632497 (+ 338us) client_negotiation.cc:240] Negotiation successful
0806 09:18:59.633177 (+ 680us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":614,"thread_start_us":364,"threads_started":1}
I20260806 09:18:59.636516 27939 heartbeater.cc:347] Connected to a master server at 127.10.255.126:32837
I20260806 09:18:59.636957 27939 heartbeater.cc:464] Registering TS with master...
I20260806 09:18:59.637815 27939 heartbeater.cc:511] Master 127.10.255.126:32837 requested a full tablet report, sending...
I20260806 09:18:59.639632 27614 ts_manager.cc:194] Registered new tserver with Master: 8d973a7ac836440d81273a3a0901e849 (127.10.255.66:45649)
I20260806 09:18:59.640815 27614 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.66@KRBTEST.COM'} at 127.10.255.66:43451
W20260806 09:18:59.984476 27943 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:18:59.984833 27943 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:18:59.984937 27943 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:18:59.993090 27943 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:18:59.993237 27943 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:18:59.993369 27943 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:19:00.005932 27943 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:39373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:42347
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=42367
--tserver_master_addrs=127.10.255.126:32837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:00.007473 27943 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:00.009090 27943 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:19:00.026012 27951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:00.026060 27949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:00.026110 27948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:00.030246 27943 server_base.cc:1034] running on GCE node
I20260806 09:19:00.031126 27943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:00.032474 27943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:00.033749 27943 hybrid_clock.cc:648] HybridClock initialized: now 1786007940033676 us; error 72 us; skew 500 ppm
I20260806 09:19:00.034090 27943 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:19:00 dist-test-slave-mvvj krb5kdc[27017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007940, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:19:00.043301 27943 init.cc:377] Logged in from keytab as kudu/127.10.255.67@KRBTEST.COM (short username kudu)
I20260806 09:19:00.045092 27943 webserver.cc:460] Webserver started at http://127.10.255.67:42367/ using document root <none> and password file <none>
I20260806 09:19:00.045886 27943 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:00.046022 27943 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:00.052589 27943 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260806 09:19:00.055927 27958 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:00.057786 27943 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:19:00.058050 27943 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "9f0a081f13ec454e9f73d3c924b5b532"
format_stamp: "Formatted at 2026-08-06 09:18:36 on dist-test-slave-mvvj"
server_key: "5aa34323f5151a8f6b1da3c831bbc402"
server_key_iv: "71401f6bcbd676f30ab630807fa4b6d5"
server_key_version: "encryptionkey@0"
I20260806 09:19:00.059319 27943 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:00.099213 27943 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:00.104286 27943 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:00.104708 27943 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:00.105916 27943 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:19:00.106151 27806 heartbeater.cc:503] Master 127.10.255.126:32837 was elected leader, sending a full tablet report...
I20260806 09:19:00.108142 27943 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:19:00.108314 27943 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:00.108475 27943 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:19:00.108557 27943 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:00.152209 27943 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:42347
I20260806 09:19:00.152403 28071 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:42347 every 8 connection(s)
I20260806 09:19:00.154141 27943 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:19:00.161451 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 27943
Aug 06 09:19:00 dist-test-slave-mvvj krb5kdc[27017](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007940, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:19:00.184574 28077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:00.162760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39834 (local address 127.10.255.126:32837)
0806 09:19:00.164000 (+ 1240us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:00.164004 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:00.164020 (+ 16us) server_negotiation.cc:407] Connection header received
0806 09:19:00.164066 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:00.164070 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:00.164166 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:00.164299 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:00.166417 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.167188 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.169228 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.169884 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.170042 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:00.173655 (+ 3613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:00.173663 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:00.173668 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:00.173723 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:00.178999 (+ 5276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:00.180111 (+ 1112us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:00.180117 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:00.180119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:00.180354 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:00.180976 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:00.180985 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:00.180991 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:00.182080 (+ 1089us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:00.182418 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:00.183173 (+ 755us) server_negotiation.cc:299] Negotiation successful
0806 09:19:00.183412 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":161,"server-negotiator.queue_time_us":1054,"spinlock_wait_cycles":1792,"thread_start_us":927,"threads_started":1}
I20260806 09:19:00.185102 28074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:00.157707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:37333 (local address 127.10.255.126:32837)
0806 09:19:00.158528 (+ 821us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:00.158534 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:00.159547 (+ 1013us) server_negotiation.cc:407] Connection header received
0806 09:19:00.162198 (+ 2651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:00.162207 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:00.162353 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:00.162564 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:00.164857 (+ 2293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.166146 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.168142 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.168844 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.168997 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:00.173935 (+ 4938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:00.173940 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:00.173944 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:00.174050 (+ 106us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:00.178954 (+ 4904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:00.180220 (+ 1266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:00.180227 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:00.180234 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:00.180355 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:00.181072 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:00.181078 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:00.181084 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:00.182051 (+ 967us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:00.182313 (+ 262us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:00.183700 (+ 1387us) server_negotiation.cc:299] Negotiation successful
0806 09:19:00.184561 (+ 861us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":631,"thread_start_us":392,"threads_started":1}
I20260806 09:19:00.186055 28075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:00.158450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.67:37333)
0806 09:19:00.159303 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:00.159359 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:00.161736 (+ 2377us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:00.162942 (+ 1206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:00.162962 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:00.163991 (+ 1029us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:19:00.164658 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:00.164679 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.166406 (+ 1727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.166410 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:00.167963 (+ 1553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:00.167980 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.169160 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.169174 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:00.169582 (+ 408us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:00.170540 (+ 958us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:19:00.170626 (+ 86us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:19:00.173584 (+ 2958us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:19:00.179243 (+ 5659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:19:00.179255 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:19:00.179277 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:19:00.180060 (+ 783us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:19:00.180496 (+ 436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:19:00.180501 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:19:00.180504 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:19:00.180828 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:19:00.182420 (+ 1592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:19:00.182430 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:19:00.183072 (+ 642us) client_negotiation.cc:769] Sending connection context
0806 09:19:00.183490 (+ 418us) client_negotiation.cc:240] Negotiation successful
0806 09:19:00.184495 (+ 1005us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":344,"threads_started":1}
I20260806 09:19:00.187742 28072 heartbeater.cc:347] Connected to a master server at 127.10.255.126:32837
I20260806 09:19:00.188134 28072 heartbeater.cc:464] Registering TS with master...
I20260806 09:19:00.188973 28072 heartbeater.cc:511] Master 127.10.255.126:32837 requested a full tablet report, sending...
I20260806 09:19:00.190753 27614 ts_manager.cc:194] Registered new tserver with Master: 9f0a081f13ec454e9f73d3c924b5b532 (127.10.255.67:42347)
I20260806 09:19:00.191789 27614 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.67@KRBTEST.COM'} at 127.10.255.67:37333
I20260806 09:19:00.201711 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 09:19:00.210278 28074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:00.202962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39840 (local address 127.10.255.126:32837)
0806 09:19:00.203230 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:00.203236 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:00.203771 (+ 535us) server_negotiation.cc:407] Connection header received
0806 09:19:00.204119 (+ 348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:00.204123 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:00.204288 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:00.204473 (+ 185us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:19:00.205083 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.205835 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.207721 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.208283 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.208450 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:00.209109 (+ 659us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:19:00.209444 (+ 335us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0806 09:19:00.209907 (+ 463us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:39840: token expired
Metrics: {"server-negotiator.queue_time_us":108}
W20260806 09:19:00.210425 28074 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:39840: token expired
W20260806 09:19:00.211388 27533 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.10.255.126:32837)
I20260806 09:19:00.229230 28074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:00.212321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39844 (local address 127.10.255.126:32837)
0806 09:19:00.212530 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:00.212536 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:00.212554 (+ 18us) server_negotiation.cc:407] Connection header received
0806 09:19:00.212621 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:00.212626 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:00.212697 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:00.212811 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:00.214355 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.215276 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.216960 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.217702 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.217859 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:00.221768 (+ 3909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:00.221775 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:00.221778 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:00.221830 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:00.225865 (+ 4035us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:00.226856 (+ 991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:00.226861 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:00.226864 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:00.227021 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:00.227469 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:00.227473 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:00.227475 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:00.227820 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:00.228153 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:00.228603 (+ 450us) server_negotiation.cc:299] Negotiation successful
0806 09:19:00.228817 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 09:19:00.233331 27614 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39844:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:19:00.242132 27614 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:19:00.286242 28085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:00.257324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:45649 (local address 127.0.0.1:60436)
0806 09:19:00.274775 (+ 17451us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:00.274802 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:00.277196 (+ 2394us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:00.278157 (+ 961us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:00.278169 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:00.278214 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:00.278899 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:00.278919 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.281137 (+ 2218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.281142 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:00.283548 (+ 2406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:00.283559 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.285091 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.285098 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:00.285315 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:00.285361 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 09:19:00.285486 (+ 125us) client_negotiation.cc:240] Negotiation successful
0806 09:19:00.285745 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17253,"mutex_wait_us":25,"thread_start_us":15331,"threads_started":1}
I20260806 09:19:00.286959 28083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:00.256949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48434 (local address 127.10.255.65:35047)
0806 09:19:00.277811 (+ 20862us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:00.277820 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:00.277850 (+ 30us) server_negotiation.cc:407] Connection header received
0806 09:19:00.277950 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:00.277962 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:00.278188 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:00.278408 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:00.279137 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.280549 (+ 1412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.283552 (+ 3003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.285358 (+ 1806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.285526 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:00.285787 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:00.286361 (+ 574us) server_negotiation.cc:299] Negotiation successful
0806 09:19:00.286567 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20683,"thread_start_us":20505,"threads_started":1}
I20260806 09:19:00.287253 28086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:00.257558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60436 (local address 127.10.255.66:45649)
0806 09:19:00.277039 (+ 19481us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:00.277050 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:00.277083 (+ 33us) server_negotiation.cc:407] Connection header received
0806 09:19:00.277516 (+ 433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:00.277526 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:00.277838 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:00.278084 (+ 246us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:00.279167 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.280973 (+ 1806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.283726 (+ 2753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.284814 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.284991 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:00.285231 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:00.286729 (+ 1498us) server_negotiation.cc:299] Negotiation successful
0806 09:19:00.286937 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19308,"thread_start_us":19178,"threads_started":1}
I20260806 09:19:00.286732 28084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:00.256924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:35047 (local address 127.0.0.1:48434)
0806 09:19:00.273313 (+ 16389us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:00.273398 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:00.273668 (+ 270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:00.278439 (+ 4771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:00.278445 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:00.278480 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:00.278944 (+ 464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:00.278954 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.280688 (+ 1734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.280693 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:00.283308 (+ 2615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:00.283331 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.285681 (+ 2350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.285687 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:00.285833 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:00.285878 (+ 45us) client_negotiation.cc:769] Sending connection context
0806 09:19:00.285971 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 09:19:00.286110 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15922,"mutex_wait_us":61,"thread_start_us":20088,"threads_started":1}
I20260806 09:19:00.288709 28087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:00.260079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:42347 (local address 127.0.0.1:53556)
0806 09:19:00.277333 (+ 17254us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:00.277366 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:00.277543 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:00.279652 (+ 2109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:00.279657 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:00.279683 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:00.280051 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:00.280064 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.282400 (+ 2336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.282406 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:00.285042 (+ 2636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:00.285065 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.287207 (+ 2142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.287214 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:00.287479 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:00.287524 (+ 45us) client_negotiation.cc:769] Sending connection context
0806 09:19:00.288110 (+ 586us) client_negotiation.cc:240] Negotiation successful
0806 09:19:00.288267 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17098,"mutex_wait_us":1,"thread_start_us":16926,"threads_started":1}
I20260806 09:19:00.291244 27740 tablet_service.cc:1467] Processing CreateTablet for tablet 83f2f8536d7b4505bf0ec251e967fb39 (DEFAULT_TABLE table=test-table [id=afc59d2af059457989a742b053dd1fb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:19:00.292102 28088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:00.260259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53556 (local address 127.10.255.67:42347)
0806 09:19:00.279050 (+ 18791us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:00.279061 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:00.279097 (+ 36us) server_negotiation.cc:407] Connection header received
0806 09:19:00.279194 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:00.279201 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:00.279416 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:00.279629 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:00.280254 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.282164 (+ 1910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.285326 (+ 3162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.286928 (+ 1602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.287103 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:00.287372 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:00.288221 (+ 849us) server_negotiation.cc:299] Negotiation successful
0806 09:19:00.288424 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18594,"thread_start_us":19640,"threads_started":1}
I20260806 09:19:00.291535 27873 tablet_service.cc:1467] Processing CreateTablet for tablet 83f2f8536d7b4505bf0ec251e967fb39 (DEFAULT_TABLE table=test-table [id=afc59d2af059457989a742b053dd1fb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:19:00.292819 27740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83f2f8536d7b4505bf0ec251e967fb39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:19:00.293730 27873 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83f2f8536d7b4505bf0ec251e967fb39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:19:00.295663 28006 tablet_service.cc:1467] Processing CreateTablet for tablet 83f2f8536d7b4505bf0ec251e967fb39 (DEFAULT_TABLE table=test-table [id=afc59d2af059457989a742b053dd1fb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:19:00.297371 28006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83f2f8536d7b4505bf0ec251e967fb39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:19:00.312460 28092 tablet_bootstrap.cc:492] T 83f2f8536d7b4505bf0ec251e967fb39 P 9f0a081f13ec454e9f73d3c924b5b532: Bootstrap starting.
I20260806 09:19:00.316751 28089 tablet_bootstrap.cc:492] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9: Bootstrap starting.
I20260806 09:19:00.317153 28092 tablet_bootstrap.cc:654] T 83f2f8536d7b4505bf0ec251e967fb39 P 9f0a081f13ec454e9f73d3c924b5b532: Neither blocks nor log segments found. Creating new log.
I20260806 09:19:00.317811 28090 tablet_bootstrap.cc:492] T 83f2f8536d7b4505bf0ec251e967fb39 P 8d973a7ac836440d81273a3a0901e849: Bootstrap starting.
I20260806 09:19:00.319242 28092 log.cc:824] T 83f2f8536d7b4505bf0ec251e967fb39 P 9f0a081f13ec454e9f73d3c924b5b532: Log is configured to *not* fsync() on all Append() calls
I20260806 09:19:00.321571 28089 tablet_bootstrap.cc:654] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9: Neither blocks nor log segments found. Creating new log.
I20260806 09:19:00.321805 28090 tablet_bootstrap.cc:654] T 83f2f8536d7b4505bf0ec251e967fb39 P 8d973a7ac836440d81273a3a0901e849: Neither blocks nor log segments found. Creating new log.
I20260806 09:19:00.322790 28089 log.cc:824] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9: Log is configured to *not* fsync() on all Append() calls
I20260806 09:19:00.323383 28090 log.cc:824] T 83f2f8536d7b4505bf0ec251e967fb39 P 8d973a7ac836440d81273a3a0901e849: Log is configured to *not* fsync() on all Append() calls
I20260806 09:19:00.324582 28092 tablet_bootstrap.cc:492] T 83f2f8536d7b4505bf0ec251e967fb39 P 9f0a081f13ec454e9f73d3c924b5b532: No bootstrap required, opened a new log
I20260806 09:19:00.325047 28092 ts_tablet_manager.cc:1397] T 83f2f8536d7b4505bf0ec251e967fb39 P 9f0a081f13ec454e9f73d3c924b5b532: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.010s
I20260806 09:19:00.326547 28089 tablet_bootstrap.cc:492] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9: No bootstrap required, opened a new log
I20260806 09:19:00.326850 28089 ts_tablet_manager.cc:1397] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.003s
I20260806 09:19:00.329581 28090 tablet_bootstrap.cc:492] T 83f2f8536d7b4505bf0ec251e967fb39 P 8d973a7ac836440d81273a3a0901e849: No bootstrap required, opened a new log
I20260806 09:19:00.330003 28090 ts_tablet_manager.cc:1397] T 83f2f8536d7b4505bf0ec251e967fb39 P 8d973a7ac836440d81273a3a0901e849: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.004s
I20260806 09:19:00.333112 28092 raft_consensus.cc:348] T 83f2f8536d7b4505bf0ec251e967fb39 P 9f0a081f13ec454e9f73d3c924b5b532 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f77142000ec42f5beefb6277cc750c9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35047 } } peers { permanent_uuid: "8d973a7ac836440d81273a3a0901e849" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 45649 } } peers { permanent_uuid: "9f0a081f13ec454e9f73d3c924b5b532" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 42347 } }
I20260806 09:19:00.333580 28092 raft_consensus.cc:374] T 83f2f8536d7b4505bf0ec251e967fb39 P 9f0a081f13ec454e9f73d3c924b5b532 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:19:00.333722 28092 raft_consensus.cc:729] T 83f2f8536d7b4505bf0ec251e967fb39 P 9f0a081f13ec454e9f73d3c924b5b532 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0a081f13ec454e9f73d3c924b5b532, State: Initialized, Role: FOLLOWER
I20260806 09:19:00.334434 28092 consensus_queue.cc:260] T 83f2f8536d7b4505bf0ec251e967fb39 P 9f0a081f13ec454e9f73d3c924b5b532 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f77142000ec42f5beefb6277cc750c9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35047 } } peers { permanent_uuid: "8d973a7ac836440d81273a3a0901e849" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 45649 } } peers { permanent_uuid: "9f0a081f13ec454e9f73d3c924b5b532" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 42347 } }
I20260806 09:19:00.335716 28072 heartbeater.cc:503] Master 127.10.255.126:32837 was elected leader, sending a full tablet report...
I20260806 09:19:00.336817 28092 ts_tablet_manager.cc:1428] T 83f2f8536d7b4505bf0ec251e967fb39 P 9f0a081f13ec454e9f73d3c924b5b532: Time spent starting tablet: real 0.012s user 0.009s sys 0.002s
I20260806 09:19:00.338889 28089 raft_consensus.cc:348] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f77142000ec42f5beefb6277cc750c9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35047 } } peers { permanent_uuid: "8d973a7ac836440d81273a3a0901e849" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 45649 } } peers { permanent_uuid: "9f0a081f13ec454e9f73d3c924b5b532" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 42347 } }
I20260806 09:19:00.339486 28089 raft_consensus.cc:374] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:19:00.339600 28089 raft_consensus.cc:729] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f77142000ec42f5beefb6277cc750c9, State: Initialized, Role: FOLLOWER
I20260806 09:19:00.340408 28089 consensus_queue.cc:260] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f77142000ec42f5beefb6277cc750c9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35047 } } peers { permanent_uuid: "8d973a7ac836440d81273a3a0901e849" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 45649 } } peers { permanent_uuid: "9f0a081f13ec454e9f73d3c924b5b532" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 42347 } }
I20260806 09:19:00.342756 28089 ts_tablet_manager.cc:1428] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9: Time spent starting tablet: real 0.016s user 0.015s sys 0.000s
I20260806 09:19:00.342792 28090 raft_consensus.cc:348] T 83f2f8536d7b4505bf0ec251e967fb39 P 8d973a7ac836440d81273a3a0901e849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f77142000ec42f5beefb6277cc750c9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35047 } } peers { permanent_uuid: "8d973a7ac836440d81273a3a0901e849" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 45649 } } peers { permanent_uuid: "9f0a081f13ec454e9f73d3c924b5b532" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 42347 } }
I20260806 09:19:00.343452 28090 raft_consensus.cc:374] T 83f2f8536d7b4505bf0ec251e967fb39 P 8d973a7ac836440d81273a3a0901e849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:19:00.343653 28090 raft_consensus.cc:729] T 83f2f8536d7b4505bf0ec251e967fb39 P 8d973a7ac836440d81273a3a0901e849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d973a7ac836440d81273a3a0901e849, State: Initialized, Role: FOLLOWER
I20260806 09:19:00.344560 28090 consensus_queue.cc:260] T 83f2f8536d7b4505bf0ec251e967fb39 P 8d973a7ac836440d81273a3a0901e849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f77142000ec42f5beefb6277cc750c9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35047 } } peers { permanent_uuid: "8d973a7ac836440d81273a3a0901e849" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 45649 } } peers { permanent_uuid: "9f0a081f13ec454e9f73d3c924b5b532" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 42347 } }
I20260806 09:19:00.346357 27939 heartbeater.cc:503] Master 127.10.255.126:32837 was elected leader, sending a full tablet report...
I20260806 09:19:00.346987 28090 ts_tablet_manager.cc:1428] T 83f2f8536d7b4505bf0ec251e967fb39 P 8d973a7ac836440d81273a3a0901e849: Time spent starting tablet: real 0.017s user 0.014s sys 0.001s
W20260806 09:19:00.359318 27940 tablet.cc:2369] T 83f2f8536d7b4505bf0ec251e967fb39 P 8d973a7ac836440d81273a3a0901e849: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 09:19:00.406412 28073 tablet.cc:2369] T 83f2f8536d7b4505bf0ec251e967fb39 P 9f0a081f13ec454e9f73d3c924b5b532: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:19:00.410006 28097 raft_consensus.cc:482] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:19:00.410315 28097 raft_consensus.cc:504] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f77142000ec42f5beefb6277cc750c9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35047 } } peers { permanent_uuid: "8d973a7ac836440d81273a3a0901e849" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 45649 } } peers { permanent_uuid: "9f0a081f13ec454e9f73d3c924b5b532" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 42347 } }
I20260806 09:19:00.412370 28097 leader_election.cc:288] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8d973a7ac836440d81273a3a0901e849 (127.10.255.66:45649), 9f0a081f13ec454e9f73d3c924b5b532 (127.10.255.67:42347)
I20260806 09:19:00.420562 28086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:00.412858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:43543 (local address 127.10.255.66:45649)
0806 09:19:00.413115 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:00.413122 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:00.414199 (+ 1077us) server_negotiation.cc:407] Connection header received
0806 09:19:00.414393 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:00.414397 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:00.414461 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:00.414581 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:00.415275 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.416067 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.418128 (+ 2061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.419399 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.419591 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:00.419675 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:00.420105 (+ 430us) server_negotiation.cc:299] Negotiation successful
0806 09:19:00.420263 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260806 09:19:00.420634 28100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:00.413049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:45649 (local address 127.10.255.65:43543)
0806 09:19:00.414034 (+ 985us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:00.414073 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:00.414252 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:00.414628 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:00.414632 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:00.414662 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:00.415059 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:00.415067 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.416215 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.416221 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:00.417880 (+ 1659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:00.417898 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.419649 (+ 1751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.419657 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:00.419893 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:00.419940 (+ 47us) client_negotiation.cc:769] Sending connection context
0806 09:19:00.420048 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 09:19:00.420213 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":871,"mutex_wait_us":44,"spinlock_wait_cycles":20864,"thread_start_us":545,"threads_started":1}
I20260806 09:19:00.420934 28088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:00.413015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:58777 (local address 127.10.255.67:42347)
0806 09:19:00.413250 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:00.413258 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:00.414108 (+ 850us) server_negotiation.cc:407] Connection header received
0806 09:19:00.414325 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:00.414332 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:00.414413 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:00.414494 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:00.415195 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.416063 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.418688 (+ 2625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.419787 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.419992 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:00.420081 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:00.420518 (+ 437us) server_negotiation.cc:299] Negotiation successful
0806 09:19:00.420683 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 09:19:00.421629 28099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:00.413015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:42347 (local address 127.10.255.65:58777)
0806 09:19:00.413974 (+ 959us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:00.413991 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:00.414138 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:00.414555 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:00.414564 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:00.414590 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:00.415030 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:00.415044 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.416225 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.416230 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:00.418478 (+ 2248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:00.418496 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.420113 (+ 1617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.420121 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:00.420297 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:00.420335 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 09:19:00.420472 (+ 137us) client_negotiation.cc:240] Negotiation successful
0806 09:19:00.420637 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":818,"mutex_wait_us":17,"thread_start_us":560,"threads_started":1}
I20260806 09:19:00.421936 27893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83f2f8536d7b4505bf0ec251e967fb39" candidate_uuid: "6f77142000ec42f5beefb6277cc750c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d973a7ac836440d81273a3a0901e849" is_pre_election: true
I20260806 09:19:00.422537 27893 raft_consensus.cc:2454] T 83f2f8536d7b4505bf0ec251e967fb39 P 8d973a7ac836440d81273a3a0901e849 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f77142000ec42f5beefb6277cc750c9 in term 0.
I20260806 09:19:00.422731 28026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83f2f8536d7b4505bf0ec251e967fb39" candidate_uuid: "6f77142000ec42f5beefb6277cc750c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0a081f13ec454e9f73d3c924b5b532" is_pre_election: true
I20260806 09:19:00.423384 28026 raft_consensus.cc:2454] T 83f2f8536d7b4505bf0ec251e967fb39 P 9f0a081f13ec454e9f73d3c924b5b532 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f77142000ec42f5beefb6277cc750c9 in term 0.
I20260806 09:19:00.423434 27694 leader_election.cc:302] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f77142000ec42f5beefb6277cc750c9, 8d973a7ac836440d81273a3a0901e849; no voters:
I20260806 09:19:00.424007 28097 raft_consensus.cc:2781] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:19:00.424180 28097 raft_consensus.cc:482] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:19:00.424312 28097 raft_consensus.cc:3037] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:19:00.426749 28097 raft_consensus.cc:504] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f77142000ec42f5beefb6277cc750c9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35047 } } peers { permanent_uuid: "8d973a7ac836440d81273a3a0901e849" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 45649 } } peers { permanent_uuid: "9f0a081f13ec454e9f73d3c924b5b532" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 42347 } }
I20260806 09:19:00.427521 28097 leader_election.cc:288] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9 [CANDIDATE]: Term 1 election: Requested vote from peers 8d973a7ac836440d81273a3a0901e849 (127.10.255.66:45649), 9f0a081f13ec454e9f73d3c924b5b532 (127.10.255.67:42347)
I20260806 09:19:00.428195 27893 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83f2f8536d7b4505bf0ec251e967fb39" candidate_uuid: "6f77142000ec42f5beefb6277cc750c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8d973a7ac836440d81273a3a0901e849"
I20260806 09:19:00.428402 27893 raft_consensus.cc:3037] T 83f2f8536d7b4505bf0ec251e967fb39 P 8d973a7ac836440d81273a3a0901e849 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:19:00.428308 28026 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83f2f8536d7b4505bf0ec251e967fb39" candidate_uuid: "6f77142000ec42f5beefb6277cc750c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0a081f13ec454e9f73d3c924b5b532"
I20260806 09:19:00.428759 28026 raft_consensus.cc:3037] T 83f2f8536d7b4505bf0ec251e967fb39 P 9f0a081f13ec454e9f73d3c924b5b532 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:19:00.430892 27893 raft_consensus.cc:2454] T 83f2f8536d7b4505bf0ec251e967fb39 P 8d973a7ac836440d81273a3a0901e849 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f77142000ec42f5beefb6277cc750c9 in term 1.
I20260806 09:19:00.431288 28026 raft_consensus.cc:2454] T 83f2f8536d7b4505bf0ec251e967fb39 P 9f0a081f13ec454e9f73d3c924b5b532 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f77142000ec42f5beefb6277cc750c9 in term 1.
I20260806 09:19:00.431507 27694 leader_election.cc:302] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f77142000ec42f5beefb6277cc750c9, 8d973a7ac836440d81273a3a0901e849; no voters:
I20260806 09:19:00.431979 28097 raft_consensus.cc:2781] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:19:00.432534 28097 raft_consensus.cc:686] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9 [term 1 LEADER]: Becoming Leader. State: Replica: 6f77142000ec42f5beefb6277cc750c9, State: Running, Role: LEADER
I20260806 09:19:00.433144 28097 consensus_queue.cc:237] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f77142000ec42f5beefb6277cc750c9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35047 } } peers { permanent_uuid: "8d973a7ac836440d81273a3a0901e849" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 45649 } } peers { permanent_uuid: "9f0a081f13ec454e9f73d3c924b5b532" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 42347 } }
I20260806 09:19:00.438357 27612 catalog_manager.cc:5495] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f77142000ec42f5beefb6277cc750c9 (127.10.255.65). New cstate: current_term: 1 leader_uuid: "6f77142000ec42f5beefb6277cc750c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f77142000ec42f5beefb6277cc750c9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35047 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8d973a7ac836440d81273a3a0901e849" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 45649 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f0a081f13ec454e9f73d3c924b5b532" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 42347 } health_report { overall_health: UNKNOWN } } }
I20260806 09:19:00.471458 28083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:00.465650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48436 (local address 127.10.255.65:35047)
0806 09:19:00.465882 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:00.465888 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:00.466005 (+ 117us) server_negotiation.cc:407] Connection header received
0806 09:19:00.466289 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:00.466294 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:00.466380 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:00.466553 (+ 173us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:19:00.466946 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.467731 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.469143 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.469558 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.469703 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:00.470285 (+ 582us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:19:00.470820 (+ 535us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:19:00.470994 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:00.471082 (+ 88us) server_negotiation.cc:299] Negotiation successful
0806 09:19:00.471179 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 09:19:00.480716 28026 raft_consensus.cc:1261] T 83f2f8536d7b4505bf0ec251e967fb39 P 9f0a081f13ec454e9f73d3c924b5b532 [term 1 FOLLOWER]: Refusing update from remote peer 6f77142000ec42f5beefb6277cc750c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:19:00.480743 27893 raft_consensus.cc:1261] T 83f2f8536d7b4505bf0ec251e967fb39 P 8d973a7ac836440d81273a3a0901e849 [term 1 FOLLOWER]: Refusing update from remote peer 6f77142000ec42f5beefb6277cc750c9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:19:00.481829 28101 consensus_queue.cc:1035] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8d973a7ac836440d81273a3a0901e849" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 45649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:19:00.482292 28097 consensus_queue.cc:1035] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f0a081f13ec454e9f73d3c924b5b532" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 42347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:19:00.499631 28105 mvcc.cc:205] Tried to move back new op lower bound from 7315488524197711872 to 7315488524018823168. Current Snapshot: MvccSnapshot[applied={T|T < 7315488524197711872}]
I20260806 09:19:00.500046 28104 mvcc.cc:205] Tried to move back new op lower bound from 7315488524197711872 to 7315488524018823168. Current Snapshot: MvccSnapshot[applied={T|T < 7315488524197711872}]
I20260806 09:19:00.529289 27612 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39844:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:19:00.529645 27612 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39844:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:19:00.533615 27612 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0: Sending DeleteTablet for 3 replicas of tablet 83f2f8536d7b4505bf0ec251e967fb39
I20260806 09:19:00.535076 28006 tablet_service.cc:1514] Processing DeleteTablet for tablet 83f2f8536d7b4505bf0ec251e967fb39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:19:00 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:53556
I20260806 09:19:00.535072 27740 tablet_service.cc:1514] Processing DeleteTablet for tablet 83f2f8536d7b4505bf0ec251e967fb39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:19:00 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:48434
I20260806 09:19:00.535151 27873 tablet_service.cc:1514] Processing DeleteTablet for tablet 83f2f8536d7b4505bf0ec251e967fb39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:19:00 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:60436
I20260806 09:19:00.536682 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 27652
I20260806 09:19:00.541028 28116 tablet_replica.cc:330] T 83f2f8536d7b4505bf0ec251e967fb39 P 8d973a7ac836440d81273a3a0901e849: stopping tablet replica
I20260806 09:19:00.541224 28114 tablet_replica.cc:330] T 83f2f8536d7b4505bf0ec251e967fb39 P 9f0a081f13ec454e9f73d3c924b5b532: stopping tablet replica
I20260806 09:19:00.541787 28114 raft_consensus.cc:2229] T 83f2f8536d7b4505bf0ec251e967fb39 P 9f0a081f13ec454e9f73d3c924b5b532 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:19:00.542423 28114 raft_consensus.cc:2258] T 83f2f8536d7b4505bf0ec251e967fb39 P 9f0a081f13ec454e9f73d3c924b5b532 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:19:00.542411 28116 raft_consensus.cc:2229] T 83f2f8536d7b4505bf0ec251e967fb39 P 8d973a7ac836440d81273a3a0901e849 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:19:00.544132 28116 raft_consensus.cc:2258] T 83f2f8536d7b4505bf0ec251e967fb39 P 8d973a7ac836440d81273a3a0901e849 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:19:00.544238 28115 tablet_replica.cc:330] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9: stopping tablet replica
I20260806 09:19:00.544754 28115 raft_consensus.cc:2229] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9 [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:19:00.545054 28114 ts_tablet_manager.cc:1905] T 83f2f8536d7b4505bf0ec251e967fb39 P 9f0a081f13ec454e9f73d3c924b5b532: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:19:00.545545 28115 raft_consensus.cc:2258] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:19:00.548146 28115 ts_tablet_manager.cc:1905] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:19:00.550755 28116 ts_tablet_manager.cc:1905] T 83f2f8536d7b4505bf0ec251e967fb39 P 8d973a7ac836440d81273a3a0901e849: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:19:00.553571 28114 ts_tablet_manager.cc:1918] T 83f2f8536d7b4505bf0ec251e967fb39 P 9f0a081f13ec454e9f73d3c924b5b532: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:19:00.553870 28114 log.cc:1196] T 83f2f8536d7b4505bf0ec251e967fb39 P 9f0a081f13ec454e9f73d3c924b5b532: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/83f2f8536d7b4505bf0ec251e967fb39
I20260806 09:19:00.554538 28114 ts_tablet_manager.cc:1939] T 83f2f8536d7b4505bf0ec251e967fb39 P 9f0a081f13ec454e9f73d3c924b5b532: Deleting consensus metadata
I20260806 09:19:00.557261 27597 catalog_manager.cc:4841] TS 9f0a081f13ec454e9f73d3c924b5b532 (127.10.255.67:42347): tablet 83f2f8536d7b4505bf0ec251e967fb39 (table test-table [id=afc59d2af059457989a742b053dd1fb5]) successfully deleted
I20260806 09:19:00.558321 28115 ts_tablet_manager.cc:1918] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:19:00.558621 28115 log.cc:1196] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/wal/wals/83f2f8536d7b4505bf0ec251e967fb39
I20260806 09:19:00.559283 28115 ts_tablet_manager.cc:1939] T 83f2f8536d7b4505bf0ec251e967fb39 P 6f77142000ec42f5beefb6277cc750c9: Deleting consensus metadata
I20260806 09:19:00.560178 28116 ts_tablet_manager.cc:1918] T 83f2f8536d7b4505bf0ec251e967fb39 P 8d973a7ac836440d81273a3a0901e849: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:19:00.560443 28116 log.cc:1196] T 83f2f8536d7b4505bf0ec251e967fb39 P 8d973a7ac836440d81273a3a0901e849: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/83f2f8536d7b4505bf0ec251e967fb39
I20260806 09:19:00.561554 28116 ts_tablet_manager.cc:1939] T 83f2f8536d7b4505bf0ec251e967fb39 P 8d973a7ac836440d81273a3a0901e849: Deleting consensus metadata
I20260806 09:19:00.561537 27599 catalog_manager.cc:4841] TS 6f77142000ec42f5beefb6277cc750c9 (127.10.255.65:35047): tablet 83f2f8536d7b4505bf0ec251e967fb39 (table test-table [id=afc59d2af059457989a742b053dd1fb5]) successfully deleted
I20260806 09:19:00.563791 28083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:00.538811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48444 (local address 127.10.255.65:35047)
0806 09:19:00.539076 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:00.539085 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:00.539122 (+ 37us) server_negotiation.cc:407] Connection header received
0806 09:19:00.539211 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:00.539220 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:00.539326 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:00.539454 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:00.543579 (+ 4125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.544827 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.546918 (+ 2091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.547824 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.547986 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:00.553118 (+ 5132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:00.553135 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:00.553156 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:00.553219 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:00.558191 (+ 4972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:00.559468 (+ 1277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:00.559483 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:00.559489 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:00.559703 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:00.560299 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:00.560305 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:00.560308 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:00.560857 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:00.562849 (+ 1992us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:00.562997 (+ 148us) server_negotiation.cc:299] Negotiation successful
0806 09:19:00.563350 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260806 09:19:00.563699 27600 catalog_manager.cc:4841] TS 8d973a7ac836440d81273a3a0901e849 (127.10.255.66:45649): tablet 83f2f8536d7b4505bf0ec251e967fb39 (table test-table [id=afc59d2af059457989a742b053dd1fb5]) successfully deleted
I20260806 09:19:00.565317 27801 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:00.672196 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 27652
I20260806 09:19:00.694031 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 27810
I20260806 09:19:00.712347 28086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:00.695091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60452 (local address 127.10.255.66:45649)
0806 09:19:00.695316 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:00.695324 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:00.695344 (+ 20us) server_negotiation.cc:407] Connection header received
0806 09:19:00.695438 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:00.695442 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:00.695513 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:00.695631 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:00.697235 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.698103 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.699626 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.700195 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.700351 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:00.703712 (+ 3361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:00.703734 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:00.703751 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:00.703800 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:00.708174 (+ 4374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:00.709212 (+ 1038us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:00.709222 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:00.709225 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:00.709395 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:00.710197 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:00.710204 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:00.710208 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:00.710726 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:00.711077 (+ 351us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:00.711467 (+ 390us) server_negotiation.cc:299] Negotiation successful
0806 09:19:00.711737 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 09:19:00.713557 27934 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:00.809607 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 27810
I20260806 09:19:00.829881 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 27943
I20260806 09:19:00.845252 28088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:00.830863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53562 (local address 127.10.255.67:42347)
0806 09:19:00.831072 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:00.831078 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:00.831133 (+ 55us) server_negotiation.cc:407] Connection header received
0806 09:19:00.831309 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:00.831318 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:00.831413 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:00.831551 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:00.833111 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.833855 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.835246 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:00.835665 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:00.835994 (+ 329us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:00.838798 (+ 2804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:00.838817 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:00.838835 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:00.838875 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:00.841912 (+ 3037us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:00.842828 (+ 916us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:00.842836 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:00.842839 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:00.843003 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:00.843415 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:00.843420 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:00.843430 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:00.843824 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:00.844209 (+ 385us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:00.844593 (+ 384us) server_negotiation.cc:299] Negotiation successful
0806 09:19:00.844860 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 09:19:00.846091 28067 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:00.942077 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 27943
I20260806 09:19:00.962155 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 27580
I20260806 09:19:00.963554 27645 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:01.087523 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 27580
I20260806 09:19:21.113122 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:32837
--webserver_interface=127.10.255.126
--webserver_port=43077
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:39373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:32837
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:19:21.490804 28121 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:19:21.491277 28121 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:19:21.491456 28121 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:19:21.500005 28121 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 09:19:21.500159 28121 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 09:19:21.500255 28121 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 09:19:21.500341 28121 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:19:21.500449 28121 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:19:21.500572 28121 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:19:21.500661 28121 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:19:21.500741 28121 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:19:21.511509 28121 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:39373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:32837
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:32837
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=43077
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:21.513015 28121 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:21.514508 28121 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:19:21.528751 28126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:21.528848 28127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:21.528800 28129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:21.529181 28121 server_base.cc:1034] running on GCE node
I20260806 09:19:21.530493 28121 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:21.532435 28121 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:21.533908 28121 hybrid_clock.cc:648] HybridClock initialized: now 1786007961533817 us; error 63 us; skew 500 ppm
I20260806 09:19:21.534384 28121 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:19:21 dist-test-slave-mvvj krb5kdc[27017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007961, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:19:21.542611 28121 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:19:21.544524 28121 webserver.cc:460] Webserver started at http://127.10.255.126:43077/ using document root <none> and password file <none>
I20260806 09:19:21.545339 28121 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:21.545442 28121 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:21.551946 28121 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.007s sys 0.000s
I20260806 09:19:21.555182 28136 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:21.556883 28121 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 09:19:21.557094 28121 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "54addc5e405f4d1eb2d4d8dd79121ee0"
format_stamp: "Formatted at 2026-08-06 09:18:35 on dist-test-slave-mvvj"
server_key: "0dcbfc8e9addc76f0012b478c0439160"
server_key_iv: "cdbd53fc2a5400b39bbb80ba89ef4ac3"
server_key_version: "encryptionkey@0"
I20260806 09:19:21.558164 28121 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:21.582172 28121 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:21.587370 28121 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:21.587715 28121 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:21.608989 28121 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:32837
I20260806 09:19:21.609097 28188 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:32837 every 8 connection(s)
I20260806 09:19:21.610657 28121 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:19:21.613245 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 28121
I20260806 09:19:21.614118 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:35047
--local_ip_for_outbound_sockets=127.10.255.65
--tserver_master_addrs=127.10.255.126:32837
--webserver_port=40897
--webserver_interface=127.10.255.65
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:39373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:19:21.618273 28189 sys_catalog.cc:263] Verifying existing consensus state
I20260806 09:19:21.621964 28189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0: Bootstrap starting.
I20260806 09:19:21.653906 28189 log.cc:824] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0: Log is configured to *not* fsync() on all Append() calls
I20260806 09:19:21.678239 28189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 09:19:21.679152 28189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0: Bootstrap complete.
I20260806 09:19:21.691608 28189 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54addc5e405f4d1eb2d4d8dd79121ee0" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 32837 } }
I20260806 09:19:21.692850 28189 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54addc5e405f4d1eb2d4d8dd79121ee0, State: Initialized, Role: FOLLOWER
I20260806 09:19:21.693629 28189 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54addc5e405f4d1eb2d4d8dd79121ee0" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 32837 } }
I20260806 09:19:21.693940 28189 raft_consensus.cc:388] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:19:21.694103 28189 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:19:21.694316 28189 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 2 FOLLOWER]: Advancing to term 3
I20260806 09:19:21.699275 28189 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54addc5e405f4d1eb2d4d8dd79121ee0" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 32837 } }
I20260806 09:19:21.699977 28189 leader_election.cc:302] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 54addc5e405f4d1eb2d4d8dd79121ee0; no voters:
I20260806 09:19:21.700728 28189 leader_election.cc:288] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 09:19:21.700971 28193 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 3 FOLLOWER]: Leader election won for term 3
I20260806 09:19:21.702343 28193 raft_consensus.cc:686] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [term 3 LEADER]: Becoming Leader. State: Replica: 54addc5e405f4d1eb2d4d8dd79121ee0, State: Running, Role: LEADER
I20260806 09:19:21.703079 28193 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54addc5e405f4d1eb2d4d8dd79121ee0" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 32837 } }
I20260806 09:19:21.703233 28189 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:19:21.706197 28195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54addc5e405f4d1eb2d4d8dd79121ee0. Latest consensus state: current_term: 3 leader_uuid: "54addc5e405f4d1eb2d4d8dd79121ee0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54addc5e405f4d1eb2d4d8dd79121ee0" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 32837 } } }
I20260806 09:19:21.706784 28195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [sys.catalog]: This master's current role is: LEADER
I20260806 09:19:21.707587 28194 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "54addc5e405f4d1eb2d4d8dd79121ee0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54addc5e405f4d1eb2d4d8dd79121ee0" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 32837 } } }
I20260806 09:19:21.708093 28194 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0 [sys.catalog]: This master's current role is: LEADER
I20260806 09:19:21.718217 28201 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:19:21.730610 28201 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:19:21.735078 28201 catalog_manager.cc:1259] Loaded cluster ID: 9f3a2c687f4445dcbfcaa13d31feefb3
I20260806 09:19:21.735392 28201 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:19:21.743067 28201 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:19:21.746174 28201 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0: Loaded TSK: 0
I20260806 09:19:21.746604 28201 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 54addc5e405f4d1eb2d4d8dd79121ee0: Loaded TSK: 1
F20260806 09:19:21.748420 28201 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
I20260806 09:19:21.748466 28212 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
@ 0x7f90b6f7e9ad google::LogMessage::Fail() at ??:0
@ 0x7f90b6f8188a google::LogMessage::SendToLog() at ??:0
@ 0x7f90b6f7e4de google::LogMessage::Flush() at ??:0
@ 0x7f90b6f7fa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f90bace27d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f90bacd173e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f90cc9b11c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f90cc9b0783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f90cca3c2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7f90cca3c0c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7f90cca865e9 std::function<>::operator()() at ??:0
@ 0x7f90cc9b4cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f90cc9b2c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f90cca3a610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f90cca3a439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f90b9bca345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f90b9bcd91c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f90b9bcd799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f90b9ba8eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f90bce826db start_thread at ??:0
@ 0x7f90b5e1861f clone at ??:0
W20260806 09:19:22.062455 28191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:19:22.062852 28191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:19:22.063028 28191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:19:22.070941 28191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:19:22.071154 28191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:19:22.071349 28191 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:19:22.082762 28191 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:39373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:35047
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=40897
--tserver_master_addrs=127.10.255.126:32837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:22.084333 28191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:22.085763 28191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:19:22.100696 28241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:22.100785 28238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:22.100759 28239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:22.102449 28191 server_base.cc:1034] running on GCE node
I20260806 09:19:22.103235 28191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:22.104421 28191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:22.105702 28191 hybrid_clock.cc:648] HybridClock initialized: now 1786007962105654 us; error 41 us; skew 500 ppm
I20260806 09:19:22.106065 28191 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:19:22 dist-test-slave-mvvj krb5kdc[27017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007962, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:19:22.109757 28191 init.cc:377] Logged in from keytab as kudu/127.10.255.65@KRBTEST.COM (short username kudu)
I20260806 09:19:22.111431 28191 webserver.cc:460] Webserver started at http://127.10.255.65:40897/ using document root <none> and password file <none>
I20260806 09:19:22.112236 28191 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:22.112352 28191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:22.118286 28191 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260806 09:19:22.121454 28248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:22.123219 28191 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 09:19:22.123418 28191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "6f77142000ec42f5beefb6277cc750c9"
format_stamp: "Formatted at 2026-08-06 09:18:35 on dist-test-slave-mvvj"
server_key: "82232122e55ae6d44d77bd5c3a99a6c2"
server_key_iv: "c5cbc7b027ea347e20adb2617722fd59"
server_key_version: "encryptionkey@0"
I20260806 09:19:22.124651 28191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:22.144807 28191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:22.150220 28191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:22.150513 28191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:22.151681 28191 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:19:22.153380 28191 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:19:22.153501 28191 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:22.153586 28191 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:19:22.153658 28191 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:22.192495 28191 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:35047
I20260806 09:19:22.192610 28361 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:35047 every 8 connection(s)
I20260806 09:19:22.194219 28191 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:19:22.199307 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 28191
I20260806 09:19:22.200277 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:45649
--local_ip_for_outbound_sockets=127.10.255.66
--tserver_master_addrs=127.10.255.126:32837
--webserver_port=37343
--webserver_interface=127.10.255.66
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:39373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:19:22.200762 28364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:22.197879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.65:54957)
0806 09:19:22.198912 (+ 1033us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:22.199308 (+ 396us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":635,"thread_start_us":360,"threads_started":1}
W20260806 09:19:22.201630 28362 heartbeater.cc:644] Failed to heartbeat to 127.10.255.126:32837 (0 consecutive failures): Network error: Failed to ping master at 127.10.255.126:32837: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
I20260806 09:19:22.202912 28364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:22.202279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.65:58649)
0806 09:19:22.202521 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:22.202729 (+ 208us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260806 09:19:22.204254 28364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:22.203692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.65:41527)
0806 09:19:22.203938 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:22.204060 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260806 09:19:22.204618 28362 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 09:19:22.559767 28365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:19:22.560184 28365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:19:22.560389 28365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:19:22.568039 28365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:19:22.568163 28365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:19:22.568346 28365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:19:22.578943 28365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:39373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:45649
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=37343
--tserver_master_addrs=127.10.255.126:32837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:22.580451 28365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:22.581908 28365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:19:22.597105 28371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:22.597196 28370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:22.597143 28373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:22.598887 28365 server_base.cc:1034] running on GCE node
I20260806 09:19:22.599646 28365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:22.600838 28365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:22.602064 28365 hybrid_clock.cc:648] HybridClock initialized: now 1786007962602012 us; error 42 us; skew 500 ppm
I20260806 09:19:22.602428 28365 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:19:22 dist-test-slave-mvvj krb5kdc[27017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007962, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:19:22.605947 28365 init.cc:377] Logged in from keytab as kudu/127.10.255.66@KRBTEST.COM (short username kudu)
I20260806 09:19:22.607786 28365 webserver.cc:460] Webserver started at http://127.10.255.66:37343/ using document root <none> and password file <none>
I20260806 09:19:22.608639 28365 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:22.608803 28365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:22.614751 28365 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260806 09:19:22.618000 28380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:22.619763 28365 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260806 09:19:22.620046 28365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "8d973a7ac836440d81273a3a0901e849"
format_stamp: "Formatted at 2026-08-06 09:18:36 on dist-test-slave-mvvj"
server_key: "2f019c8e919db77081b2ed6508b88975"
server_key_iv: "25de4a7120356eabc8307b0db7afb7d0"
server_key_version: "encryptionkey@0"
I20260806 09:19:22.621263 28365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:22.643210 28365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:22.648607 28365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:22.648929 28365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:22.649986 28365 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:19:22.651432 28365 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:19:22.651561 28365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:22.651700 28365 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:19:22.651782 28365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:22.694228 28365 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:45649
I20260806 09:19:22.694484 28496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:45649 every 8 connection(s)
I20260806 09:19:22.696079 28365 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:19:22.700150 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 28365
I20260806 09:19:22.700973 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:42347
--local_ip_for_outbound_sockets=127.10.255.67
--tserver_master_addrs=127.10.255.126:32837
--webserver_port=42367
--webserver_interface=127.10.255.67
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:39373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:19:22.702294 28499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:22.699597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.66:59815)
0806 09:19:22.700640 (+ 1043us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:22.700985 (+ 345us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":663,"thread_start_us":425,"threads_started":1}
W20260806 09:19:22.703140 28497 heartbeater.cc:644] Failed to heartbeat to 127.10.255.126:32837 (0 consecutive failures): Network error: Failed to ping master at 127.10.255.126:32837: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
I20260806 09:19:22.704484 28499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:22.703959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.66:34999)
0806 09:19:22.704190 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:22.704309 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260806 09:19:22.706238 28500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:22.705155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.66:53855)
0806 09:19:22.705805 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:22.705972 (+ 167us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":278,"threads_started":1}
W20260806 09:19:22.706652 28497 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 09:19:23.076890 28501 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:19:23.077229 28501 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:19:23.077329 28501 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:19:23.084931 28501 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:19:23.085069 28501 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:19:23.085189 28501 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:19:23.095502 28501 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:39373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:42347
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=42367
--tserver_master_addrs=127.10.255.126:32837
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:23.097118 28501 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:23.098582 28501 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:19:23.113495 28506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:23.113456 28509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:23.113525 28507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:23.114353 28501 server_base.cc:1034] running on GCE node
I20260806 09:19:23.115051 28501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:23.116154 28501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:23.117595 28501 hybrid_clock.cc:648] HybridClock initialized: now 1786007963117530 us; error 38 us; skew 500 ppm
I20260806 09:19:23.118068 28501 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:19:23 dist-test-slave-mvvj krb5kdc[27017](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007963, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:19:23.122260 28501 init.cc:377] Logged in from keytab as kudu/127.10.255.67@KRBTEST.COM (short username kudu)
I20260806 09:19:23.124261 28501 webserver.cc:460] Webserver started at http://127.10.255.67:42367/ using document root <none> and password file <none>
I20260806 09:19:23.125077 28501 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:23.125221 28501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:23.131768 28501 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.006s
I20260806 09:19:23.135273 28516 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:23.137202 28501 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260806 09:19:23.137400 28501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "9f0a081f13ec454e9f73d3c924b5b532"
format_stamp: "Formatted at 2026-08-06 09:18:36 on dist-test-slave-mvvj"
server_key: "5aa34323f5151a8f6b1da3c831bbc402"
server_key_iv: "71401f6bcbd676f30ab630807fa4b6d5"
server_key_version: "encryptionkey@0"
I20260806 09:19:23.138567 28501 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:23.166766 28501 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:23.171561 28501 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:23.171864 28501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:23.173125 28501 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:19:23.175001 28501 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:19:23.175118 28501 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:23.175208 28501 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:19:23.175277 28501 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:23.206367 28602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:23.205412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.65:44629)
0806 09:19:23.206001 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:23.206125 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":303,"threads_started":1}
I20260806 09:19:23.217065 28501 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:42347
I20260806 09:19:23.217178 28631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:42347 every 8 connection(s)
I20260806 09:19:23.218796 28501 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:19:23.224413 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 28501
I20260806 09:19:23.225078 28634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:23.222474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.67:35001)
0806 09:19:23.223320 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:23.223643 (+ 323us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":322,"threads_started":1}
W20260806 09:19:23.226132 28632 heartbeater.cc:644] Failed to heartbeat to 127.10.255.126:32837 (0 consecutive failures): Network error: Failed to ping master at 127.10.255.126:32837: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
I20260806 09:19:23.227242 28634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:23.226877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.67:58481)
0806 09:19:23.227048 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:23.227124 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260806 09:19:23.228332 28634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:23.227919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.67:58153)
0806 09:19:23.228113 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:23.228202 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260806 09:19:23.228657 28632 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 09:19:23.708461 28636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:23.707393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.66:54467)
0806 09:19:23.708096 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:23.708211 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":364,"threads_started":1}
I20260806 09:19:24.208500 28637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:24.207540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.65:33009)
0806 09:19:24.208176 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:24.208270 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":382,"threads_started":1}
I20260806 09:19:24.230378 28638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:24.229424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.67:35493)
0806 09:19:24.230040 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:24.230136 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":488,"thread_start_us":355,"threads_started":1}
I20260806 09:19:24.710630 28639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:24.709777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.66:58783)
0806 09:19:24.710286 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:24.710439 (+ 153us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":293,"threads_started":1}
I20260806 09:19:25.210615 28640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:25.209733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.65:36597)
0806 09:19:25.210320 (+ 587us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:25.210428 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":329,"threads_started":1}
I20260806 09:19:25.232290 28641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:25.231377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.67:39955)
0806 09:19:25.231997 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:25.232102 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":342,"threads_started":1}
I20260806 09:19:25.712833 28642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:25.711801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.66:53061)
0806 09:19:25.712440 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:25.712596 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":329,"threads_started":1}
I20260806 09:19:26.212754 28643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:26.211757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.65:58187)
0806 09:19:26.212395 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:26.212552 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":359,"threads_started":1}
I20260806 09:19:26.234081 28644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:26.233303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.67:35989)
0806 09:19:26.233782 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:26.233873 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":255,"threads_started":1}
I20260806 09:19:26.714828 28645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:26.714045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.66:46359)
0806 09:19:26.714549 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:26.714661 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":253,"threads_started":1}
I20260806 09:19:27.214823 28646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:27.213930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.65:48893)
0806 09:19:27.214542 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:27.214639 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":284,"threads_started":1}
I20260806 09:19:27.236137 28647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:27.235217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.67:46965)
0806 09:19:27.235794 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:27.235954 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":322,"threads_started":1}
I20260806 09:19:27.717077 28648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:27.716199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.66:59005)
0806 09:19:27.716777 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:27.716871 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":314,"threads_started":1}
I20260806 09:19:28.216930 28649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:28.216058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.65:44063)
0806 09:19:28.216611 (+ 553us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:28.216730 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":285,"threads_started":1}
I20260806 09:19:28.238065 28650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:28.237245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.67:46439)
0806 09:19:28.237786 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:28.237876 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":283,"threads_started":1}
I20260806 09:19:28.719249 28651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:28.718309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.66:40299)
0806 09:19:28.718966 (+ 657us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:28.719071 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":318,"threads_started":1}
I20260806 09:19:29.219214 28652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:29.218033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.65:47037)
0806 09:19:29.218829 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:29.218940 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":657,"thread_start_us":441,"threads_started":1}
I20260806 09:19:29.240188 28653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:29.239260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.67:59555)
0806 09:19:29.239795 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:29.239999 (+ 204us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":267,"threads_started":1}
I20260806 09:19:29.721596 28654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:29.720610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.66:50267)
0806 09:19:29.721270 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:29.721356 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":338,"threads_started":1}
I20260806 09:19:30.221083 28655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:30.220342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.65:38373)
0806 09:19:30.220827 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:30.220919 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":236,"threads_started":1}
I20260806 09:19:30.242269 28656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:30.241227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.67:36589)
0806 09:19:30.241892 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:30.242002 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":282,"threads_started":1}
I20260806 09:19:30.723677 28657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:30.722667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.66:60589)
0806 09:19:30.723177 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:30.723279 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":253,"threads_started":1}
I20260806 09:19:31.223272 28658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:31.222260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.65:35113)
0806 09:19:31.222938 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:31.223037 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":342,"threads_started":1}
I20260806 09:19:31.244362 28659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:31.243362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.67:58763)
0806 09:19:31.244095 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:31.244194 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":535,"threads_started":1}
I20260806 09:19:31.725785 28660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:31.724828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.66:54719)
0806 09:19:31.725412 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:31.725527 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":254,"threads_started":1}
I20260806 09:19:32.225593 28661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:32.224559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.65:48871)
0806 09:19:32.225261 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:32.225360 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":410,"threads_started":1}
I20260806 09:19:32.246431 28662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:32.245509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.67:57175)
0806 09:19:32.246098 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:32.246231 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":293,"threads_started":1}
I20260806 09:19:32.727856 28663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:32.727020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.66:54069)
0806 09:19:32.727539 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:32.727640 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":258,"threads_started":1}
I20260806 09:19:33.227550 28664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:33.226723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.65:53647)
0806 09:19:33.227265 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:33.227358 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":293,"threads_started":1}
I20260806 09:19:33.248505 28665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:33.247649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.67:42009)
0806 09:19:33.248233 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:33.248338 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":344,"threads_started":1}
I20260806 09:19:33.730542 28666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:33.729290 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.66:35447)
0806 09:19:33.730050 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:33.730253 (+ 203us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":617,"thread_start_us":377,"threads_started":1}
I20260806 09:19:34.229425 28667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:34.228641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.65:43819)
0806 09:19:34.229161 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:34.229255 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":285,"threads_started":1}
I20260806 09:19:34.250322 28668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:34.249542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.67:41799)
0806 09:19:34.250013 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:34.250139 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":231,"threads_started":1}
I20260806 09:19:34.732395 28669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:34.731592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.66:41767)
0806 09:19:34.732123 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:34.732220 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":286,"threads_started":1}
I20260806 09:19:35.231755 28670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:35.230529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.65:51667)
0806 09:19:35.231331 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:35.231472 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":644,"thread_start_us":309,"threads_started":1}
I20260806 09:19:35.252784 28671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:35.251647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.67:56821)
0806 09:19:35.252380 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:35.252518 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":384,"threads_started":1}
I20260806 09:19:35.734323 28672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:35.733460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.66:35603)
0806 09:19:35.734023 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:35.734120 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":288,"threads_started":1}
I20260806 09:19:36.233640 28673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:36.232839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.65:38027)
0806 09:19:36.233334 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:36.233444 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":260,"threads_started":1}
I20260806 09:19:36.255079 28674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:36.254068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.67:45087)
0806 09:19:36.254701 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:36.254852 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":352,"threads_started":1}
I20260806 09:19:36.736797 28675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:36.735477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.66:47807)
0806 09:19:36.736278 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:36.736402 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":628,"thread_start_us":358,"threads_started":1}
I20260806 09:19:37.235723 28676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:37.234865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.65:55141)
0806 09:19:37.235376 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:37.235531 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":265,"threads_started":1}
I20260806 09:19:37.257004 28677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:37.256211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.67:42827)
0806 09:19:37.256700 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:37.256789 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":241,"threads_started":1}
I20260806 09:19:37.739114 28678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:37.738101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.66:37269)
0806 09:19:37.738767 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:37.738891 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":288,"threads_started":1}
I20260806 09:19:38.235402 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 28191
I20260806 09:19:38.237862 28679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:38.236828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.65:45325)
0806 09:19:38.237465 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:38.237583 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":346,"threads_started":1}
I20260806 09:19:38.257247 28680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:38.237560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60320 (local address 127.10.255.65:35047)
0806 09:19:38.238461 (+ 901us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:38.238485 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:38.238546 (+ 61us) server_negotiation.cc:407] Connection header received
0806 09:19:38.240674 (+ 2128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:38.240686 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:38.241159 (+ 473us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:38.241554 (+ 395us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:38.243372 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:38.244788 (+ 1416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:38.246149 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:38.246893 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:38.247140 (+ 247us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:38.250022 (+ 2882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:38.250031 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:38.250048 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:38.250098 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:38.253361 (+ 3263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:38.254197 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:38.254204 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:38.254212 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:38.254455 (+ 243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:38.254907 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:38.254912 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:38.254915 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:38.255537 (+ 622us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:38.255920 (+ 383us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:38.256459 (+ 539us) server_negotiation.cc:299] Negotiation successful
0806 09:19:38.256934 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":626,"thread_start_us":519,"threads_started":1}
I20260806 09:19:38.259186 28681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:38.258296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:32837 (local address 127.10.255.67:38189)
0806 09:19:38.258846 (+ 550us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:38.258976 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.126:32837: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":306,"threads_started":1}
I20260806 09:19:38.259356 28357 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:38.350530 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 28191
I20260806 09:19:38.370047 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 28365
I20260806 09:19:38.392752 28683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:38.371190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39470 (local address 127.10.255.66:45649)
0806 09:19:38.371907 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:38.371922 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:38.371961 (+ 39us) server_negotiation.cc:407] Connection header received
0806 09:19:38.373637 (+ 1676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:38.373647 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:38.374116 (+ 469us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:38.374495 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:38.376709 (+ 2214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:38.378188 (+ 1479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:38.379872 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:38.380852 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:38.381126 (+ 274us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:38.384669 (+ 3543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:38.384680 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:38.384700 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:38.384755 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:38.388628 (+ 3873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:38.389603 (+ 975us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:38.389612 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:38.389621 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:38.389830 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:38.390298 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:38.390305 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:38.390313 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:38.390959 (+ 646us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:38.391303 (+ 344us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:38.391942 (+ 639us) server_negotiation.cc:299] Negotiation successful
0806 09:19:38.392434 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":368,"threads_started":1}
I20260806 09:19:38.394539 28492 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:38.484925 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 28365
I20260806 09:19:38.505221 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 28501
I20260806 09:19:38.527547 28685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:38.506536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51558 (local address 127.10.255.67:42347)
0806 09:19:38.507294 (+ 758us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:38.507309 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:38.507353 (+ 44us) server_negotiation.cc:407] Connection header received
0806 09:19:38.509152 (+ 1799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:38.509162 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:38.509694 (+ 532us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:38.510031 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:38.511620 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:38.513201 (+ 1581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:38.514799 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:38.515614 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:38.515786 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:38.519323 (+ 3537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:38.519334 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:38.519356 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:38.519415 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:38.523041 (+ 3626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:38.524170 (+ 1129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:38.524179 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:38.524186 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:38.524388 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:38.525051 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:38.525056 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:38.525058 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:38.525783 (+ 725us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:38.526067 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:38.526610 (+ 543us) server_negotiation.cc:299] Negotiation successful
0806 09:19:38.527195 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":406,"threads_started":1}
I20260806 09:19:38.529292 28627 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:38.618031 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 28501
2026-08-06T09:19:38Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (65473 ms)
[----------] 30 tests from SecurityITest (331044 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:19:38 dist-test-slave-mvvj krb5kdc[28689](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:19:38 dist-test-slave-mvvj krb5kdc[28689](info): set up 2 sockets
Aug 06 09:19:38 dist-test-slave-mvvj krb5kdc[28689](info): commencing operation
krb5kdc: starting...
W20260806 09:19:39.795084 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.000s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:19:39 dist-test-slave-mvvj krb5kdc[28689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007979, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:19:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:19:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:19:40.088888 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:44481
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:44481
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:19:40.456684 28703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:19:40.457037 28703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:19:40.457134 28703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:19:40.464726 28703 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:19:40.464857 28703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:19:40.464905 28703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:19:40.464956 28703 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:19:40.465003 28703 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:19:40.475383 28703 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:44481
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:44481
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:40.477362 28703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:40.478845 28703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:19:40.492408 28709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:40.492511 28712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:40.492465 28710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:40.492864 28703 server_base.cc:1034] running on GCE node
I20260806 09:19:40.494057 28703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:40.495553 28703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:40.496793 28703 hybrid_clock.cc:648] HybridClock initialized: now 1786007980496721 us; error 50 us; skew 500 ppm
I20260806 09:19:40.497311 28703 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:19:40 dist-test-slave-mvvj krb5kdc[28689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007980, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:19:40.505916 28703 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:19:40.507931 28703 webserver.cc:460] Webserver started at http://127.10.255.126:44813/ using document root <none> and password file <none>
I20260806 09:19:40.508740 28703 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:40.508901 28703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:40.509240 28703 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:19:40.512691 28703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "850608d35ec14c9da6af63a332b21760"
format_stamp: "Formatted at 2026-08-06 09:19:40 on dist-test-slave-mvvj"
server_key: "105a4421879ffb222d4f1da0335e17de"
server_key_iv: "39f87045317287cce1cc9ba5fbd1059a"
server_key_version: "encryptionkey@0"
I20260806 09:19:40.513579 28703 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "850608d35ec14c9da6af63a332b21760"
format_stamp: "Formatted at 2026-08-06 09:19:40 on dist-test-slave-mvvj"
server_key: "105a4421879ffb222d4f1da0335e17de"
server_key_iv: "39f87045317287cce1cc9ba5fbd1059a"
server_key_version: "encryptionkey@0"
I20260806 09:19:40.519815 28703 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260806 09:19:40.524219 28720 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:40.525869 28703 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:19:40.526104 28703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "850608d35ec14c9da6af63a332b21760"
format_stamp: "Formatted at 2026-08-06 09:19:40 on dist-test-slave-mvvj"
server_key: "105a4421879ffb222d4f1da0335e17de"
server_key_iv: "39f87045317287cce1cc9ba5fbd1059a"
server_key_version: "encryptionkey@0"
I20260806 09:19:40.526340 28703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:40.543238 28703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:40.548046 28703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:40.548398 28703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:40.570197 28703 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:44481
I20260806 09:19:40.570204 28771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:44481 every 8 connection(s)
I20260806 09:19:40.571795 28703 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:19:40.575960 28772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:19:40.579291 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 28703
I20260806 09:19:40.579515 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:19:40.580348 11261 external_mini_cluster.cc:1428] Setting key 3a706e0badb5d1080765378a19743df4
I20260806 09:19:40.589788 28772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 850608d35ec14c9da6af63a332b21760: Bootstrap starting.
I20260806 09:19:40.594134 28772 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 850608d35ec14c9da6af63a332b21760: Neither blocks nor log segments found. Creating new log.
I20260806 09:19:40.595865 28772 log.cc:824] T 00000000000000000000000000000000 P 850608d35ec14c9da6af63a332b21760: Log is configured to *not* fsync() on all Append() calls
Aug 06 09:19:40 dist-test-slave-mvvj krb5kdc[28689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007979, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:19:40.599514 28772 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 850608d35ec14c9da6af63a332b21760: No bootstrap required, opened a new log
I20260806 09:19:40.606159 28775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:40.582422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41118 (local address 127.10.255.126:44481)
0806 09:19:40.583222 (+ 800us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:40.583233 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:40.583277 (+ 44us) server_negotiation.cc:407] Connection header received
0806 09:19:40.585068 (+ 1791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:40.585093 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:40.585591 (+ 498us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:40.585948 (+ 357us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:40.587994 (+ 2046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:40.589401 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:40.591335 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:40.592183 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:40.592324 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:40.598030 (+ 5706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:40.598038 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:40.598056 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:40.598104 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:40.601494 (+ 3390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:40.602334 (+ 840us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:40.602342 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:40.602348 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:40.602537 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:40.602978 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:40.602989 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:40.602997 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:40.603606 (+ 609us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:40.604018 (+ 412us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:40.604497 (+ 479us) server_negotiation.cc:299] Negotiation successful
0806 09:19:40.605016 (+ 519us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":372,"threads_started":1}
I20260806 09:19:40.608366 28772 raft_consensus.cc:348] T 00000000000000000000000000000000 P 850608d35ec14c9da6af63a332b21760 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "850608d35ec14c9da6af63a332b21760" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 44481 } }
I20260806 09:19:40.608825 28772 raft_consensus.cc:374] T 00000000000000000000000000000000 P 850608d35ec14c9da6af63a332b21760 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:19:40.608956 28772 raft_consensus.cc:729] T 00000000000000000000000000000000 P 850608d35ec14c9da6af63a332b21760 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 850608d35ec14c9da6af63a332b21760, State: Initialized, Role: FOLLOWER
I20260806 09:19:40.609683 28772 consensus_queue.cc:260] T 00000000000000000000000000000000 P 850608d35ec14c9da6af63a332b21760 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "850608d35ec14c9da6af63a332b21760" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 44481 } }
I20260806 09:19:40.609956 28772 raft_consensus.cc:388] T 00000000000000000000000000000000 P 850608d35ec14c9da6af63a332b21760 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:19:40.610118 28772 raft_consensus.cc:482] T 00000000000000000000000000000000 P 850608d35ec14c9da6af63a332b21760 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:19:40.610303 28772 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 850608d35ec14c9da6af63a332b21760 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:19:40.613144 28772 raft_consensus.cc:504] T 00000000000000000000000000000000 P 850608d35ec14c9da6af63a332b21760 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "850608d35ec14c9da6af63a332b21760" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 44481 } }
I20260806 09:19:40.613755 28772 leader_election.cc:302] T 00000000000000000000000000000000 P 850608d35ec14c9da6af63a332b21760 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 850608d35ec14c9da6af63a332b21760; no voters:
I20260806 09:19:40.614413 28772 leader_election.cc:288] T 00000000000000000000000000000000 P 850608d35ec14c9da6af63a332b21760 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:19:40.614596 28777 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 850608d35ec14c9da6af63a332b21760 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:19:40.615378 28777 raft_consensus.cc:686] T 00000000000000000000000000000000 P 850608d35ec14c9da6af63a332b21760 [term 1 LEADER]: Becoming Leader. State: Replica: 850608d35ec14c9da6af63a332b21760, State: Running, Role: LEADER
I20260806 09:19:40.616135 28777 consensus_queue.cc:237] T 00000000000000000000000000000000 P 850608d35ec14c9da6af63a332b21760 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "850608d35ec14c9da6af63a332b21760" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 44481 } }
I20260806 09:19:40.616945 28772 sys_catalog.cc:564] T 00000000000000000000000000000000 P 850608d35ec14c9da6af63a332b21760 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:19:40.619478 28778 sys_catalog.cc:455] T 00000000000000000000000000000000 P 850608d35ec14c9da6af63a332b21760 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "850608d35ec14c9da6af63a332b21760" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "850608d35ec14c9da6af63a332b21760" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 44481 } } }
I20260806 09:19:40.620076 28778 sys_catalog.cc:458] T 00000000000000000000000000000000 P 850608d35ec14c9da6af63a332b21760 [sys.catalog]: This master's current role is: LEADER
I20260806 09:19:40.619889 28779 sys_catalog.cc:455] T 00000000000000000000000000000000 P 850608d35ec14c9da6af63a332b21760 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 850608d35ec14c9da6af63a332b21760. Latest consensus state: current_term: 1 leader_uuid: "850608d35ec14c9da6af63a332b21760" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "850608d35ec14c9da6af63a332b21760" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 44481 } } }
I20260806 09:19:40.620172 28779 sys_catalog.cc:458] T 00000000000000000000000000000000 P 850608d35ec14c9da6af63a332b21760 [sys.catalog]: This master's current role is: LEADER
I20260806 09:19:40.622794 28785 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:19:40.629019 28785 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:19:40.639712 28785 catalog_manager.cc:1347] Generated new cluster ID: 9efcaec9090f4a67aeed67bc7023c75d
I20260806 09:19:40.639889 28785 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:19:40.681675 28785 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:19:40.683805 28785 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:19:40.695528 28785 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 850608d35ec14c9da6af63a332b21760: Generated new TSK 0
I20260806 09:19:40.696771 28785 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.255.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
I20260806 09:19:40.768364 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:44481
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:19:41.135685 28798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:19:41.136053 28798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:19:41.136221 28798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:19:41.143729 28798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:19:41.143911 28798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:19:41.144100 28798 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:19:41.154305 28798 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:44481
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:41.155709 28798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:41.157208 28798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:19:41.171347 28804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:41.171429 28803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:41.171402 28806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:41.172242 28798 server_base.cc:1034] running on GCE node
I20260806 09:19:41.172901 28798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:41.173916 28798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:41.175168 28798 hybrid_clock.cc:648] HybridClock initialized: now 1786007981175113 us; error 47 us; skew 500 ppm
I20260806 09:19:41.175571 28798 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:19:41 dist-test-slave-mvvj krb5kdc[28689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007981, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:19:41.179011 28798 init.cc:377] Logged in from keytab as kudu/127.10.255.65@KRBTEST.COM (short username kudu)
I20260806 09:19:41.180675 28798 webserver.cc:460] Webserver started at http://127.10.255.65:46875/ using document root <none> and password file <none>
I20260806 09:19:41.181411 28798 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:41.181565 28798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:41.181911 28798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:19:41.185101 28798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "724b30ea943d4958bf818bbe88bbc690"
format_stamp: "Formatted at 2026-08-06 09:19:41 on dist-test-slave-mvvj"
server_key: "185a10bb0a687e8978eadcc1ed318b33"
server_key_iv: "ed926bd96d373cf3eb06fe2e7a8cffb9"
server_key_version: "encryptionkey@0"
I20260806 09:19:41.185950 28798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "724b30ea943d4958bf818bbe88bbc690"
format_stamp: "Formatted at 2026-08-06 09:19:41 on dist-test-slave-mvvj"
server_key: "185a10bb0a687e8978eadcc1ed318b33"
server_key_iv: "ed926bd96d373cf3eb06fe2e7a8cffb9"
server_key_version: "encryptionkey@0"
I20260806 09:19:41.192154 28798 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260806 09:19:41.196427 28813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:41.198056 28798 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 09:19:41.198282 28798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "724b30ea943d4958bf818bbe88bbc690"
format_stamp: "Formatted at 2026-08-06 09:19:41 on dist-test-slave-mvvj"
server_key: "185a10bb0a687e8978eadcc1ed318b33"
server_key_iv: "ed926bd96d373cf3eb06fe2e7a8cffb9"
server_key_version: "encryptionkey@0"
I20260806 09:19:41.198616 28798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:41.214702 28798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:41.219753 28798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:41.220112 28798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:41.221381 28798 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:19:41.222954 28798 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:19:41.223186 28798 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:41.223373 28798 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:19:41.223461 28798 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:41.260324 28798 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:37997
I20260806 09:19:41.260499 28927 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:37997 every 8 connection(s)
I20260806 09:19:41.261705 28798 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:19:41.268477 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 28798
I20260806 09:19:41.268750 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:19:41.269500 11261 external_mini_cluster.cc:1428] Setting key 32703a91204254a352c0f6ebc71ba119
Aug 06 09:19:41 dist-test-slave-mvvj krb5kdc[28689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007981, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:19:41.288561 28930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:41.264807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:45641 (local address 127.10.255.126:44481)
0806 09:19:41.265369 (+ 562us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:41.265375 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:41.266208 (+ 833us) server_negotiation.cc:407] Connection header received
0806 09:19:41.268503 (+ 2295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:41.268508 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:41.268622 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:41.268782 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:41.270785 (+ 2003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:41.271971 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:41.275019 (+ 3048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:41.275568 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:41.275688 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:41.280881 (+ 5193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:41.280887 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:41.280890 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:41.280932 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:41.284611 (+ 3679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:41.285632 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:41.285639 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:41.285645 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:41.285787 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:41.286294 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:41.286300 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:41.286304 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:41.286640 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:41.286870 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:41.287935 (+ 1065us) server_negotiation.cc:299] Negotiation successful
0806 09:19:41.288269 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":324,"threads_started":1}
I20260806 09:19:41.290004 28931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:41.265196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:44481 (local address 127.10.255.65:45641)
0806 09:19:41.266008 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:41.266064 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:41.268106 (+ 2042us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:41.269054 (+ 948us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:41.269097 (+ 43us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:41.269790 (+ 693us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:19:41.270551 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:41.270580 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:41.272187 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:41.272193 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:41.274781 (+ 2588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:41.274808 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:41.275900 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:41.275913 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:41.276307 (+ 394us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:41.277221 (+ 914us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:19:41.277261 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:19:41.280556 (+ 3295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:19:41.284839 (+ 4283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:19:41.284850 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:19:41.284877 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:19:41.285393 (+ 516us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:19:41.285919 (+ 526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:19:41.285925 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:19:41.285929 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:19:41.286161 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:19:41.286832 (+ 671us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:19:41.286844 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:19:41.287408 (+ 564us) client_negotiation.cc:769] Sending connection context
0806 09:19:41.287754 (+ 346us) client_negotiation.cc:240] Negotiation successful
0806 09:19:41.288452 (+ 698us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":333,"threads_started":1}
I20260806 09:19:41.291874 28928 heartbeater.cc:347] Connected to a master server at 127.10.255.126:44481
I20260806 09:19:41.292287 28928 heartbeater.cc:464] Registering TS with master...
I20260806 09:19:41.293134 28928 heartbeater.cc:511] Master 127.10.255.126:44481 requested a full tablet report, sending...
I20260806 09:19:41.295680 28737 ts_manager.cc:194] Registered new tserver with Master: 724b30ea943d4958bf818bbe88bbc690 (127.10.255.65:37997)
I20260806 09:19:41.297335 28737 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.65@KRBTEST.COM'} at 127.10.255.65:45641
WARNING: no policy specified for kudu/127.10.255.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
I20260806 09:19:41.339403 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:44481
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:19:41.700969 28934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:19:41.701468 28934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:19:41.701624 28934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:19:41.709514 28934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:19:41.709642 28934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:19:41.709760 28934 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:19:41.720492 28934 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:44481
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:41.722074 28934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:41.723513 28934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:19:41.738359 28939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:41.738431 28940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:41.738580 28942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:41.739590 28934 server_base.cc:1034] running on GCE node
I20260806 09:19:41.740437 28934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:41.741742 28934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:41.743052 28934 hybrid_clock.cc:648] HybridClock initialized: now 1786007981743015 us; error 46 us; skew 500 ppm
I20260806 09:19:41.743525 28934 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:19:41 dist-test-slave-mvvj krb5kdc[28689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007981, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:19:41.747105 28934 init.cc:377] Logged in from keytab as kudu/127.10.255.66@KRBTEST.COM (short username kudu)
I20260806 09:19:41.749086 28934 webserver.cc:460] Webserver started at http://127.10.255.66:39619/ using document root <none> and password file <none>
I20260806 09:19:41.749869 28934 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:41.750036 28934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:41.750398 28934 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:19:41.753803 28934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "dc0daa3f6efc40fd8302ba23d9714880"
format_stamp: "Formatted at 2026-08-06 09:19:41 on dist-test-slave-mvvj"
server_key: "ededd445944376e4ac195b8795b30526"
server_key_iv: "719d136c69345eb20cbb103e708bc479"
server_key_version: "encryptionkey@0"
I20260806 09:19:41.754990 28934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "dc0daa3f6efc40fd8302ba23d9714880"
format_stamp: "Formatted at 2026-08-06 09:19:41 on dist-test-slave-mvvj"
server_key: "ededd445944376e4ac195b8795b30526"
server_key_iv: "719d136c69345eb20cbb103e708bc479"
server_key_version: "encryptionkey@0"
I20260806 09:19:41.761132 28934 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
I20260806 09:19:41.765188 28949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:41.766912 28934 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260806 09:19:41.767107 28934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "dc0daa3f6efc40fd8302ba23d9714880"
format_stamp: "Formatted at 2026-08-06 09:19:41 on dist-test-slave-mvvj"
server_key: "ededd445944376e4ac195b8795b30526"
server_key_iv: "719d136c69345eb20cbb103e708bc479"
server_key_version: "encryptionkey@0"
I20260806 09:19:41.767338 28934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:41.792564 28934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:41.797312 28934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:41.797636 28934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:41.798722 28934 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:19:41.800287 28934 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:19:41.800371 28934 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:41.800511 28934 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:19:41.800568 28934 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:41.837826 28934 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:39071
I20260806 09:19:41.837865 29063 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:39071 every 8 connection(s)
I20260806 09:19:41.839284 28934 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:19:41.848121 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 28934
I20260806 09:19:41.848335 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:19:41.848822 11261 external_mini_cluster.cc:1428] Setting key c7c7fe6fbe695cce863371adbf992f0c
Aug 06 09:19:41 dist-test-slave-mvvj krb5kdc[28689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007981, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:19:41.861567 29066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:41.842244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:48919 (local address 127.10.255.126:44481)
0806 09:19:41.842733 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:41.842738 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:41.843752 (+ 1014us) server_negotiation.cc:407] Connection header received
0806 09:19:41.845834 (+ 2082us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:41.845842 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:41.845944 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:41.846071 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:41.847741 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:41.848677 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:41.850837 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:41.851310 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:41.851451 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:41.855240 (+ 3789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:41.855245 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:41.855248 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:41.855283 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:41.858168 (+ 2885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:41.859050 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:41.859056 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:41.859062 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:41.859198 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:41.859653 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:41.859659 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:41.859663 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:41.860025 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:41.860191 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:41.860910 (+ 719us) server_negotiation.cc:299] Negotiation successful
0806 09:19:41.861151 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":236,"threads_started":1}
I20260806 09:19:41.862612 29067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:41.842803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:44481 (local address 127.10.255.66:48919)
0806 09:19:41.843561 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:41.843618 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:41.845511 (+ 1893us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:41.846335 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:41.846345 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:41.846903 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:19:41.847520 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:41.847540 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:41.848843 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:41.848853 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:41.850662 (+ 1809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:41.850682 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:41.851568 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:41.851576 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:41.851884 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:41.852676 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:19:41.852701 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:19:41.854953 (+ 2252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:19:41.858368 (+ 3415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:19:41.858378 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:19:41.858419 (+ 41us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:19:41.858894 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:19:41.859320 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:19:41.859325 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:19:41.859328 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:19:41.859536 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:19:41.860161 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:19:41.860170 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:19:41.860546 (+ 376us) client_negotiation.cc:769] Sending connection context
0806 09:19:41.860827 (+ 281us) client_negotiation.cc:240] Negotiation successful
0806 09:19:41.861418 (+ 591us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":304,"threads_started":1}
I20260806 09:19:41.864259 29064 heartbeater.cc:347] Connected to a master server at 127.10.255.126:44481
I20260806 09:19:41.864622 29064 heartbeater.cc:464] Registering TS with master...
I20260806 09:19:41.865587 29064 heartbeater.cc:511] Master 127.10.255.126:44481 requested a full tablet report, sending...
I20260806 09:19:41.867482 28737 ts_manager.cc:194] Registered new tserver with Master: dc0daa3f6efc40fd8302ba23d9714880 (127.10.255.66:39071)
I20260806 09:19:41.868824 28737 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.66@KRBTEST.COM'} at 127.10.255.66:48919
WARNING: no policy specified for kudu/127.10.255.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
I20260806 09:19:41.915694 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:44481
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:19:42.272688 29070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:19:42.273010 29070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:19:42.273110 29070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:19:42.280929 29070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:19:42.281086 29070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:19:42.281209 29070 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:19:42.292356 29070 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:44481
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:42.293879 29070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:42.295298 29070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 09:19:42.301409 28928 heartbeater.cc:503] Master 127.10.255.126:44481 was elected leader, sending a full tablet report...
W20260806 09:19:42.310686 29076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:42.310710 29078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:42.310648 29075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:42.311895 29070 server_base.cc:1034] running on GCE node
I20260806 09:19:42.312657 29070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:42.313874 29070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:42.315124 29070 hybrid_clock.cc:648] HybridClock initialized: now 1786007982315075 us; error 34 us; skew 500 ppm
I20260806 09:19:42.315441 29070 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:19:42 dist-test-slave-mvvj krb5kdc[28689](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007982, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:19:42.319712 29070 init.cc:377] Logged in from keytab as kudu/127.10.255.67@KRBTEST.COM (short username kudu)
I20260806 09:19:42.321573 29070 webserver.cc:460] Webserver started at http://127.10.255.67:33615/ using document root <none> and password file <none>
I20260806 09:19:42.322353 29070 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:42.322588 29070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:42.322947 29070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:19:42.326299 29070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "eead8adacf5544fdac056f9092af4979"
format_stamp: "Formatted at 2026-08-06 09:19:42 on dist-test-slave-mvvj"
server_key: "0c233d8abe4efefaf1a39dc7539e6c32"
server_key_iv: "fd8022f33fbedec4d197c2157710092d"
server_key_version: "encryptionkey@0"
I20260806 09:19:42.327262 29070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "eead8adacf5544fdac056f9092af4979"
format_stamp: "Formatted at 2026-08-06 09:19:42 on dist-test-slave-mvvj"
server_key: "0c233d8abe4efefaf1a39dc7539e6c32"
server_key_iv: "fd8022f33fbedec4d197c2157710092d"
server_key_version: "encryptionkey@0"
I20260806 09:19:42.333681 29070 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.004s
I20260806 09:19:42.337862 29086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:42.339630 29070 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.001s
I20260806 09:19:42.339815 29070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "eead8adacf5544fdac056f9092af4979"
format_stamp: "Formatted at 2026-08-06 09:19:42 on dist-test-slave-mvvj"
server_key: "0c233d8abe4efefaf1a39dc7539e6c32"
server_key_iv: "fd8022f33fbedec4d197c2157710092d"
server_key_version: "encryptionkey@0"
I20260806 09:19:42.340188 29070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:42.356408 29070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:42.361689 29070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:42.362082 29070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:42.363205 29070 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:19:42.364936 29070 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:19:42.365023 29070 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:42.365181 29070 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:19:42.365239 29070 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:42.405310 29070 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:39375
I20260806 09:19:42.405364 29200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:39375 every 8 connection(s)
I20260806 09:19:42.406827 29070 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:19:42.415335 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 29070
I20260806 09:19:42.415566 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:19:42.416146 11261 external_mini_cluster.cc:1428] Setting key 260917a09464d4d0db89b7ed79b44618
Aug 06 09:19:42 dist-test-slave-mvvj krb5kdc[28689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007982, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:19:42.432127 29203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:42.410089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:37699 (local address 127.10.255.126:44481)
0806 09:19:42.410646 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:42.410652 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:42.411884 (+ 1232us) server_negotiation.cc:407] Connection header received
0806 09:19:42.414072 (+ 2188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:42.414076 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:42.414153 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:42.414262 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:42.416399 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.417599 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.420278 (+ 2679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.420830 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.420941 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:42.425042 (+ 4101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:42.425048 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:42.425052 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:42.425088 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:42.428141 (+ 3053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:42.429061 (+ 920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:42.429065 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:42.429067 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:42.429196 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:42.429740 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:42.429745 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:42.429747 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:42.430158 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:42.430354 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:42.431414 (+ 1060us) server_negotiation.cc:299] Negotiation successful
0806 09:19:42.431698 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":254,"threads_started":1}
I20260806 09:19:42.433163 29204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:42.410785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:44481 (local address 127.10.255.67:37699)
0806 09:19:42.411679 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:42.411736 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:42.413710 (+ 1974us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:42.414540 (+ 830us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:42.414549 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:42.415279 (+ 730us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:19:42.416148 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:42.416173 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.417850 (+ 1677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.417857 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:42.420086 (+ 2229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:42.420107 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.421093 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.421099 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:42.421343 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:42.422095 (+ 752us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:19:42.422121 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:19:42.424752 (+ 2631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:19:42.428316 (+ 3564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:19:42.428325 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:19:42.428341 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:19:42.428874 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:19:42.429308 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:19:42.429312 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:19:42.429315 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:19:42.429543 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:19:42.430325 (+ 782us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:19:42.430332 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:19:42.430880 (+ 548us) client_negotiation.cc:769] Sending connection context
0806 09:19:42.431261 (+ 381us) client_negotiation.cc:240] Negotiation successful
0806 09:19:42.431898 (+ 637us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":336,"threads_started":1}
I20260806 09:19:42.434948 29201 heartbeater.cc:347] Connected to a master server at 127.10.255.126:44481
I20260806 09:19:42.435344 29201 heartbeater.cc:464] Registering TS with master...
I20260806 09:19:42.436256 29201 heartbeater.cc:511] Master 127.10.255.126:44481 requested a full tablet report, sending...
I20260806 09:19:42.437948 28737 ts_manager.cc:194] Registered new tserver with Master: eead8adacf5544fdac056f9092af4979 (127.10.255.67:39375)
I20260806 09:19:42.438843 28737 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.67@KRBTEST.COM'} at 127.10.255.67:37699
I20260806 09:19:42.446867 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 09:19:42.466697 29203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:42.451974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41128 (local address 127.10.255.126:44481)
0806 09:19:42.452159 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:42.452163 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:42.452648 (+ 485us) server_negotiation.cc:407] Connection header received
0806 09:19:42.452800 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:42.452804 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:42.452896 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:42.452995 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:42.454677 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.455605 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.457212 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.457629 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.457741 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:42.460854 (+ 3113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:42.460859 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:42.460863 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:42.460946 (+ 83us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:42.463950 (+ 3004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:42.464809 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:42.464814 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:42.464816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:42.464955 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:42.465337 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:42.465341 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:42.465343 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:42.465696 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:42.465878 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:42.466268 (+ 390us) server_negotiation.cc:299] Negotiation successful
0806 09:19:42.466460 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 09:19:42.471393 28737 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41128:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:19:42.479020 28737 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:19:42.506206 29215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:42.493692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:39071 (local address 127.0.0.1:55314)
0806 09:19:42.496067 (+ 2375us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:42.496082 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:42.496244 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:42.497239 (+ 995us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:42.497248 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:42.497280 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:42.497832 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:42.497849 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.499777 (+ 1928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.499785 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:42.502612 (+ 2827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:42.502631 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.504976 (+ 2345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.504984 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:42.505206 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:42.505268 (+ 62us) client_negotiation.cc:769] Sending connection context
0806 09:19:42.505418 (+ 150us) client_negotiation.cc:240] Negotiation successful
0806 09:19:42.505656 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2262,"mutex_wait_us":23,"thread_start_us":1097,"threads_started":1}
I20260806 09:19:42.506590 29216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:42.493504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38322 (local address 127.10.255.65:37997)
0806 09:19:42.494740 (+ 1236us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:42.494755 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:42.495711 (+ 956us) server_negotiation.cc:407] Connection header received
0806 09:19:42.497931 (+ 2220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:42.497946 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:42.498247 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:42.498476 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:42.499202 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.500957 (+ 1755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.503532 (+ 2575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.505075 (+ 1543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.505223 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:42.505467 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:42.506055 (+ 588us) server_negotiation.cc:299] Negotiation successful
0806 09:19:42.506274 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1005,"thread_start_us":846,"threads_started":1}
I20260806 09:19:42.506490 29217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:42.493153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:37997 (local address 127.0.0.1:38322)
0806 09:19:42.495239 (+ 2086us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:42.495292 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:42.495490 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:42.498646 (+ 3156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:42.498651 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:42.498675 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:42.498997 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:42.499006 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.501132 (+ 2126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.501138 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:42.503332 (+ 2194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:42.503349 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.505637 (+ 2288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.505646 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:42.505832 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:42.505865 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 09:19:42.505964 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 09:19:42.506113 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1813,"thread_start_us":2606,"threads_started":1}
I20260806 09:19:42.507606 29218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:42.494310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55314 (local address 127.10.255.66:39071)
0806 09:19:42.495160 (+ 850us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:42.495170 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:42.496200 (+ 1030us) server_negotiation.cc:407] Connection header received
0806 09:19:42.496460 (+ 260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:42.496469 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:42.496756 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:42.496963 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:42.498045 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.499632 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.502811 (+ 3179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.504670 (+ 1859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.504898 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:42.505134 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:42.507227 (+ 2093us) server_negotiation.cc:299] Negotiation successful
0806 09:19:42.507376 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":690,"thread_start_us":585,"threads_started":1}
I20260806 09:19:42.509033 29219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:42.496106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:39375 (local address 127.0.0.1:45676)
0806 09:19:42.497920 (+ 1814us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:42.497938 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:42.498080 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:42.499235 (+ 1155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:42.499239 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:42.499266 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:42.499620 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:42.499633 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.501642 (+ 2009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.501648 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:42.504011 (+ 2363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:42.504029 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.508119 (+ 4090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.508127 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:42.508304 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:42.508337 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 09:19:42.508442 (+ 105us) client_negotiation.cc:240] Negotiation successful
0806 09:19:42.508588 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1684,"mutex_wait_us":1,"thread_start_us":1496,"threads_started":1}
I20260806 09:19:42.509059 29220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:42.496521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45676 (local address 127.10.255.67:39375)
0806 09:19:42.498695 (+ 2174us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:42.498704 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:42.498736 (+ 32us) server_negotiation.cc:407] Connection header received
0806 09:19:42.498827 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:42.498834 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:42.499051 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:42.499253 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:42.499857 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.501419 (+ 1562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.505247 (+ 3828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.507756 (+ 2509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.508009 (+ 253us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:42.508263 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:42.508525 (+ 262us) server_negotiation.cc:299] Negotiation successful
0806 09:19:42.508714 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2004,"thread_start_us":1817,"threads_started":1}
I20260806 09:19:42.511248 28999 tablet_service.cc:1467] Processing CreateTablet for tablet 3b67fb3fe36247dca385080196be47b9 (DEFAULT_TABLE table=test-table [id=ef4bb104b5934f458d9bb4b213f17629]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:19:42.511013 28863 tablet_service.cc:1467] Processing CreateTablet for tablet 3b67fb3fe36247dca385080196be47b9 (DEFAULT_TABLE table=test-table [id=ef4bb104b5934f458d9bb4b213f17629]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:19:42.512585 28999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b67fb3fe36247dca385080196be47b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:19:42.512655 28863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b67fb3fe36247dca385080196be47b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:19:42.512827 29134 tablet_service.cc:1467] Processing CreateTablet for tablet 3b67fb3fe36247dca385080196be47b9 (DEFAULT_TABLE table=test-table [id=ef4bb104b5934f458d9bb4b213f17629]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:19:42.514375 29134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3b67fb3fe36247dca385080196be47b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:19:42.526113 29221 tablet_bootstrap.cc:492] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880: Bootstrap starting.
I20260806 09:19:42.528771 29222 tablet_bootstrap.cc:492] T 3b67fb3fe36247dca385080196be47b9 P 724b30ea943d4958bf818bbe88bbc690: Bootstrap starting.
I20260806 09:19:42.530242 29221 tablet_bootstrap.cc:654] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880: Neither blocks nor log segments found. Creating new log.
I20260806 09:19:42.531893 29221 log.cc:824] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880: Log is configured to *not* fsync() on all Append() calls
I20260806 09:19:42.533638 29222 tablet_bootstrap.cc:654] T 3b67fb3fe36247dca385080196be47b9 P 724b30ea943d4958bf818bbe88bbc690: Neither blocks nor log segments found. Creating new log.
I20260806 09:19:42.535138 29222 log.cc:824] T 3b67fb3fe36247dca385080196be47b9 P 724b30ea943d4958bf818bbe88bbc690: Log is configured to *not* fsync() on all Append() calls
I20260806 09:19:42.536104 29223 tablet_bootstrap.cc:492] T 3b67fb3fe36247dca385080196be47b9 P eead8adacf5544fdac056f9092af4979: Bootstrap starting.
I20260806 09:19:42.536613 29221 tablet_bootstrap.cc:492] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880: No bootstrap required, opened a new log
I20260806 09:19:42.536994 29221 ts_tablet_manager.cc:1397] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.004s
I20260806 09:19:42.538712 29222 tablet_bootstrap.cc:492] T 3b67fb3fe36247dca385080196be47b9 P 724b30ea943d4958bf818bbe88bbc690: No bootstrap required, opened a new log
I20260806 09:19:42.539011 29222 ts_tablet_manager.cc:1397] T 3b67fb3fe36247dca385080196be47b9 P 724b30ea943d4958bf818bbe88bbc690: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.003s
I20260806 09:19:42.540014 29223 tablet_bootstrap.cc:654] T 3b67fb3fe36247dca385080196be47b9 P eead8adacf5544fdac056f9092af4979: Neither blocks nor log segments found. Creating new log.
I20260806 09:19:42.541055 29223 log.cc:824] T 3b67fb3fe36247dca385080196be47b9 P eead8adacf5544fdac056f9092af4979: Log is configured to *not* fsync() on all Append() calls
I20260806 09:19:42.543985 29223 tablet_bootstrap.cc:492] T 3b67fb3fe36247dca385080196be47b9 P eead8adacf5544fdac056f9092af4979: No bootstrap required, opened a new log
I20260806 09:19:42.544358 29223 ts_tablet_manager.cc:1397] T 3b67fb3fe36247dca385080196be47b9 P eead8adacf5544fdac056f9092af4979: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.003s
I20260806 09:19:42.548715 29222 raft_consensus.cc:348] T 3b67fb3fe36247dca385080196be47b9 P 724b30ea943d4958bf818bbe88bbc690 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "724b30ea943d4958bf818bbe88bbc690" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37997 } } peers { permanent_uuid: "dc0daa3f6efc40fd8302ba23d9714880" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 39071 } } peers { permanent_uuid: "eead8adacf5544fdac056f9092af4979" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39375 } }
I20260806 09:19:42.548650 29221 raft_consensus.cc:348] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "724b30ea943d4958bf818bbe88bbc690" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37997 } } peers { permanent_uuid: "dc0daa3f6efc40fd8302ba23d9714880" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 39071 } } peers { permanent_uuid: "eead8adacf5544fdac056f9092af4979" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39375 } }
I20260806 09:19:42.549186 29221 raft_consensus.cc:374] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:19:42.549197 29222 raft_consensus.cc:374] T 3b67fb3fe36247dca385080196be47b9 P 724b30ea943d4958bf818bbe88bbc690 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:19:42.549295 29222 raft_consensus.cc:729] T 3b67fb3fe36247dca385080196be47b9 P 724b30ea943d4958bf818bbe88bbc690 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 724b30ea943d4958bf818bbe88bbc690, State: Initialized, Role: FOLLOWER
I20260806 09:19:42.549329 29221 raft_consensus.cc:729] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc0daa3f6efc40fd8302ba23d9714880, State: Initialized, Role: FOLLOWER
I20260806 09:19:42.550051 29222 consensus_queue.cc:260] T 3b67fb3fe36247dca385080196be47b9 P 724b30ea943d4958bf818bbe88bbc690 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "724b30ea943d4958bf818bbe88bbc690" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37997 } } peers { permanent_uuid: "dc0daa3f6efc40fd8302ba23d9714880" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 39071 } } peers { permanent_uuid: "eead8adacf5544fdac056f9092af4979" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39375 } }
I20260806 09:19:42.550045 29221 consensus_queue.cc:260] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "724b30ea943d4958bf818bbe88bbc690" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37997 } } peers { permanent_uuid: "dc0daa3f6efc40fd8302ba23d9714880" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 39071 } } peers { permanent_uuid: "eead8adacf5544fdac056f9092af4979" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39375 } }
I20260806 09:19:42.552129 29222 ts_tablet_manager.cc:1428] T 3b67fb3fe36247dca385080196be47b9 P 724b30ea943d4958bf818bbe88bbc690: Time spent starting tablet: real 0.013s user 0.013s sys 0.002s
I20260806 09:19:42.554107 29221 ts_tablet_manager.cc:1428] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880: Time spent starting tablet: real 0.017s user 0.011s sys 0.004s
I20260806 09:19:42.555589 29064 heartbeater.cc:503] Master 127.10.255.126:44481 was elected leader, sending a full tablet report...
I20260806 09:19:42.557483 29223 raft_consensus.cc:348] T 3b67fb3fe36247dca385080196be47b9 P eead8adacf5544fdac056f9092af4979 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "724b30ea943d4958bf818bbe88bbc690" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37997 } } peers { permanent_uuid: "dc0daa3f6efc40fd8302ba23d9714880" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 39071 } } peers { permanent_uuid: "eead8adacf5544fdac056f9092af4979" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39375 } }
I20260806 09:19:42.558167 29223 raft_consensus.cc:374] T 3b67fb3fe36247dca385080196be47b9 P eead8adacf5544fdac056f9092af4979 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:19:42.558341 29223 raft_consensus.cc:729] T 3b67fb3fe36247dca385080196be47b9 P eead8adacf5544fdac056f9092af4979 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eead8adacf5544fdac056f9092af4979, State: Initialized, Role: FOLLOWER
I20260806 09:19:42.558283 29228 raft_consensus.cc:482] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:19:42.559310 29223 consensus_queue.cc:260] T 3b67fb3fe36247dca385080196be47b9 P eead8adacf5544fdac056f9092af4979 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "724b30ea943d4958bf818bbe88bbc690" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37997 } } peers { permanent_uuid: "dc0daa3f6efc40fd8302ba23d9714880" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 39071 } } peers { permanent_uuid: "eead8adacf5544fdac056f9092af4979" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39375 } }
I20260806 09:19:42.559384 29228 raft_consensus.cc:504] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "724b30ea943d4958bf818bbe88bbc690" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37997 } } peers { permanent_uuid: "dc0daa3f6efc40fd8302ba23d9714880" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 39071 } } peers { permanent_uuid: "eead8adacf5544fdac056f9092af4979" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39375 } }
I20260806 09:19:42.560712 29201 heartbeater.cc:503] Master 127.10.255.126:44481 was elected leader, sending a full tablet report...
I20260806 09:19:42.561501 29223 ts_tablet_manager.cc:1428] T 3b67fb3fe36247dca385080196be47b9 P eead8adacf5544fdac056f9092af4979: Time spent starting tablet: real 0.017s user 0.008s sys 0.006s
I20260806 09:19:42.562397 29228 leader_election.cc:288] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 724b30ea943d4958bf818bbe88bbc690 (127.10.255.65:37997), eead8adacf5544fdac056f9092af4979 (127.10.255.67:39375)
I20260806 09:19:42.569979 29216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:42.562648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:54417 (local address 127.10.255.65:37997)
0806 09:19:42.562921 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:42.562931 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:42.563327 (+ 396us) server_negotiation.cc:407] Connection header received
0806 09:19:42.563554 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:42.563558 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:42.563626 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:42.563727 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:42.564348 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.565351 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.568074 (+ 2723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.568882 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.569097 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:42.569186 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:42.569591 (+ 405us) server_negotiation.cc:299] Negotiation successful
0806 09:19:42.569740 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 09:19:42.570084 29230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:42.562039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:37997 (local address 127.10.255.66:54417)
0806 09:19:42.563214 (+ 1175us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:42.563231 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:42.563403 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:42.563761 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:42.563766 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:42.563795 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:42.564199 (+ 404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:42.564210 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.565547 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.565553 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:42.567778 (+ 2225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:42.567791 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.569142 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.569149 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:42.569351 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:42.569387 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 09:19:42.569494 (+ 107us) client_negotiation.cc:240] Negotiation successful
0806 09:19:42.569652 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1044,"thread_start_us":837,"threads_started":1}
I20260806 09:19:42.571231 28883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b67fb3fe36247dca385080196be47b9" candidate_uuid: "dc0daa3f6efc40fd8302ba23d9714880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "724b30ea943d4958bf818bbe88bbc690" is_pre_election: true
I20260806 09:19:42.571792 28883 raft_consensus.cc:2454] T 3b67fb3fe36247dca385080196be47b9 P 724b30ea943d4958bf818bbe88bbc690 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc0daa3f6efc40fd8302ba23d9714880 in term 0.
I20260806 09:19:42.572578 28953 leader_election.cc:302] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 724b30ea943d4958bf818bbe88bbc690, dc0daa3f6efc40fd8302ba23d9714880; no voters:
I20260806 09:19:42.573128 29228 raft_consensus.cc:2781] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:19:42.573954 29220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:42.561983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:36439 (local address 127.10.255.67:39375)
0806 09:19:42.562284 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:42.562292 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:42.565300 (+ 3008us) server_negotiation.cc:407] Connection header received
0806 09:19:42.565503 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:42.565509 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:42.565586 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:42.565685 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:42.566442 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.567550 (+ 1108us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.569384 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.570602 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.572408 (+ 1806us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:42.572466 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:42.573550 (+ 1084us) server_negotiation.cc:299] Negotiation successful
0806 09:19:42.573703 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140}
I20260806 09:19:42.573433 29228 raft_consensus.cc:482] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:19:42.574499 29228 raft_consensus.cc:3037] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:19:42.576191 29231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:42.562100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:39375 (local address 127.10.255.66:36439)
0806 09:19:42.565187 (+ 3087us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:42.565203 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:42.565353 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:42.565729 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:42.565734 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:42.565762 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:42.566255 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:42.566268 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.567738 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.567747 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:42.569227 (+ 1480us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:42.569240 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.573125 (+ 3885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.573132 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:42.573337 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:42.573370 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 09:19:42.574145 (+ 775us) client_negotiation.cc:240] Negotiation successful
0806 09:19:42.575752 (+ 1607us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2964,"thread_start_us":2757,"threads_started":1}
I20260806 09:19:42.577222 29154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b67fb3fe36247dca385080196be47b9" candidate_uuid: "dc0daa3f6efc40fd8302ba23d9714880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eead8adacf5544fdac056f9092af4979" is_pre_election: true
I20260806 09:19:42.577854 29154 raft_consensus.cc:2454] T 3b67fb3fe36247dca385080196be47b9 P eead8adacf5544fdac056f9092af4979 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc0daa3f6efc40fd8302ba23d9714880 in term 0.
I20260806 09:19:42.579012 29228 raft_consensus.cc:504] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "724b30ea943d4958bf818bbe88bbc690" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37997 } } peers { permanent_uuid: "dc0daa3f6efc40fd8302ba23d9714880" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 39071 } } peers { permanent_uuid: "eead8adacf5544fdac056f9092af4979" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39375 } }
I20260806 09:19:42.579663 29228 leader_election.cc:288] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880 [CANDIDATE]: Term 1 election: Requested vote from peers 724b30ea943d4958bf818bbe88bbc690 (127.10.255.65:37997), eead8adacf5544fdac056f9092af4979 (127.10.255.67:39375)
I20260806 09:19:42.580217 28883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b67fb3fe36247dca385080196be47b9" candidate_uuid: "dc0daa3f6efc40fd8302ba23d9714880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "724b30ea943d4958bf818bbe88bbc690"
I20260806 09:19:42.580258 29154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b67fb3fe36247dca385080196be47b9" candidate_uuid: "dc0daa3f6efc40fd8302ba23d9714880" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eead8adacf5544fdac056f9092af4979"
I20260806 09:19:42.580461 28883 raft_consensus.cc:3037] T 3b67fb3fe36247dca385080196be47b9 P 724b30ea943d4958bf818bbe88bbc690 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:19:42.580480 29154 raft_consensus.cc:3037] T 3b67fb3fe36247dca385080196be47b9 P eead8adacf5544fdac056f9092af4979 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:19:42.583055 28883 raft_consensus.cc:2454] T 3b67fb3fe36247dca385080196be47b9 P 724b30ea943d4958bf818bbe88bbc690 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc0daa3f6efc40fd8302ba23d9714880 in term 1.
I20260806 09:19:42.583587 28953 leader_election.cc:302] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 724b30ea943d4958bf818bbe88bbc690, dc0daa3f6efc40fd8302ba23d9714880; no voters:
I20260806 09:19:42.583868 29154 raft_consensus.cc:2454] T 3b67fb3fe36247dca385080196be47b9 P eead8adacf5544fdac056f9092af4979 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc0daa3f6efc40fd8302ba23d9714880 in term 1.
I20260806 09:19:42.583976 29228 raft_consensus.cc:2781] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:19:42.584546 29228 raft_consensus.cc:686] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880 [term 1 LEADER]: Becoming Leader. State: Replica: dc0daa3f6efc40fd8302ba23d9714880, State: Running, Role: LEADER
I20260806 09:19:42.585191 29228 consensus_queue.cc:237] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "724b30ea943d4958bf818bbe88bbc690" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37997 } } peers { permanent_uuid: "dc0daa3f6efc40fd8302ba23d9714880" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 39071 } } peers { permanent_uuid: "eead8adacf5544fdac056f9092af4979" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39375 } }
I20260806 09:19:42.589960 28736 catalog_manager.cc:5495] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880 reported cstate change: term changed from 0 to 1, leader changed from <none> to dc0daa3f6efc40fd8302ba23d9714880 (127.10.255.66). New cstate: current_term: 1 leader_uuid: "dc0daa3f6efc40fd8302ba23d9714880" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "724b30ea943d4958bf818bbe88bbc690" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37997 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc0daa3f6efc40fd8302ba23d9714880" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 39071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eead8adacf5544fdac056f9092af4979" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39375 } health_report { overall_health: UNKNOWN } } }
W20260806 09:19:42.591511 29065 tablet.cc:2369] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:19:42.608430 29218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:42.602480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55324 (local address 127.10.255.66:39071)
0806 09:19:42.602671 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:42.602676 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:42.602888 (+ 212us) server_negotiation.cc:407] Connection header received
0806 09:19:42.603011 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:42.603015 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:42.603119 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:42.603262 (+ 143us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:19:42.603683 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.604538 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.606117 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.606536 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.606647 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:42.607131 (+ 484us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:19:42.607723 (+ 592us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:19:42.607965 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:42.608086 (+ 121us) server_negotiation.cc:299] Negotiation successful
0806 09:19:42.608197 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260806 09:19:42.617340 28883 raft_consensus.cc:1261] T 3b67fb3fe36247dca385080196be47b9 P 724b30ea943d4958bf818bbe88bbc690 [term 1 FOLLOWER]: Refusing update from remote peer dc0daa3f6efc40fd8302ba23d9714880: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:19:42.617393 29154 raft_consensus.cc:1261] T 3b67fb3fe36247dca385080196be47b9 P eead8adacf5544fdac056f9092af4979 [term 1 FOLLOWER]: Refusing update from remote peer dc0daa3f6efc40fd8302ba23d9714880: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:19:42.618643 29232 consensus_queue.cc:1035] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "724b30ea943d4958bf818bbe88bbc690" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 37997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:19:42.619068 29228 consensus_queue.cc:1035] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eead8adacf5544fdac056f9092af4979" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:19:42.641517 29237 mvcc.cc:205] Tried to move back new op lower bound from 7315488696789385216 to 7315488696673587200. Current Snapshot: MvccSnapshot[applied={T|T < 7315488696789385216 or (T in {7315488696789385216})}]
I20260806 09:19:42.655128 28737 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41128:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:19:42.655441 28737 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41128:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:19:42.660225 28737 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 850608d35ec14c9da6af63a332b21760: Sending DeleteTablet for 3 replicas of tablet 3b67fb3fe36247dca385080196be47b9
I20260806 09:19:42.661621 28863 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b67fb3fe36247dca385080196be47b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:19:42 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:38322
I20260806 09:19:42.661626 28999 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b67fb3fe36247dca385080196be47b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:19:42 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:55314
I20260806 09:19:42.662110 29134 tablet_service.cc:1514] Processing DeleteTablet for tablet 3b67fb3fe36247dca385080196be47b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:19:42 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:45676
I20260806 09:19:42.664834 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 28798
I20260806 09:19:42.672560 29245 tablet_replica.cc:330] T 3b67fb3fe36247dca385080196be47b9 P 724b30ea943d4958bf818bbe88bbc690: stopping tablet replica
I20260806 09:19:42.673151 29245 raft_consensus.cc:2229] T 3b67fb3fe36247dca385080196be47b9 P 724b30ea943d4958bf818bbe88bbc690 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:19:42.673261 29246 tablet_replica.cc:330] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880: stopping tablet replica
I20260806 09:19:42.673632 29247 tablet_replica.cc:330] T 3b67fb3fe36247dca385080196be47b9 P eead8adacf5544fdac056f9092af4979: stopping tablet replica
I20260806 09:19:42.673810 29245 raft_consensus.cc:2258] T 3b67fb3fe36247dca385080196be47b9 P 724b30ea943d4958bf818bbe88bbc690 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:19:42.674003 29246 raft_consensus.cc:2229] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880 [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:19:42.674134 29247 raft_consensus.cc:2229] T 3b67fb3fe36247dca385080196be47b9 P eead8adacf5544fdac056f9092af4979 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:19:42.674690 29247 raft_consensus.cc:2258] T 3b67fb3fe36247dca385080196be47b9 P eead8adacf5544fdac056f9092af4979 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:19:42.675372 29246 raft_consensus.cc:2258] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:19:42.677116 29247 ts_tablet_manager.cc:1905] T 3b67fb3fe36247dca385080196be47b9 P eead8adacf5544fdac056f9092af4979: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:19:42.677186 29245 ts_tablet_manager.cc:1905] T 3b67fb3fe36247dca385080196be47b9 P 724b30ea943d4958bf818bbe88bbc690: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:19:42.681588 29246 ts_tablet_manager.cc:1905] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 06 09:19:42 dist-test-slave-mvvj krb5kdc[28689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007979, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.65@KRBTEST.COM
I20260806 09:19:42.685546 29247 ts_tablet_manager.cc:1918] T 3b67fb3fe36247dca385080196be47b9 P eead8adacf5544fdac056f9092af4979: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:19:42.685755 29247 log.cc:1196] T 3b67fb3fe36247dca385080196be47b9 P eead8adacf5544fdac056f9092af4979: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/3b67fb3fe36247dca385080196be47b9
I20260806 09:19:42.686383 29247 ts_tablet_manager.cc:1939] T 3b67fb3fe36247dca385080196be47b9 P eead8adacf5544fdac056f9092af4979: Deleting consensus metadata
I20260806 09:19:42.688732 28723 catalog_manager.cc:4841] TS eead8adacf5544fdac056f9092af4979 (127.10.255.67:39375): tablet 3b67fb3fe36247dca385080196be47b9 (table test-table [id=ef4bb104b5934f458d9bb4b213f17629]) successfully deleted
I20260806 09:19:42.691938 29246 ts_tablet_manager.cc:1918] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:19:42.692142 29246 log.cc:1196] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/3b67fb3fe36247dca385080196be47b9
I20260806 09:19:42.692907 29246 ts_tablet_manager.cc:1939] T 3b67fb3fe36247dca385080196be47b9 P dc0daa3f6efc40fd8302ba23d9714880: Deleting consensus metadata
I20260806 09:19:42.694216 29245 ts_tablet_manager.cc:1918] T 3b67fb3fe36247dca385080196be47b9 P 724b30ea943d4958bf818bbe88bbc690: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:19:42.694423 29245 log.cc:1196] T 3b67fb3fe36247dca385080196be47b9 P 724b30ea943d4958bf818bbe88bbc690: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786007647474472-11261-0/minicluster-data/ts-0/wal/wals/3b67fb3fe36247dca385080196be47b9
I20260806 09:19:42.695102 29245 ts_tablet_manager.cc:1939] T 3b67fb3fe36247dca385080196be47b9 P 724b30ea943d4958bf818bbe88bbc690: Deleting consensus metadata
I20260806 09:19:42.695091 28722 catalog_manager.cc:4841] TS dc0daa3f6efc40fd8302ba23d9714880 (127.10.255.66:39071): tablet 3b67fb3fe36247dca385080196be47b9 (table test-table [id=ef4bb104b5934f458d9bb4b213f17629]) successfully deleted
I20260806 09:19:42.696842 29216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:42.666384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38336 (local address 127.10.255.65:37997)
0806 09:19:42.666645 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:42.666655 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:42.673572 (+ 6917us) server_negotiation.cc:407] Connection header received
0806 09:19:42.673930 (+ 358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:42.673937 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:42.674039 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:42.674158 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:42.676460 (+ 2302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.677613 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.679986 (+ 2373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.680675 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.680784 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:42.687109 (+ 6325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:42.687134 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:42.687153 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:42.687206 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:42.692598 (+ 5392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:42.693745 (+ 1147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:42.693756 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:42.693759 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:42.693958 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:42.694492 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:42.694497 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:42.694500 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:42.695071 (+ 571us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:42.695428 (+ 357us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:42.696027 (+ 599us) server_negotiation.cc:299] Negotiation successful
0806 09:19:42.696389 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260806 09:19:42.697276 28724 catalog_manager.cc:4841] TS 724b30ea943d4958bf818bbe88bbc690 (127.10.255.65:37997): tablet 3b67fb3fe36247dca385080196be47b9 (table test-table [id=ef4bb104b5934f458d9bb4b213f17629]) successfully deleted
I20260806 09:19:42.697607 28923 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:42.791447 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 28798
I20260806 09:19:42.813035 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 28934
Aug 06 09:19:42 dist-test-slave-mvvj krb5kdc[28689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007979, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.66@KRBTEST.COM
I20260806 09:19:42.834985 29218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:42.814032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55340 (local address 127.10.255.66:39071)
0806 09:19:42.814286 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:42.814295 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:42.814430 (+ 135us) server_negotiation.cc:407] Connection header received
0806 09:19:42.814617 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:42.814626 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:42.814751 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:42.814901 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:42.816764 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.817900 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.820108 (+ 2208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.820609 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.820794 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:42.826798 (+ 6004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:42.826825 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:42.826848 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:42.826903 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:42.831228 (+ 4325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:42.832420 (+ 1192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:42.832432 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:42.832442 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:42.832644 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:42.833097 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:42.833103 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:42.833106 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:42.833599 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:42.833929 (+ 330us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:42.834318 (+ 389us) server_negotiation.cc:299] Negotiation successful
0806 09:19:42.834567 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 09:19:42.835940 29059 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:42.957667 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 28934
I20260806 09:19:42.979801 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 29070
Aug 06 09:19:42 dist-test-slave-mvvj krb5kdc[28689](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007979, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.67@KRBTEST.COM
I20260806 09:19:42.998270 29220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:42.980841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45688 (local address 127.10.255.67:39375)
0806 09:19:42.981055 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:42.981060 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:42.981083 (+ 23us) server_negotiation.cc:407] Connection header received
0806 09:19:42.981206 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:42.981210 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:42.981277 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:42.981368 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:42.982796 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.983583 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.985206 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:42.985662 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:42.985788 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:42.990945 (+ 5157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:42.990967 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:42.990985 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:42.991032 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:42.994727 (+ 3695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:42.995771 (+ 1044us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:42.995779 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:42.995782 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:42.996070 (+ 288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:42.996529 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:42.996533 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:42.996535 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:42.996969 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:42.997219 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:42.997630 (+ 411us) server_negotiation.cc:299] Negotiation successful
0806 09:19:42.997846 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 09:19:42.999100 29196 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:43.093665 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 29070
I20260806 09:19:43.112212 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 28703
I20260806 09:19:43.113473 28767 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:43.229137 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 28703
2026-08-06T09:19:43Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4618 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-06T09:19:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:19:43Z Disabled control of system clock
I20260806 09:19:43.319330 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:36065
--webserver_interface=127.10.255.126
--webserver_port=0
--builtin_ntp_servers=127.10.255.84:45319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:36065
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 09:19:43.692672 29256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:19:43.693022 29256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:19:43.693166 29256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:19:43.701344 29256 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:19:43.701480 29256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:19:43.701561 29256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:19:43.701658 29256 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:19:43.701740 29256 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:19:43.712010 29256 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:45319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:36065
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:36065
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:43.713428 29256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:43.715389 29256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:19:43.728699 29261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:43.728709 29263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:43.728653 29265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:43.729900 29256 server_base.cc:1034] running on GCE node
I20260806 09:19:43.731077 29256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:43.732879 29256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:43.734176 29256 hybrid_clock.cc:648] HybridClock initialized: now 1786007983734101 us; error 77 us; skew 500 ppm
I20260806 09:19:43.734702 29256 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:19:43.737689 29256 webserver.cc:460] Webserver started at http://127.10.255.126:41163/ using document root <none> and password file <none>
I20260806 09:19:43.738485 29256 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:43.738639 29256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:43.738996 29256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:19:43.742331 29256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "f31fd2a5f854456e8de7c237241a1c18"
format_stamp: "Formatted at 2026-08-06 09:19:43 on dist-test-slave-mvvj"
server_key: "4b54e195e7886795018b997b8da6629d"
server_key_iv: "f250b015711a17e23ae5f44a3beca92d"
server_key_version: "encryptionkey@0"
I20260806 09:19:43.743247 29256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "f31fd2a5f854456e8de7c237241a1c18"
format_stamp: "Formatted at 2026-08-06 09:19:43 on dist-test-slave-mvvj"
server_key: "4b54e195e7886795018b997b8da6629d"
server_key_iv: "f250b015711a17e23ae5f44a3beca92d"
server_key_version: "encryptionkey@0"
I20260806 09:19:43.749142 29256 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260806 09:19:43.753189 29271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:43.754842 29256 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.002s
I20260806 09:19:43.755088 29256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "f31fd2a5f854456e8de7c237241a1c18"
format_stamp: "Formatted at 2026-08-06 09:19:43 on dist-test-slave-mvvj"
server_key: "4b54e195e7886795018b997b8da6629d"
server_key_iv: "f250b015711a17e23ae5f44a3beca92d"
server_key_version: "encryptionkey@0"
I20260806 09:19:43.755373 29256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:43.775804 29256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:43.776926 29256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:43.777271 29256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:43.799551 29256 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:36065
I20260806 09:19:43.799561 29322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:36065 every 8 connection(s)
I20260806 09:19:43.801218 29256 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:19:43.805881 29323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:19:43.808526 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 29256
I20260806 09:19:43.808736 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:19:43.809257 11261 external_mini_cluster.cc:1428] Setting key 617ecbbfcda24dbf2ba1b351a78c48b7
I20260806 09:19:43.819820 29323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f31fd2a5f854456e8de7c237241a1c18: Bootstrap starting.
I20260806 09:19:43.823961 29323 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f31fd2a5f854456e8de7c237241a1c18: Neither blocks nor log segments found. Creating new log.
I20260806 09:19:43.824601 29326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:43.811515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40388 (local address 127.10.255.126:36065)
0806 09:19:43.812757 (+ 1242us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:43.812780 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:43.812828 (+ 48us) server_negotiation.cc:407] Connection header received
0806 09:19:43.814630 (+ 1802us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:43.814657 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:43.815175 (+ 518us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:43.815599 (+ 424us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:43.816268 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:43.817679 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:43.819196 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:43.820027 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:43.820237 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:43.821755 (+ 1518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:43.821764 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:43.821782 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:19:43.822384 (+ 602us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:43.822544 (+ 160us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:19:43.822570 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:43.822671 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:43.822962 (+ 291us) server_negotiation.cc:299] Negotiation successful
0806 09:19:43.823357 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":682,"thread_start_us":417,"threads_started":1}
I20260806 09:19:43.825369 29323 log.cc:824] T 00000000000000000000000000000000 P f31fd2a5f854456e8de7c237241a1c18: Log is configured to *not* fsync() on all Append() calls
I20260806 09:19:43.829296 29323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f31fd2a5f854456e8de7c237241a1c18: No bootstrap required, opened a new log
I20260806 09:19:43.837379 29323 raft_consensus.cc:348] T 00000000000000000000000000000000 P f31fd2a5f854456e8de7c237241a1c18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f31fd2a5f854456e8de7c237241a1c18" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36065 } }
I20260806 09:19:43.837800 29323 raft_consensus.cc:374] T 00000000000000000000000000000000 P f31fd2a5f854456e8de7c237241a1c18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:19:43.837886 29323 raft_consensus.cc:729] T 00000000000000000000000000000000 P f31fd2a5f854456e8de7c237241a1c18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f31fd2a5f854456e8de7c237241a1c18, State: Initialized, Role: FOLLOWER
I20260806 09:19:43.838445 29323 consensus_queue.cc:260] T 00000000000000000000000000000000 P f31fd2a5f854456e8de7c237241a1c18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f31fd2a5f854456e8de7c237241a1c18" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36065 } }
I20260806 09:19:43.838660 29323 raft_consensus.cc:388] T 00000000000000000000000000000000 P f31fd2a5f854456e8de7c237241a1c18 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:19:43.838814 29323 raft_consensus.cc:482] T 00000000000000000000000000000000 P f31fd2a5f854456e8de7c237241a1c18 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:19:43.839003 29323 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f31fd2a5f854456e8de7c237241a1c18 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:19:43.841634 29323 raft_consensus.cc:504] T 00000000000000000000000000000000 P f31fd2a5f854456e8de7c237241a1c18 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f31fd2a5f854456e8de7c237241a1c18" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36065 } }
I20260806 09:19:43.842204 29323 leader_election.cc:302] T 00000000000000000000000000000000 P f31fd2a5f854456e8de7c237241a1c18 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f31fd2a5f854456e8de7c237241a1c18; no voters:
I20260806 09:19:43.842883 29323 leader_election.cc:288] T 00000000000000000000000000000000 P f31fd2a5f854456e8de7c237241a1c18 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:19:43.843094 29328 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f31fd2a5f854456e8de7c237241a1c18 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:19:43.843976 29328 raft_consensus.cc:686] T 00000000000000000000000000000000 P f31fd2a5f854456e8de7c237241a1c18 [term 1 LEADER]: Becoming Leader. State: Replica: f31fd2a5f854456e8de7c237241a1c18, State: Running, Role: LEADER
I20260806 09:19:43.844591 29328 consensus_queue.cc:237] T 00000000000000000000000000000000 P f31fd2a5f854456e8de7c237241a1c18 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f31fd2a5f854456e8de7c237241a1c18" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36065 } }
I20260806 09:19:43.845235 29323 sys_catalog.cc:564] T 00000000000000000000000000000000 P f31fd2a5f854456e8de7c237241a1c18 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:19:43.847805 29329 sys_catalog.cc:455] T 00000000000000000000000000000000 P f31fd2a5f854456e8de7c237241a1c18 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f31fd2a5f854456e8de7c237241a1c18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f31fd2a5f854456e8de7c237241a1c18" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36065 } } }
I20260806 09:19:43.847776 29330 sys_catalog.cc:455] T 00000000000000000000000000000000 P f31fd2a5f854456e8de7c237241a1c18 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f31fd2a5f854456e8de7c237241a1c18. Latest consensus state: current_term: 1 leader_uuid: "f31fd2a5f854456e8de7c237241a1c18" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f31fd2a5f854456e8de7c237241a1c18" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36065 } } }
I20260806 09:19:43.848562 29329 sys_catalog.cc:458] T 00000000000000000000000000000000 P f31fd2a5f854456e8de7c237241a1c18 [sys.catalog]: This master's current role is: LEADER
I20260806 09:19:43.848591 29330 sys_catalog.cc:458] T 00000000000000000000000000000000 P f31fd2a5f854456e8de7c237241a1c18 [sys.catalog]: This master's current role is: LEADER
I20260806 09:19:43.851233 29334 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:19:43.857239 29334 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:19:43.867632 29334 catalog_manager.cc:1347] Generated new cluster ID: 28a0f4e26ec6474a937105d7248e99d3
I20260806 09:19:43.867780 29334 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:19:43.902338 29334 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:19:43.904382 29334 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:19:43.920243 29334 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f31fd2a5f854456e8de7c237241a1c18: Generated new TSK 0
I20260806 09:19:43.921353 29334 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:19:43.932171 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:36065
--builtin_ntp_servers=127.10.255.84:45319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 09:19:44.301050 29348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:19:44.301446 29348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:19:44.301635 29348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:19:44.309540 29348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:19:44.309719 29348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:19:44.309916 29348 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:19:44.319916 29348 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:45319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:36065
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:44.321363 29348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:44.323465 29348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:19:44.338375 29354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:44.338274 29357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:44.338338 29355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:44.339183 29348 server_base.cc:1034] running on GCE node
I20260806 09:19:44.339967 29348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:44.340978 29348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:44.342243 29348 hybrid_clock.cc:648] HybridClock initialized: now 1786007984342192 us; error 32 us; skew 500 ppm
I20260806 09:19:44.342694 29348 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:19:44.345391 29348 webserver.cc:460] Webserver started at http://127.10.255.65:33989/ using document root <none> and password file <none>
I20260806 09:19:44.346276 29348 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:44.346455 29348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:44.346864 29348 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:19:44.350250 29348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "56ce71b304934fa59d282e79e160ec1c"
format_stamp: "Formatted at 2026-08-06 09:19:44 on dist-test-slave-mvvj"
server_key: "cbe30eed80a77c13a1d30b6d5abf2a55"
server_key_iv: "56ec7a665ac3248d44eee04f1b656996"
server_key_version: "encryptionkey@0"
I20260806 09:19:44.351146 29348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "56ce71b304934fa59d282e79e160ec1c"
format_stamp: "Formatted at 2026-08-06 09:19:44 on dist-test-slave-mvvj"
server_key: "cbe30eed80a77c13a1d30b6d5abf2a55"
server_key_iv: "56ec7a665ac3248d44eee04f1b656996"
server_key_version: "encryptionkey@0"
I20260806 09:19:44.357427 29348 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260806 09:19:44.361627 29363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:44.363232 29348 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 09:19:44.363458 29348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "56ce71b304934fa59d282e79e160ec1c"
format_stamp: "Formatted at 2026-08-06 09:19:44 on dist-test-slave-mvvj"
server_key: "cbe30eed80a77c13a1d30b6d5abf2a55"
server_key_iv: "56ec7a665ac3248d44eee04f1b656996"
server_key_version: "encryptionkey@0"
I20260806 09:19:44.363680 29348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:44.382248 29348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:44.383191 29348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:44.383533 29348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:44.384704 29348 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:19:44.386372 29348 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:19:44.386521 29348 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:44.386648 29348 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:19:44.386715 29348 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:44.423642 29348 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:45097
I20260806 09:19:44.423895 29476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:45097 every 8 connection(s)
I20260806 09:19:44.425181 29348 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:19:44.427706 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 29348
I20260806 09:19:44.427938 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:19:44.428516 11261 external_mini_cluster.cc:1428] Setting key e1c924c7aa8d56398bf921477095007f
I20260806 09:19:44.432049 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:36065
--builtin_ntp_servers=127.10.255.84:45319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 09:19:44.440404 29479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:44.428394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:51723 (local address 127.10.255.126:36065)
0806 09:19:44.429030 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:44.429037 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:44.430484 (+ 1447us) server_negotiation.cc:407] Connection header received
0806 09:19:44.432762 (+ 2278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:44.432768 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:44.432868 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:44.433004 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:44.434274 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:44.435043 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:44.436887 (+ 1844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:44.437337 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:44.437502 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:44.439205 (+ 1703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:44.439211 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:44.439214 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:19:44.439237 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:44.439282 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:19:44.439295 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:44.439410 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:44.439682 (+ 272us) server_negotiation.cc:299] Negotiation successful
0806 09:19:44.439967 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":478,"thread_start_us":334,"threads_started":1}
I20260806 09:19:44.441747 29481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:44.429158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:36065 (local address 127.10.255.65:51723)
0806 09:19:44.430296 (+ 1138us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:44.430347 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:44.432450 (+ 2103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:44.433286 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:44.433296 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:44.433401 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:19:44.434053 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:44.434074 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:44.435245 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:44.435249 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:44.436696 (+ 1447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:44.436712 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:44.437634 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:44.437643 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:44.437901 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:44.438749 (+ 848us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 09:19:44.438751 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:19:44.438806 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 09:19:44.438910 (+ 104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:19:44.439411 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:19:44.439427 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:19:44.439439 (+ 12us) client_negotiation.cc:769] Sending connection context
0806 09:19:44.439667 (+ 228us) client_negotiation.cc:240] Negotiation successful
0806 09:19:44.440355 (+ 688us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":343,"threads_started":1}
I20260806 09:19:44.443960 29477 heartbeater.cc:347] Connected to a master server at 127.10.255.126:36065
I20260806 09:19:44.444329 29477 heartbeater.cc:464] Registering TS with master...
I20260806 09:19:44.445267 29477 heartbeater.cc:511] Master 127.10.255.126:36065 requested a full tablet report, sending...
I20260806 09:19:44.447968 29288 ts_manager.cc:194] Registered new tserver with Master: 56ce71b304934fa59d282e79e160ec1c (127.10.255.65:45097)
I20260806 09:19:44.449879 29288 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.255.65:51723
W20260806 09:19:44.790347 29482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:19:44.790709 29482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:19:44.790886 29482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:19:44.798563 29482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:19:44.798738 29482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:19:44.798967 29482 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:19:44.808992 29482 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:45319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:36065
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:44.810436 29482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:44.812429 29482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:19:44.826614 29487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:44.826653 29488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:44.826577 29490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:44.827463 29482 server_base.cc:1034] running on GCE node
I20260806 09:19:44.828275 29482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:44.829367 29482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:44.830672 29482 hybrid_clock.cc:648] HybridClock initialized: now 1786007984830598 us; error 73 us; skew 500 ppm
I20260806 09:19:44.831022 29482 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:19:44.833802 29482 webserver.cc:460] Webserver started at http://127.10.255.66:43823/ using document root <none> and password file <none>
I20260806 09:19:44.834587 29482 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:44.834736 29482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:44.835088 29482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:19:44.838438 29482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "8d07cadbeb4a496bbba90d2a898f968f"
format_stamp: "Formatted at 2026-08-06 09:19:44 on dist-test-slave-mvvj"
server_key: "b70a0cf9dfa5719e03c85d9e899ffda3"
server_key_iv: "45a69b7040fa0562fa56d2849d75e3ec"
server_key_version: "encryptionkey@0"
I20260806 09:19:44.839387 29482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "8d07cadbeb4a496bbba90d2a898f968f"
format_stamp: "Formatted at 2026-08-06 09:19:44 on dist-test-slave-mvvj"
server_key: "b70a0cf9dfa5719e03c85d9e899ffda3"
server_key_iv: "45a69b7040fa0562fa56d2849d75e3ec"
server_key_version: "encryptionkey@0"
I20260806 09:19:44.845253 29482 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260806 09:19:44.849294 29496 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:44.850894 29482 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 09:19:44.851109 29482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "8d07cadbeb4a496bbba90d2a898f968f"
format_stamp: "Formatted at 2026-08-06 09:19:44 on dist-test-slave-mvvj"
server_key: "b70a0cf9dfa5719e03c85d9e899ffda3"
server_key_iv: "45a69b7040fa0562fa56d2849d75e3ec"
server_key_version: "encryptionkey@0"
I20260806 09:19:44.851361 29482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:44.872113 29482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:44.873104 29482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:44.873458 29482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:44.874560 29482 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:19:44.876262 29482 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:19:44.876391 29482 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:44.876533 29482 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:19:44.876632 29482 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:44.913655 29482 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:35077
I20260806 09:19:44.913713 29608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:35077 every 8 connection(s)
I20260806 09:19:44.915110 29482 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:19:44.921978 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 29482
I20260806 09:19:44.922230 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:19:44.922797 11261 external_mini_cluster.cc:1428] Setting key 9d2026d3f58f5bb429e277b4a3b5d789
I20260806 09:19:44.926543 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:36065
--builtin_ntp_servers=127.10.255.84:45319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 09:19:44.930735 29479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:44.918156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:41783 (local address 127.10.255.126:36065)
0806 09:19:44.918365 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:44.918370 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:44.920147 (+ 1777us) server_negotiation.cc:407] Connection header received
0806 09:19:44.922234 (+ 2087us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:44.922240 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:44.922363 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:44.922495 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:44.923858 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:44.924967 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:44.927551 (+ 2584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:44.928057 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:44.928196 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:44.929942 (+ 1746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:44.929947 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:44.929951 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:19:44.929971 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:44.930012 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:19:44.930024 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:44.930118 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:44.930373 (+ 255us) server_negotiation.cc:299] Negotiation successful
0806 09:19:44.930465 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 09:19:44.932384 29611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:44.918693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:36065 (local address 127.10.255.66:41783)
0806 09:19:44.919904 (+ 1211us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:44.919975 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:44.921932 (+ 1957us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:44.922759 (+ 827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:44.922768 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:44.922863 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:19:44.923642 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:44.923678 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:44.925120 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:44.925124 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:44.927379 (+ 2255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:44.927401 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:44.928332 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:44.928342 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:44.928693 (+ 351us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:44.929531 (+ 838us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 09:19:44.929536 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:19:44.929597 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 09:19:44.929718 (+ 121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:19:44.930130 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:19:44.930144 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:19:44.930156 (+ 12us) client_negotiation.cc:769] Sending connection context
0806 09:19:44.930358 (+ 202us) client_negotiation.cc:240] Negotiation successful
0806 09:19:44.930849 (+ 491us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638,"thread_start_us":411,"threads_started":1}
I20260806 09:19:44.934006 29609 heartbeater.cc:347] Connected to a master server at 127.10.255.126:36065
I20260806 09:19:44.934348 29609 heartbeater.cc:464] Registering TS with master...
I20260806 09:19:44.935221 29609 heartbeater.cc:511] Master 127.10.255.126:36065 requested a full tablet report, sending...
I20260806 09:19:44.936831 29288 ts_manager.cc:194] Registered new tserver with Master: 8d07cadbeb4a496bbba90d2a898f968f (127.10.255.66:35077)
I20260806 09:19:44.938115 29288 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.255.66:41783
W20260806 09:19:45.299739 29612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:19:45.300240 29612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:19:45.300406 29612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:19:45.309726 29612 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:19:45.309908 29612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:19:45.310099 29612 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:19:45.320205 29612 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:45319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:36065
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:45.321683 29612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:45.323639 29612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:19:45.338887 29619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:45.338927 29621 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:45.339190 29618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:45.340202 29612 server_base.cc:1034] running on GCE node
I20260806 09:19:45.340909 29612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:45.341981 29612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:45.343225 29612 hybrid_clock.cc:648] HybridClock initialized: now 1786007985343178 us; error 39 us; skew 500 ppm
I20260806 09:19:45.343544 29612 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:19:45.346475 29612 webserver.cc:460] Webserver started at http://127.10.255.67:39821/ using document root <none> and password file <none>
I20260806 09:19:45.347231 29612 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:45.347327 29612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:45.347608 29612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:19:45.350842 29612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "33e098b3e2d34f518c6e04040d8b55fd"
format_stamp: "Formatted at 2026-08-06 09:19:45 on dist-test-slave-mvvj"
server_key: "99265ac51d9e86d65894cd36c7efb448"
server_key_iv: "c355f9e6726defc5335151fd30d6ef9b"
server_key_version: "encryptionkey@0"
I20260806 09:19:45.351697 29612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "33e098b3e2d34f518c6e04040d8b55fd"
format_stamp: "Formatted at 2026-08-06 09:19:45 on dist-test-slave-mvvj"
server_key: "99265ac51d9e86d65894cd36c7efb448"
server_key_iv: "c355f9e6726defc5335151fd30d6ef9b"
server_key_version: "encryptionkey@0"
I20260806 09:19:45.357831 29612 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260806 09:19:45.362162 29628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:45.364012 29612 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:19:45.364194 29612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "33e098b3e2d34f518c6e04040d8b55fd"
format_stamp: "Formatted at 2026-08-06 09:19:45 on dist-test-slave-mvvj"
server_key: "99265ac51d9e86d65894cd36c7efb448"
server_key_iv: "c355f9e6726defc5335151fd30d6ef9b"
server_key_version: "encryptionkey@0"
I20260806 09:19:45.364418 29612 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:45.385547 29612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:45.386462 29612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:45.386771 29612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:45.388008 29612 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:19:45.389640 29612 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:19:45.389743 29612 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:45.389824 29612 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:19:45.389881 29612 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:45.427421 29612 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:41237
I20260806 09:19:45.427469 29740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:41237 every 8 connection(s)
I20260806 09:19:45.429347 29612 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:19:45.438592 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 29612
I20260806 09:19:45.438809 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:19:45.439395 11261 external_mini_cluster.cc:1428] Setting key b30c70ef37b4acfc72bee71cedc59e62
I20260806 09:19:45.444206 29743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:45.432519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:48887 (local address 127.10.255.126:36065)
0806 09:19:45.433077 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:45.433082 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:45.434133 (+ 1051us) server_negotiation.cc:407] Connection header received
0806 09:19:45.436470 (+ 2337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:45.436478 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:45.436592 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:45.436732 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:45.438008 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.439336 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.441205 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.441633 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.441773 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:45.443219 (+ 1446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:45.443224 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:45.443228 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:19:45.443246 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:45.443287 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:19:45.443299 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:45.443398 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:45.443686 (+ 288us) server_negotiation.cc:299] Negotiation successful
0806 09:19:45.443790 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":296,"threads_started":1}
I20260806 09:19:45.445303 29744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:45.432915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:36065 (local address 127.10.255.67:48887)
0806 09:19:45.433932 (+ 1017us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:45.433990 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:45.436129 (+ 2139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:45.437016 (+ 887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:45.437026 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:45.437132 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:19:45.437789 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:45.437808 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.439578 (+ 1770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.439583 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:45.441042 (+ 1459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:45.441058 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.441889 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.441896 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:45.442150 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:45.442856 (+ 706us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 09:19:45.442859 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:19:45.442902 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 09:19:45.442992 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:19:45.443399 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:19:45.443413 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:19:45.443424 (+ 11us) client_negotiation.cc:769] Sending connection context
0806 09:19:45.443679 (+ 255us) client_negotiation.cc:240] Negotiation successful
0806 09:19:45.444152 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":298,"threads_started":1}
I20260806 09:19:45.446918 29741 heartbeater.cc:347] Connected to a master server at 127.10.255.126:36065
I20260806 09:19:45.447300 29741 heartbeater.cc:464] Registering TS with master...
I20260806 09:19:45.448351 29741 heartbeater.cc:511] Master 127.10.255.126:36065 requested a full tablet report, sending...
I20260806 09:19:45.450197 29288 ts_manager.cc:194] Registered new tserver with Master: 33e098b3e2d34f518c6e04040d8b55fd (127.10.255.67:41237)
I20260806 09:19:45.451081 29288 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.255.67:48887
I20260806 09:19:45.454814 29477 heartbeater.cc:503] Master 127.10.255.126:36065 was elected leader, sending a full tablet report...
I20260806 09:19:45.455853 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 09:19:45.470054 29743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:45.462998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40394 (local address 127.10.255.126:36065)
0806 09:19:45.463310 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:45.463347 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:45.463932 (+ 585us) server_negotiation.cc:407] Connection header received
0806 09:19:45.464155 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:45.464159 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:45.464231 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:45.464328 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:45.464888 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.465707 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.467225 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.467691 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.467940 (+ 249us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:45.469160 (+ 1220us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:45.469165 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:45.469169 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:19:45.469192 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:45.469229 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:19:45.469242 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:45.469353 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:45.469616 (+ 263us) server_negotiation.cc:299] Negotiation successful
0806 09:19:45.469735 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260806 09:19:45.474779 29288 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40394:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:19:45.482467 29288 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:19:45.526546 29757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:45.496453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50960 (local address 127.10.255.65:45097)
0806 09:19:45.518508 (+ 22055us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:45.518515 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:45.518543 (+ 28us) server_negotiation.cc:407] Connection header received
0806 09:19:45.518628 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:45.518635 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:45.518859 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:45.519131 (+ 272us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:45.519909 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.521430 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.523867 (+ 2437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.524948 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.525116 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:45.525468 (+ 352us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:45.525926 (+ 458us) server_negotiation.cc:299] Negotiation successful
0806 09:19:45.526157 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21856,"thread_start_us":22920,"threads_started":1}
I20260806 09:19:45.527402 29758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:45.495631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:45097 (local address 127.0.0.1:50960)
0806 09:19:45.517412 (+ 21781us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:45.517444 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:45.517585 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:45.519170 (+ 1585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:45.519177 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:45.519215 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:45.519625 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:45.519645 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.521585 (+ 1940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.521591 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:45.523627 (+ 2036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:45.523641 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.525177 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.525184 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:45.525623 (+ 439us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:45.525671 (+ 48us) client_negotiation.cc:769] Sending connection context
0806 09:19:45.525839 (+ 168us) client_negotiation.cc:240] Negotiation successful
0806 09:19:45.526470 (+ 631us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21624,"mutex_wait_us":147,"thread_start_us":20297,"threads_started":1}
I20260806 09:19:45.528685 29755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:45.495577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:41237 (local address 127.0.0.1:42900)
0806 09:19:45.516556 (+ 20979us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:45.516630 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:45.516859 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:45.520782 (+ 3923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:45.520790 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:45.520821 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:45.521238 (+ 417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:45.521250 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.522666 (+ 1416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.522676 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:45.525624 (+ 2948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:45.525640 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.527910 (+ 2270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.527917 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:45.528108 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:45.528146 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 09:19:45.528239 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 09:19:45.528379 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20525,"mutex_wait_us":297,"thread_start_us":21677,"threads_started":1}
I20260806 09:19:45.529435 29756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:45.496179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42900 (local address 127.10.255.67:41237)
0806 09:19:45.520142 (+ 23963us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:45.520152 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:45.520190 (+ 38us) server_negotiation.cc:407] Connection header received
0806 09:19:45.520304 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:45.520315 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:45.520573 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:45.520756 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:45.521462 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.522498 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.525847 (+ 3349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.527317 (+ 1470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.527468 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:45.527742 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:45.528958 (+ 1216us) server_negotiation.cc:299] Negotiation successful
0806 09:19:45.529158 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23746,"thread_start_us":23543,"threads_started":1}
I20260806 09:19:45.529924 29754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:45.497416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:35077 (local address 127.0.0.1:50878)
0806 09:19:45.517629 (+ 20213us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:45.517657 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:45.517783 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:45.520407 (+ 2624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:45.520412 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:45.520434 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:45.520831 (+ 397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:45.520845 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.522766 (+ 1921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.522770 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:45.525557 (+ 2787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:45.525588 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.528962 (+ 3374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.528969 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:45.529158 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:45.529191 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 09:19:45.529286 (+ 95us) client_negotiation.cc:240] Negotiation successful
0806 09:19:45.529445 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20040,"mutex_wait_us":193,"thread_start_us":20442,"threads_started":1}
I20260806 09:19:45.531178 29759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:45.498099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50878 (local address 127.10.255.66:35077)
0806 09:19:45.518531 (+ 20432us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:45.518541 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:45.518595 (+ 54us) server_negotiation.cc:407] Connection header received
0806 09:19:45.518720 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:45.518732 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:45.519036 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:45.520150 (+ 1114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:45.521083 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.522619 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.525814 (+ 3195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.528251 (+ 2437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.528497 (+ 246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:45.530342 (+ 1845us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:45.530465 (+ 123us) server_negotiation.cc:299] Negotiation successful
0806 09:19:45.530701 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20257,"thread_start_us":20128,"threads_started":1}
I20260806 09:19:45.532553 29411 tablet_service.cc:1467] Processing CreateTablet for tablet a239b0c95a994a1b9937a315400513f9 (DEFAULT_TABLE table=test-table [id=3018b951b4b84a6ebceffe9d00808314]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:19:45.533432 29676 tablet_service.cc:1467] Processing CreateTablet for tablet a239b0c95a994a1b9937a315400513f9 (DEFAULT_TABLE table=test-table [id=3018b951b4b84a6ebceffe9d00808314]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:19:45.534247 29411 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a239b0c95a994a1b9937a315400513f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:19:45.534866 29676 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a239b0c95a994a1b9937a315400513f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:19:45.534781 29544 tablet_service.cc:1467] Processing CreateTablet for tablet a239b0c95a994a1b9937a315400513f9 (DEFAULT_TABLE table=test-table [id=3018b951b4b84a6ebceffe9d00808314]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:19:45.536310 29544 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a239b0c95a994a1b9937a315400513f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:19:45.546967 29760 tablet_bootstrap.cc:492] T a239b0c95a994a1b9937a315400513f9 P 33e098b3e2d34f518c6e04040d8b55fd: Bootstrap starting.
I20260806 09:19:45.551501 29761 tablet_bootstrap.cc:492] T a239b0c95a994a1b9937a315400513f9 P 56ce71b304934fa59d282e79e160ec1c: Bootstrap starting.
I20260806 09:19:45.551577 29760 tablet_bootstrap.cc:654] T a239b0c95a994a1b9937a315400513f9 P 33e098b3e2d34f518c6e04040d8b55fd: Neither blocks nor log segments found. Creating new log.
I20260806 09:19:45.553167 29760 log.cc:824] T a239b0c95a994a1b9937a315400513f9 P 33e098b3e2d34f518c6e04040d8b55fd: Log is configured to *not* fsync() on all Append() calls
I20260806 09:19:45.554970 29762 tablet_bootstrap.cc:492] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f: Bootstrap starting.
I20260806 09:19:45.555960 29761 tablet_bootstrap.cc:654] T a239b0c95a994a1b9937a315400513f9 P 56ce71b304934fa59d282e79e160ec1c: Neither blocks nor log segments found. Creating new log.
I20260806 09:19:45.556951 29760 tablet_bootstrap.cc:492] T a239b0c95a994a1b9937a315400513f9 P 33e098b3e2d34f518c6e04040d8b55fd: No bootstrap required, opened a new log
I20260806 09:19:45.557248 29760 ts_tablet_manager.cc:1397] T a239b0c95a994a1b9937a315400513f9 P 33e098b3e2d34f518c6e04040d8b55fd: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.001s
I20260806 09:19:45.557386 29761 log.cc:824] T a239b0c95a994a1b9937a315400513f9 P 56ce71b304934fa59d282e79e160ec1c: Log is configured to *not* fsync() on all Append() calls
I20260806 09:19:45.559494 29762 tablet_bootstrap.cc:654] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f: Neither blocks nor log segments found. Creating new log.
I20260806 09:19:45.560840 29762 log.cc:824] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f: Log is configured to *not* fsync() on all Append() calls
I20260806 09:19:45.561478 29761 tablet_bootstrap.cc:492] T a239b0c95a994a1b9937a315400513f9 P 56ce71b304934fa59d282e79e160ec1c: No bootstrap required, opened a new log
I20260806 09:19:45.561784 29761 ts_tablet_manager.cc:1397] T a239b0c95a994a1b9937a315400513f9 P 56ce71b304934fa59d282e79e160ec1c: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260806 09:19:45.566470 29760 raft_consensus.cc:348] T a239b0c95a994a1b9937a315400513f9 P 33e098b3e2d34f518c6e04040d8b55fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e098b3e2d34f518c6e04040d8b55fd" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 41237 } } peers { permanent_uuid: "56ce71b304934fa59d282e79e160ec1c" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45097 } } peers { permanent_uuid: "8d07cadbeb4a496bbba90d2a898f968f" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35077 } }
I20260806 09:19:45.566910 29760 raft_consensus.cc:374] T a239b0c95a994a1b9937a315400513f9 P 33e098b3e2d34f518c6e04040d8b55fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:19:45.567020 29760 raft_consensus.cc:729] T a239b0c95a994a1b9937a315400513f9 P 33e098b3e2d34f518c6e04040d8b55fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33e098b3e2d34f518c6e04040d8b55fd, State: Initialized, Role: FOLLOWER
I20260806 09:19:45.567076 29762 tablet_bootstrap.cc:492] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f: No bootstrap required, opened a new log
I20260806 09:19:45.567394 29762 ts_tablet_manager.cc:1397] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20260806 09:19:45.567889 29760 consensus_queue.cc:260] T a239b0c95a994a1b9937a315400513f9 P 33e098b3e2d34f518c6e04040d8b55fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e098b3e2d34f518c6e04040d8b55fd" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 41237 } } peers { permanent_uuid: "56ce71b304934fa59d282e79e160ec1c" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45097 } } peers { permanent_uuid: "8d07cadbeb4a496bbba90d2a898f968f" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35077 } }
I20260806 09:19:45.569449 29741 heartbeater.cc:503] Master 127.10.255.126:36065 was elected leader, sending a full tablet report...
I20260806 09:19:45.570107 29760 ts_tablet_manager.cc:1428] T a239b0c95a994a1b9937a315400513f9 P 33e098b3e2d34f518c6e04040d8b55fd: Time spent starting tablet: real 0.013s user 0.006s sys 0.007s
I20260806 09:19:45.573014 29761 raft_consensus.cc:348] T a239b0c95a994a1b9937a315400513f9 P 56ce71b304934fa59d282e79e160ec1c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e098b3e2d34f518c6e04040d8b55fd" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 41237 } } peers { permanent_uuid: "56ce71b304934fa59d282e79e160ec1c" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45097 } } peers { permanent_uuid: "8d07cadbeb4a496bbba90d2a898f968f" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35077 } }
I20260806 09:19:45.573530 29761 raft_consensus.cc:374] T a239b0c95a994a1b9937a315400513f9 P 56ce71b304934fa59d282e79e160ec1c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:19:45.573635 29761 raft_consensus.cc:729] T a239b0c95a994a1b9937a315400513f9 P 56ce71b304934fa59d282e79e160ec1c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56ce71b304934fa59d282e79e160ec1c, State: Initialized, Role: FOLLOWER
I20260806 09:19:45.574415 29761 consensus_queue.cc:260] T a239b0c95a994a1b9937a315400513f9 P 56ce71b304934fa59d282e79e160ec1c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e098b3e2d34f518c6e04040d8b55fd" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 41237 } } peers { permanent_uuid: "56ce71b304934fa59d282e79e160ec1c" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45097 } } peers { permanent_uuid: "8d07cadbeb4a496bbba90d2a898f968f" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35077 } }
I20260806 09:19:45.576459 29761 ts_tablet_manager.cc:1428] T a239b0c95a994a1b9937a315400513f9 P 56ce71b304934fa59d282e79e160ec1c: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260806 09:19:45.581254 29762 raft_consensus.cc:348] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e098b3e2d34f518c6e04040d8b55fd" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 41237 } } peers { permanent_uuid: "56ce71b304934fa59d282e79e160ec1c" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45097 } } peers { permanent_uuid: "8d07cadbeb4a496bbba90d2a898f968f" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35077 } }
I20260806 09:19:45.581727 29762 raft_consensus.cc:374] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:19:45.581878 29762 raft_consensus.cc:729] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d07cadbeb4a496bbba90d2a898f968f, State: Initialized, Role: FOLLOWER
I20260806 09:19:45.582506 29762 consensus_queue.cc:260] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e098b3e2d34f518c6e04040d8b55fd" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 41237 } } peers { permanent_uuid: "56ce71b304934fa59d282e79e160ec1c" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45097 } } peers { permanent_uuid: "8d07cadbeb4a496bbba90d2a898f968f" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35077 } }
I20260806 09:19:45.584491 29762 ts_tablet_manager.cc:1428] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f: Time spent starting tablet: real 0.017s user 0.012s sys 0.004s
I20260806 09:19:45.584522 29609 heartbeater.cc:503] Master 127.10.255.126:36065 was elected leader, sending a full tablet report...
W20260806 09:19:45.667472 29610 tablet.cc:2369] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 09:19:45.678035 29478 tablet.cc:2369] T a239b0c95a994a1b9937a315400513f9 P 56ce71b304934fa59d282e79e160ec1c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 09:19:45.681483 29742 tablet.cc:2369] T a239b0c95a994a1b9937a315400513f9 P 33e098b3e2d34f518c6e04040d8b55fd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:19:45.719403 29769 raft_consensus.cc:482] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:19:45.719940 29769 raft_consensus.cc:504] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e098b3e2d34f518c6e04040d8b55fd" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 41237 } } peers { permanent_uuid: "56ce71b304934fa59d282e79e160ec1c" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45097 } } peers { permanent_uuid: "8d07cadbeb4a496bbba90d2a898f968f" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35077 } }
I20260806 09:19:45.721825 29769 leader_election.cc:288] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 33e098b3e2d34f518c6e04040d8b55fd (127.10.255.67:41237), 56ce71b304934fa59d282e79e160ec1c (127.10.255.65:45097)
I20260806 09:19:45.728868 29756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:45.722451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:52407 (local address 127.10.255.67:41237)
0806 09:19:45.722666 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:45.722672 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:45.723274 (+ 602us) server_negotiation.cc:407] Connection header received
0806 09:19:45.723558 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:45.723563 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:45.723626 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:45.723735 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:45.724370 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.725119 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.727000 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.727896 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.728104 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:45.728185 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:45.728472 (+ 287us) server_negotiation.cc:299] Negotiation successful
0806 09:19:45.728614 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 09:19:45.729187 29770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:45.722251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:41237 (local address 127.10.255.66:52407)
0806 09:19:45.723134 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:45.723151 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:45.723369 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:45.723759 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:45.723763 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:45.723790 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:45.724213 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:45.724224 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.725269 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.725275 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:45.726786 (+ 1511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:45.726799 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.728124 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.728130 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:45.728299 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:45.728324 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 09:19:45.728441 (+ 117us) client_negotiation.cc:240] Negotiation successful
0806 09:19:45.728586 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":763,"mutex_wait_us":1,"thread_start_us":527,"threads_started":1}
I20260806 09:19:45.730144 29757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:45.722368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:50663 (local address 127.10.255.65:45097)
0806 09:19:45.722591 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:45.722599 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:45.723801 (+ 1202us) server_negotiation.cc:407] Connection header received
0806 09:19:45.724093 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:45.724107 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:45.724190 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:45.724304 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:45.724879 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.725657 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.727882 (+ 2225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.728795 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.728997 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:45.729073 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:45.729715 (+ 642us) server_negotiation.cc:299] Negotiation successful
0806 09:19:45.729865 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260806 09:19:45.730255 29771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:45.722372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:45097 (local address 127.10.255.66:50663)
0806 09:19:45.723652 (+ 1280us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:45.723679 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:45.723915 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:45.724329 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:45.724334 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:45.724361 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:45.724711 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:45.724720 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.725839 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.725845 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:45.727637 (+ 1792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:45.727651 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.729282 (+ 1631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.729294 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:45.729536 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:45.729562 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 09:19:45.729683 (+ 121us) client_negotiation.cc:240] Negotiation successful
0806 09:19:45.729828 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1174,"mutex_wait_us":3,"thread_start_us":854,"threads_started":1}
I20260806 09:19:45.730321 29696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a239b0c95a994a1b9937a315400513f9" candidate_uuid: "8d07cadbeb4a496bbba90d2a898f968f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e098b3e2d34f518c6e04040d8b55fd" is_pre_election: true
I20260806 09:19:45.730999 29696 raft_consensus.cc:2454] T a239b0c95a994a1b9937a315400513f9 P 33e098b3e2d34f518c6e04040d8b55fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d07cadbeb4a496bbba90d2a898f968f in term 0.
I20260806 09:19:45.731451 29431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a239b0c95a994a1b9937a315400513f9" candidate_uuid: "8d07cadbeb4a496bbba90d2a898f968f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56ce71b304934fa59d282e79e160ec1c" is_pre_election: true
I20260806 09:19:45.731927 29498 leader_election.cc:302] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e098b3e2d34f518c6e04040d8b55fd, 8d07cadbeb4a496bbba90d2a898f968f; no voters:
I20260806 09:19:45.732125 29431 raft_consensus.cc:2454] T a239b0c95a994a1b9937a315400513f9 P 56ce71b304934fa59d282e79e160ec1c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8d07cadbeb4a496bbba90d2a898f968f in term 0.
I20260806 09:19:45.732448 29769 raft_consensus.cc:2781] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:19:45.732646 29769 raft_consensus.cc:482] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:19:45.732813 29769 raft_consensus.cc:3037] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:19:45.736040 29769 raft_consensus.cc:504] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e098b3e2d34f518c6e04040d8b55fd" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 41237 } } peers { permanent_uuid: "56ce71b304934fa59d282e79e160ec1c" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45097 } } peers { permanent_uuid: "8d07cadbeb4a496bbba90d2a898f968f" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35077 } }
I20260806 09:19:45.736809 29769 leader_election.cc:288] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f [CANDIDATE]: Term 1 election: Requested vote from peers 33e098b3e2d34f518c6e04040d8b55fd (127.10.255.67:41237), 56ce71b304934fa59d282e79e160ec1c (127.10.255.65:45097)
I20260806 09:19:45.737450 29696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a239b0c95a994a1b9937a315400513f9" candidate_uuid: "8d07cadbeb4a496bbba90d2a898f968f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33e098b3e2d34f518c6e04040d8b55fd"
I20260806 09:19:45.737440 29431 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a239b0c95a994a1b9937a315400513f9" candidate_uuid: "8d07cadbeb4a496bbba90d2a898f968f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "56ce71b304934fa59d282e79e160ec1c"
I20260806 09:19:45.737715 29431 raft_consensus.cc:3037] T a239b0c95a994a1b9937a315400513f9 P 56ce71b304934fa59d282e79e160ec1c [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:19:45.737715 29696 raft_consensus.cc:3037] T a239b0c95a994a1b9937a315400513f9 P 33e098b3e2d34f518c6e04040d8b55fd [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:19:45.741540 29431 raft_consensus.cc:2454] T a239b0c95a994a1b9937a315400513f9 P 56ce71b304934fa59d282e79e160ec1c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d07cadbeb4a496bbba90d2a898f968f in term 1.
I20260806 09:19:45.741544 29696 raft_consensus.cc:2454] T a239b0c95a994a1b9937a315400513f9 P 33e098b3e2d34f518c6e04040d8b55fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8d07cadbeb4a496bbba90d2a898f968f in term 1.
I20260806 09:19:45.742151 29498 leader_election.cc:302] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33e098b3e2d34f518c6e04040d8b55fd, 8d07cadbeb4a496bbba90d2a898f968f; no voters:
I20260806 09:19:45.742571 29769 raft_consensus.cc:2781] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:19:45.743098 29769 raft_consensus.cc:686] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f [term 1 LEADER]: Becoming Leader. State: Replica: 8d07cadbeb4a496bbba90d2a898f968f, State: Running, Role: LEADER
I20260806 09:19:45.743659 29769 consensus_queue.cc:237] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e098b3e2d34f518c6e04040d8b55fd" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 41237 } } peers { permanent_uuid: "56ce71b304934fa59d282e79e160ec1c" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45097 } } peers { permanent_uuid: "8d07cadbeb4a496bbba90d2a898f968f" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35077 } }
I20260806 09:19:45.749094 29288 catalog_manager.cc:5495] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8d07cadbeb4a496bbba90d2a898f968f (127.10.255.66). New cstate: current_term: 1 leader_uuid: "8d07cadbeb4a496bbba90d2a898f968f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "33e098b3e2d34f518c6e04040d8b55fd" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 41237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "56ce71b304934fa59d282e79e160ec1c" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8d07cadbeb4a496bbba90d2a898f968f" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35077 } health_report { overall_health: HEALTHY } } }
I20260806 09:19:45.809461 29759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:45.802421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50880 (local address 127.10.255.66:35077)
0806 09:19:45.802691 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:45.802696 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:45.802746 (+ 50us) server_negotiation.cc:407] Connection header received
0806 09:19:45.802988 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:45.802992 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:45.803093 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:45.803247 (+ 154us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:19:45.803727 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.804606 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.806780 (+ 2174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.807250 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.807364 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:45.808089 (+ 725us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:19:45.808764 (+ 675us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:19:45.808881 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:45.809032 (+ 151us) server_negotiation.cc:299] Negotiation successful
0806 09:19:45.809128 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260806 09:19:45.819773 29431 raft_consensus.cc:1261] T a239b0c95a994a1b9937a315400513f9 P 56ce71b304934fa59d282e79e160ec1c [term 1 FOLLOWER]: Refusing update from remote peer 8d07cadbeb4a496bbba90d2a898f968f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:19:45.819985 29696 raft_consensus.cc:1261] T a239b0c95a994a1b9937a315400513f9 P 33e098b3e2d34f518c6e04040d8b55fd [term 1 FOLLOWER]: Refusing update from remote peer 8d07cadbeb4a496bbba90d2a898f968f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:19:45.821139 29772 consensus_queue.cc:1035] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f [LEADER]: Connected to new peer: Peer: permanent_uuid: "56ce71b304934fa59d282e79e160ec1c" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 45097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:19:45.821528 29769 consensus_queue.cc:1035] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f [LEADER]: Connected to new peer: Peer: permanent_uuid: "33e098b3e2d34f518c6e04040d8b55fd" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 41237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:19:45.835276 29775 mvcc.cc:205] Tried to move back new op lower bound from 7315488709905985536 to 7315488709610700800. Current Snapshot: MvccSnapshot[applied={T|T < 7315488709905985536}]
I20260806 09:19:45.852263 29287 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40394:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:19:45.852610 29287 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40394:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:19:45.857251 29287 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f31fd2a5f854456e8de7c237241a1c18: Sending DeleteTablet for 3 replicas of tablet a239b0c95a994a1b9937a315400513f9
I20260806 09:19:45.858705 29676 tablet_service.cc:1514] Processing DeleteTablet for tablet a239b0c95a994a1b9937a315400513f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:19:45 UTC) from {username='slave'} at 127.0.0.1:42900
I20260806 09:19:45.858704 29411 tablet_service.cc:1514] Processing DeleteTablet for tablet a239b0c95a994a1b9937a315400513f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:19:45 UTC) from {username='slave'} at 127.0.0.1:50960
I20260806 09:19:45.859588 29544 tablet_service.cc:1514] Processing DeleteTablet for tablet a239b0c95a994a1b9937a315400513f9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:19:45 UTC) from {username='slave'} at 127.0.0.1:50878
I20260806 09:19:45.860837 29787 tablet_replica.cc:330] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f: stopping tablet replica
I20260806 09:19:45.861387 29787 raft_consensus.cc:2229] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:19:45.862251 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 29348
I20260806 09:19:45.862273 29787 raft_consensus.cc:2258] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:19:45.873555 29787 ts_tablet_manager.cc:1905] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:19:45.875365 29785 tablet_replica.cc:330] T a239b0c95a994a1b9937a315400513f9 P 33e098b3e2d34f518c6e04040d8b55fd: stopping tablet replica
I20260806 09:19:45.876052 29785 raft_consensus.cc:2229] T a239b0c95a994a1b9937a315400513f9 P 33e098b3e2d34f518c6e04040d8b55fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:19:45.876782 29785 raft_consensus.cc:2258] T a239b0c95a994a1b9937a315400513f9 P 33e098b3e2d34f518c6e04040d8b55fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:19:45.878095 29786 tablet_replica.cc:330] T a239b0c95a994a1b9937a315400513f9 P 56ce71b304934fa59d282e79e160ec1c: stopping tablet replica
I20260806 09:19:45.878628 29786 raft_consensus.cc:2229] T a239b0c95a994a1b9937a315400513f9 P 56ce71b304934fa59d282e79e160ec1c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:19:45.879483 29786 raft_consensus.cc:2258] T a239b0c95a994a1b9937a315400513f9 P 56ce71b304934fa59d282e79e160ec1c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:19:45.881052 29785 ts_tablet_manager.cc:1905] T a239b0c95a994a1b9937a315400513f9 P 33e098b3e2d34f518c6e04040d8b55fd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:19:45.883173 29786 ts_tablet_manager.cc:1905] T a239b0c95a994a1b9937a315400513f9 P 56ce71b304934fa59d282e79e160ec1c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:19:45.888873 29785 ts_tablet_manager.cc:1918] T a239b0c95a994a1b9937a315400513f9 P 33e098b3e2d34f518c6e04040d8b55fd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:19:45.889199 29785 log.cc:1196] T a239b0c95a994a1b9937a315400513f9 P 33e098b3e2d34f518c6e04040d8b55fd: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/a239b0c95a994a1b9937a315400513f9
I20260806 09:19:45.889894 29785 ts_tablet_manager.cc:1939] T a239b0c95a994a1b9937a315400513f9 P 33e098b3e2d34f518c6e04040d8b55fd: Deleting consensus metadata
I20260806 09:19:45.890496 29787 ts_tablet_manager.cc:1918] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:19:45.890718 29787 log.cc:1196] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/a239b0c95a994a1b9937a315400513f9
I20260806 09:19:45.890847 29786 ts_tablet_manager.cc:1918] T a239b0c95a994a1b9937a315400513f9 P 56ce71b304934fa59d282e79e160ec1c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:19:45.891083 29786 log.cc:1196] T a239b0c95a994a1b9937a315400513f9 P 56ce71b304934fa59d282e79e160ec1c: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786007647474472-11261-0/minicluster-data/ts-0/wal/wals/a239b0c95a994a1b9937a315400513f9
I20260806 09:19:45.891369 29787 ts_tablet_manager.cc:1939] T a239b0c95a994a1b9937a315400513f9 P 8d07cadbeb4a496bbba90d2a898f968f: Deleting consensus metadata
I20260806 09:19:45.891701 29786 ts_tablet_manager.cc:1939] T a239b0c95a994a1b9937a315400513f9 P 56ce71b304934fa59d282e79e160ec1c: Deleting consensus metadata
I20260806 09:19:45.892781 29273 catalog_manager.cc:4841] TS 33e098b3e2d34f518c6e04040d8b55fd (127.10.255.67:41237): tablet a239b0c95a994a1b9937a315400513f9 (table test-table [id=3018b951b4b84a6ebceffe9d00808314]) successfully deleted
I20260806 09:19:45.893301 29272 catalog_manager.cc:4841] TS 8d07cadbeb4a496bbba90d2a898f968f (127.10.255.66:35077): tablet a239b0c95a994a1b9937a315400513f9 (table test-table [id=3018b951b4b84a6ebceffe9d00808314]) successfully deleted
I20260806 09:19:45.893823 29275 catalog_manager.cc:4841] TS 56ce71b304934fa59d282e79e160ec1c (127.10.255.65:45097): tablet a239b0c95a994a1b9937a315400513f9 (table test-table [id=3018b951b4b84a6ebceffe9d00808314]) successfully deleted
I20260806 09:19:45.896350 29757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:45.863722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50974 (local address 127.10.255.65:45097)
0806 09:19:45.863954 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:45.863962 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:45.878458 (+ 14496us) server_negotiation.cc:407] Connection header received
0806 09:19:45.878765 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:45.878771 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:45.878893 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:45.879016 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:45.879938 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.881223 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.886346 (+ 5123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:45.887050 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:45.887171 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:45.894814 (+ 7643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:45.894824 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:45.894839 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:19:45.895442 (+ 603us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:45.895505 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:19:45.895534 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:45.895653 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:45.895944 (+ 291us) server_negotiation.cc:299] Negotiation successful
0806 09:19:45.896085 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 09:19:45.897177 29471 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:46.033034 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 29348
I20260806 09:19:46.052827 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 29482
I20260806 09:19:46.062453 29759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:46.053838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50896 (local address 127.10.255.66:35077)
0806 09:19:46.054081 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:46.054086 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:46.054105 (+ 19us) server_negotiation.cc:407] Connection header received
0806 09:19:46.054221 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:46.054225 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:46.054322 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:46.054410 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:46.055119 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:46.056318 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:46.058422 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:46.059085 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:46.059212 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:46.060640 (+ 1428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:46.060655 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:46.060670 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:19:46.061540 (+ 870us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:46.061596 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:19:46.061620 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:46.061718 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:46.061912 (+ 194us) server_negotiation.cc:299] Negotiation successful
0806 09:19:46.062043 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 09:19:46.063273 29604 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:46.180773 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 29482
I20260806 09:19:46.202250 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 29612
I20260806 09:19:46.210009 29756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:46.203043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42902 (local address 127.10.255.67:41237)
0806 09:19:46.203217 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:46.203222 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:46.203305 (+ 83us) server_negotiation.cc:407] Connection header received
0806 09:19:46.203497 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:46.203502 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:46.203599 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:46.203691 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:46.204197 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:46.204960 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:46.206673 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:46.207095 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:46.207206 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:46.208540 (+ 1334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:46.208550 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:46.208565 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:19:46.209180 (+ 615us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:46.209236 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:19:46.209265 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:46.209362 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:46.209609 (+ 247us) server_negotiation.cc:299] Negotiation successful
0806 09:19:46.209729 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 09:19:46.210821 29736 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:46.305234 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 29612
I20260806 09:19:46.324911 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 29256
I20260806 09:19:46.326210 29318 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:46.441632 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 29256
2026-08-06T09:19:46Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (3205 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:19:46 dist-test-slave-mvvj krb5kdc[29795](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:19:46 dist-test-slave-mvvj krb5kdc[29795](info): set up 2 sockets
Aug 06 09:19:46 dist-test-slave-mvvj krb5kdc[29795](info): commencing operation
krb5kdc: starting...
W20260806 09:19:47.586905 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.000s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:19:47 dist-test-slave-mvvj krb5kdc[29795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007987, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:19:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:19:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:19:47.886467 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:39795
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:39795
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:19:48.264048 29808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:19:48.264389 29808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:19:48.264566 29808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:19:48.272459 29808 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:19:48.272589 29808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:19:48.272686 29808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:19:48.272776 29808 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:19:48.272861 29808 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:19:48.283550 29808 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:39795
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:39795
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:48.285053 29808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:48.286515 29808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:19:48.299978 29814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:48.300123 29816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:48.300005 29813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:48.300979 29808 server_base.cc:1034] running on GCE node
I20260806 09:19:48.301883 29808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:48.303489 29808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:48.304752 29808 hybrid_clock.cc:648] HybridClock initialized: now 1786007988304688 us; error 45 us; skew 500 ppm
I20260806 09:19:48.305235 29808 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:19:48 dist-test-slave-mvvj krb5kdc[29795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007988, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:19:48.309250 29808 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:19:48.311280 29808 webserver.cc:460] Webserver started at http://127.10.255.126:41701/ using document root <none> and password file <none>
I20260806 09:19:48.312290 29808 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:48.312476 29808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:48.312922 29808 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:19:48.316872 29808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "b6dc1cbfe14e45258129090e41e9d44f"
format_stamp: "Formatted at 2026-08-06 09:19:48 on dist-test-slave-mvvj"
server_key: "60ba60de856f070b7a73dd066719a5d5"
server_key_iv: "a172ce272a87ac93b8acf883f19cf5d5"
server_key_version: "encryptionkey@0"
I20260806 09:19:48.317962 29808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "b6dc1cbfe14e45258129090e41e9d44f"
format_stamp: "Formatted at 2026-08-06 09:19:48 on dist-test-slave-mvvj"
server_key: "60ba60de856f070b7a73dd066719a5d5"
server_key_iv: "a172ce272a87ac93b8acf883f19cf5d5"
server_key_version: "encryptionkey@0"
I20260806 09:19:48.324581 29808 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 09:19:48.329071 29823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:48.330734 29808 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260806 09:19:48.330973 29808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "b6dc1cbfe14e45258129090e41e9d44f"
format_stamp: "Formatted at 2026-08-06 09:19:48 on dist-test-slave-mvvj"
server_key: "60ba60de856f070b7a73dd066719a5d5"
server_key_iv: "a172ce272a87ac93b8acf883f19cf5d5"
server_key_version: "encryptionkey@0"
I20260806 09:19:48.331228 29808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:48.349834 29808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:48.355302 29808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:48.355707 29808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:48.377957 29808 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:39795
I20260806 09:19:48.377960 29874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:39795 every 8 connection(s)
I20260806 09:19:48.379683 29808 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:19:48.384200 29875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:19:48.388788 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 29808
I20260806 09:19:48.388998 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:19:48.389597 11261 external_mini_cluster.cc:1428] Setting key 4a904af4af452d215059f72c4d338fff
I20260806 09:19:48.399592 29875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6dc1cbfe14e45258129090e41e9d44f: Bootstrap starting.
I20260806 09:19:48.404348 29875 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6dc1cbfe14e45258129090e41e9d44f: Neither blocks nor log segments found. Creating new log.
I20260806 09:19:48.406015 29875 log.cc:824] T 00000000000000000000000000000000 P b6dc1cbfe14e45258129090e41e9d44f: Log is configured to *not* fsync() on all Append() calls
Aug 06 09:19:48 dist-test-slave-mvvj krb5kdc[29795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007987, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:19:48.410650 29875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6dc1cbfe14e45258129090e41e9d44f: No bootstrap required, opened a new log
I20260806 09:19:48.419457 29878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:48.391769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37298 (local address 127.10.255.126:39795)
0806 09:19:48.392692 (+ 923us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:48.392705 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:48.392749 (+ 44us) server_negotiation.cc:407] Connection header received
0806 09:19:48.394500 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:48.394527 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:48.395004 (+ 477us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:48.395391 (+ 387us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:48.397743 (+ 2352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:48.399409 (+ 1666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:48.401686 (+ 2277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:48.402565 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:48.402739 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:48.409512 (+ 6773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:48.409523 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:48.409541 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:48.409590 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:48.413841 (+ 4251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:48.415107 (+ 1266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:48.415117 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:48.415125 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:48.415345 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:48.415910 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:48.415915 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:48.415917 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:48.416659 (+ 742us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:48.416940 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:48.417539 (+ 599us) server_negotiation.cc:299] Negotiation successful
0806 09:19:48.418060 (+ 521us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":704,"thread_start_us":440,"threads_started":1}
I20260806 09:19:48.421526 29875 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6dc1cbfe14e45258129090e41e9d44f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6dc1cbfe14e45258129090e41e9d44f" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 39795 } }
I20260806 09:19:48.422030 29875 raft_consensus.cc:374] T 00000000000000000000000000000000 P b6dc1cbfe14e45258129090e41e9d44f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:19:48.422192 29875 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6dc1cbfe14e45258129090e41e9d44f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6dc1cbfe14e45258129090e41e9d44f, State: Initialized, Role: FOLLOWER
I20260806 09:19:48.422832 29875 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6dc1cbfe14e45258129090e41e9d44f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6dc1cbfe14e45258129090e41e9d44f" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 39795 } }
I20260806 09:19:48.423157 29875 raft_consensus.cc:388] T 00000000000000000000000000000000 P b6dc1cbfe14e45258129090e41e9d44f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:19:48.423324 29875 raft_consensus.cc:482] T 00000000000000000000000000000000 P b6dc1cbfe14e45258129090e41e9d44f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:19:48.423527 29875 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6dc1cbfe14e45258129090e41e9d44f [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:19:48.426307 29875 raft_consensus.cc:504] T 00000000000000000000000000000000 P b6dc1cbfe14e45258129090e41e9d44f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6dc1cbfe14e45258129090e41e9d44f" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 39795 } }
I20260806 09:19:48.426934 29875 leader_election.cc:302] T 00000000000000000000000000000000 P b6dc1cbfe14e45258129090e41e9d44f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b6dc1cbfe14e45258129090e41e9d44f; no voters:
I20260806 09:19:48.427656 29875 leader_election.cc:288] T 00000000000000000000000000000000 P b6dc1cbfe14e45258129090e41e9d44f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:19:48.427919 29880 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b6dc1cbfe14e45258129090e41e9d44f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:19:48.429388 29880 raft_consensus.cc:686] T 00000000000000000000000000000000 P b6dc1cbfe14e45258129090e41e9d44f [term 1 LEADER]: Becoming Leader. State: Replica: b6dc1cbfe14e45258129090e41e9d44f, State: Running, Role: LEADER
I20260806 09:19:48.429993 29880 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6dc1cbfe14e45258129090e41e9d44f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6dc1cbfe14e45258129090e41e9d44f" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 39795 } }
I20260806 09:19:48.430317 29875 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6dc1cbfe14e45258129090e41e9d44f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:19:48.433001 29882 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6dc1cbfe14e45258129090e41e9d44f [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6dc1cbfe14e45258129090e41e9d44f. Latest consensus state: current_term: 1 leader_uuid: "b6dc1cbfe14e45258129090e41e9d44f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6dc1cbfe14e45258129090e41e9d44f" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 39795 } } }
I20260806 09:19:48.433547 29882 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6dc1cbfe14e45258129090e41e9d44f [sys.catalog]: This master's current role is: LEADER
I20260806 09:19:48.433557 29881 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6dc1cbfe14e45258129090e41e9d44f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b6dc1cbfe14e45258129090e41e9d44f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6dc1cbfe14e45258129090e41e9d44f" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 39795 } } }
I20260806 09:19:48.434433 29881 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6dc1cbfe14e45258129090e41e9d44f [sys.catalog]: This master's current role is: LEADER
I20260806 09:19:48.436728 29885 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:19:48.442782 29885 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:19:48.454766 29885 catalog_manager.cc:1347] Generated new cluster ID: 561ac7e72325413f83d53b881b34d353
I20260806 09:19:48.454968 29885 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:19:48.474715 29885 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:19:48.476818 29885 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:19:48.492192 29885 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b6dc1cbfe14e45258129090e41e9d44f: Generated new TSK 0
I20260806 09:19:48.493440 29885 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.255.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
I20260806 09:19:48.576977 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:39795
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:19:48.990965 29901 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:19:48.991286 29901 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:19:48.991390 29901 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:19:48.999572 29901 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:19:48.999714 29901 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:19:48.999887 29901 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:19:49.011307 29901 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:39795
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:49.012913 29901 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:49.014436 29901 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:19:49.029372 29909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:49.029490 29906 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:49.029513 29907 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:49.030431 29901 server_base.cc:1034] running on GCE node
I20260806 09:19:49.031147 29901 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:49.032359 29901 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:49.033677 29901 hybrid_clock.cc:648] HybridClock initialized: now 1786007989033598 us; error 40 us; skew 500 ppm
I20260806 09:19:49.034049 29901 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:19:49 dist-test-slave-mvvj krb5kdc[29795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007989, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:19:49.037883 29901 init.cc:377] Logged in from keytab as kudu/127.10.255.65@KRBTEST.COM (short username kudu)
I20260806 09:19:49.039598 29901 webserver.cc:460] Webserver started at http://127.10.255.65:42613/ using document root <none> and password file <none>
I20260806 09:19:49.040398 29901 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:49.040519 29901 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:49.040797 29901 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:19:49.044060 29901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "48d6215c97db43a9ac8a6b4d2313c22a"
format_stamp: "Formatted at 2026-08-06 09:19:49 on dist-test-slave-mvvj"
server_key: "669f59870820c19ac741bbf5664b989a"
server_key_iv: "387bd6d07abb068742fd4efb4b23d90e"
server_key_version: "encryptionkey@0"
I20260806 09:19:49.044900 29901 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "48d6215c97db43a9ac8a6b4d2313c22a"
format_stamp: "Formatted at 2026-08-06 09:19:49 on dist-test-slave-mvvj"
server_key: "669f59870820c19ac741bbf5664b989a"
server_key_iv: "387bd6d07abb068742fd4efb4b23d90e"
server_key_version: "encryptionkey@0"
I20260806 09:19:49.051009 29901 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260806 09:19:49.054914 29916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:49.056440 29901 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260806 09:19:49.056640 29901 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "48d6215c97db43a9ac8a6b4d2313c22a"
format_stamp: "Formatted at 2026-08-06 09:19:49 on dist-test-slave-mvvj"
server_key: "669f59870820c19ac741bbf5664b989a"
server_key_iv: "387bd6d07abb068742fd4efb4b23d90e"
server_key_version: "encryptionkey@0"
I20260806 09:19:49.056875 29901 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:49.073800 29901 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:49.078574 29901 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:49.079016 29901 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:49.080215 29901 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:19:49.081749 29901 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:19:49.081828 29901 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:49.082020 29901 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:19:49.082084 29901 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:49.120641 29901 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:40931
I20260806 09:19:49.120800 30030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:40931 every 8 connection(s)
I20260806 09:19:49.122154 29901 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:19:49.122862 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 29901
I20260806 09:19:49.123121 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:19:49.123719 11261 external_mini_cluster.cc:1428] Setting key 4cb573ad220aebb0ed6b91df4c61b2b0
Aug 06 09:19:49 dist-test-slave-mvvj krb5kdc[29795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007989, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:19:49.147599 30033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:49.125515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:37325 (local address 127.10.255.126:39795)
0806 09:19:49.126054 (+ 539us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:49.126061 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:49.127314 (+ 1253us) server_negotiation.cc:407] Connection header received
0806 09:19:49.129400 (+ 2086us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:49.129406 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:49.129523 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:49.129650 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:49.131645 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:49.132555 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:49.134271 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:49.135137 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:49.135303 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:49.140231 (+ 4928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:49.140237 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:49.140240 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:49.140282 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:49.143213 (+ 2931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:49.144494 (+ 1281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:49.144552 (+ 58us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:49.144555 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:49.144728 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:49.145398 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:49.145403 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:49.145405 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:49.145817 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:49.145957 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:49.147051 (+ 1094us) server_negotiation.cc:299] Negotiation successful
0806 09:19:49.147272 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":278,"threads_started":1}
I20260806 09:19:49.149396 30034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:49.126271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:39795 (local address 127.10.255.65:37325)
0806 09:19:49.127140 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:49.127191 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:49.129081 (+ 1890us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:49.129960 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:49.129974 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:49.130617 (+ 643us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:19:49.131421 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:49.131444 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:49.132760 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:49.132765 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:49.134092 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:49.134106 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:49.135485 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:49.135493 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:49.135748 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:49.136685 (+ 937us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:19:49.136717 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:19:49.139917 (+ 3200us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:19:49.143434 (+ 3517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:19:49.143449 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:19:49.143473 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:19:49.144301 (+ 828us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:19:49.144898 (+ 597us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:19:49.144905 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:19:49.144912 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:19:49.145218 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:19:49.145994 (+ 776us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:19:49.146005 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:19:49.146558 (+ 553us) client_negotiation.cc:769] Sending connection context
0806 09:19:49.146905 (+ 347us) client_negotiation.cc:240] Negotiation successful
0806 09:19:49.147607 (+ 702us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":576,"thread_start_us":354,"threads_started":1}
I20260806 09:19:49.151445 30031 heartbeater.cc:347] Connected to a master server at 127.10.255.126:39795
I20260806 09:19:49.151862 30031 heartbeater.cc:464] Registering TS with master...
I20260806 09:19:49.152999 30031 heartbeater.cc:511] Master 127.10.255.126:39795 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.255.66@KRBTEST.COM; defaulting to no policy
I20260806 09:19:49.155932 29840 ts_manager.cc:194] Registered new tserver with Master: 48d6215c97db43a9ac8a6b4d2313c22a (127.10.255.65:40931)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.66@KRBTEST.COM" created.
I20260806 09:19:49.157752 29840 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.65@KRBTEST.COM'} at 127.10.255.65:37325
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
I20260806 09:19:49.192694 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:39795
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:19:49.554962 30038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:19:49.555277 30038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:19:49.555454 30038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:19:49.563603 30038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:19:49.563822 30038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:19:49.564445 30038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:19:49.575093 30038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:39795
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:49.576531 30038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:49.578109 30038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:19:49.596190 30044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:49.596243 30043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:49.596288 30046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:49.597335 30038 server_base.cc:1034] running on GCE node
I20260806 09:19:49.598004 30038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:49.599040 30038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:49.600279 30038 hybrid_clock.cc:648] HybridClock initialized: now 1786007989600179 us; error 66 us; skew 500 ppm
I20260806 09:19:49.600806 30038 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:19:49 dist-test-slave-mvvj krb5kdc[29795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007989, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:19:49.604800 30038 init.cc:377] Logged in from keytab as kudu/127.10.255.66@KRBTEST.COM (short username kudu)
I20260806 09:19:49.606385 30038 webserver.cc:460] Webserver started at http://127.10.255.66:43783/ using document root <none> and password file <none>
I20260806 09:19:49.607149 30038 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:49.607307 30038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:49.607652 30038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:19:49.611003 30038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "b0feee44e8ba4e9c91e96364c63b5d09"
format_stamp: "Formatted at 2026-08-06 09:19:49 on dist-test-slave-mvvj"
server_key: "5b735aa8e3ba5e95cf1294407eaba940"
server_key_iv: "224d9a61f2d041e9c2c45a49bbab9d9f"
server_key_version: "encryptionkey@0"
I20260806 09:19:49.612061 30038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "b0feee44e8ba4e9c91e96364c63b5d09"
format_stamp: "Formatted at 2026-08-06 09:19:49 on dist-test-slave-mvvj"
server_key: "5b735aa8e3ba5e95cf1294407eaba940"
server_key_iv: "224d9a61f2d041e9c2c45a49bbab9d9f"
server_key_version: "encryptionkey@0"
I20260806 09:19:49.617983 30038 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 09:19:49.622206 30053 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:49.624217 30038 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:19:49.624450 30038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "b0feee44e8ba4e9c91e96364c63b5d09"
format_stamp: "Formatted at 2026-08-06 09:19:49 on dist-test-slave-mvvj"
server_key: "5b735aa8e3ba5e95cf1294407eaba940"
server_key_iv: "224d9a61f2d041e9c2c45a49bbab9d9f"
server_key_version: "encryptionkey@0"
I20260806 09:19:49.624703 30038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:49.640858 30038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:49.646183 30038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:49.646554 30038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:49.647634 30038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:19:49.649237 30038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:19:49.649353 30038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:49.649520 30038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:19:49.649601 30038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:49.687531 30038 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:43515
I20260806 09:19:49.687599 30166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:43515 every 8 connection(s)
I20260806 09:19:49.689056 30038 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:19:49.692216 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 30038
I20260806 09:19:49.692442 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:19:49.693010 11261 external_mini_cluster.cc:1428] Setting key 71597082c99074bfe538be6a5481836a
Aug 06 09:19:49 dist-test-slave-mvvj krb5kdc[29795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007989, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:19:49.717664 30169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:49.692182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:35533 (local address 127.10.255.126:39795)
0806 09:19:49.692823 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:49.692830 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:49.694052 (+ 1222us) server_negotiation.cc:407] Connection header received
0806 09:19:49.696608 (+ 2556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:49.696614 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:49.696715 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:49.696817 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:49.699298 (+ 2481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:49.700283 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:49.703266 (+ 2983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:49.703796 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:49.704015 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:49.708957 (+ 4942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:49.708967 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:49.708975 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:49.709029 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:49.713012 (+ 3983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:49.714421 (+ 1409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:49.714426 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:49.714429 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:49.714605 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:49.715413 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:49.715418 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:49.715420 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:49.715805 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:49.716049 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:49.716938 (+ 889us) server_negotiation.cc:299] Negotiation successful
0806 09:19:49.717244 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":362,"threads_started":1}
I20260806 09:19:49.718786 30170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:49.692873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:39795 (local address 127.10.255.66:35533)
0806 09:19:49.693855 (+ 982us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:49.693903 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:49.696230 (+ 2327us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:49.697139 (+ 909us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:49.697155 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:49.698047 (+ 892us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:19:49.699001 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:49.699035 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:49.700546 (+ 1511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:49.700555 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:49.702996 (+ 2441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:49.703022 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:49.704177 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:49.704188 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:49.704558 (+ 370us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:49.705447 (+ 889us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:19:49.705485 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:19:49.708638 (+ 3153us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:19:49.713294 (+ 4656us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:19:49.713304 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:19:49.713320 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:19:49.714153 (+ 833us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:19:49.714930 (+ 777us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:19:49.714941 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:19:49.714943 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:19:49.715235 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:19:49.716040 (+ 805us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:19:49.716049 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:19:49.716487 (+ 438us) client_negotiation.cc:769] Sending connection context
0806 09:19:49.716800 (+ 313us) client_negotiation.cc:240] Negotiation successful
0806 09:19:49.717442 (+ 642us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":632,"thread_start_us":365,"threads_started":1}
I20260806 09:19:49.721168 30167 heartbeater.cc:347] Connected to a master server at 127.10.255.126:39795
I20260806 09:19:49.721575 30167 heartbeater.cc:464] Registering TS with master...
I20260806 09:19:49.722445 30167 heartbeater.cc:511] Master 127.10.255.126:39795 requested a full tablet report, sending...
I20260806 09:19:49.724646 29840 ts_manager.cc:194] Registered new tserver with Master: b0feee44e8ba4e9c91e96364c63b5d09 (127.10.255.66:43515)
WARNING: no policy specified for kudu/127.10.255.67@KRBTEST.COM; defaulting to no policy
I20260806 09:19:49.726142 29840 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.66@KRBTEST.COM'} at 127.10.255.66:35533
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
I20260806 09:19:49.764797 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:39795
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:43401
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:19:50.125771 30173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:19:50.126148 30173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:19:50.126354 30173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:19:50.134641 30173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:19:50.134845 30173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:19:50.135049 30173 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:19:50.146029 30173 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:43401
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:39795
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:50.147394 30173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:50.148841 30173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 09:19:50.161679 30031 heartbeater.cc:503] Master 127.10.255.126:39795 was elected leader, sending a full tablet report...
W20260806 09:19:50.163741 30178 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:50.163690 30179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:50.164475 30181 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:50.165151 30173 server_base.cc:1034] running on GCE node
I20260806 09:19:50.166110 30173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:50.167430 30173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:50.168694 30173 hybrid_clock.cc:648] HybridClock initialized: now 1786007990168596 us; error 86 us; skew 500 ppm
I20260806 09:19:50.169054 30173 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:19:50 dist-test-slave-mvvj krb5kdc[29795](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007990, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:19:50.172703 30173 init.cc:377] Logged in from keytab as kudu/127.10.255.67@KRBTEST.COM (short username kudu)
I20260806 09:19:50.174554 30173 webserver.cc:460] Webserver started at http://127.10.255.67:35441/ using document root <none> and password file <none>
I20260806 09:19:50.175325 30173 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:50.175483 30173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:50.175889 30173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:19:50.179235 30173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "ff0ec81cd3234c6b9c2f117a35b94897"
format_stamp: "Formatted at 2026-08-06 09:19:50 on dist-test-slave-mvvj"
server_key: "459d510d6606ed15e9f118a2ca385efb"
server_key_iv: "843bd262c9987102d415da296c9a0f82"
server_key_version: "encryptionkey@0"
I20260806 09:19:50.180202 30173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "ff0ec81cd3234c6b9c2f117a35b94897"
format_stamp: "Formatted at 2026-08-06 09:19:50 on dist-test-slave-mvvj"
server_key: "459d510d6606ed15e9f118a2ca385efb"
server_key_iv: "843bd262c9987102d415da296c9a0f82"
server_key_version: "encryptionkey@0"
I20260806 09:19:50.186200 30173 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 09:19:50.190619 30188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:50.192523 30173 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:19:50.192768 30173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "ff0ec81cd3234c6b9c2f117a35b94897"
format_stamp: "Formatted at 2026-08-06 09:19:50 on dist-test-slave-mvvj"
server_key: "459d510d6606ed15e9f118a2ca385efb"
server_key_iv: "843bd262c9987102d415da296c9a0f82"
server_key_version: "encryptionkey@0"
I20260806 09:19:50.193058 30173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:50.210940 30173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:50.216192 30173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:50.216532 30173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:50.217651 30173 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:19:50.219302 30173 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:19:50.219424 30173 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:50.219583 30173 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:19:50.219661 30173 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:50.257027 30173 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:41231
I20260806 09:19:50.257066 30301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:41231 every 8 connection(s)
I20260806 09:19:50.258529 30173 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:19:50.264521 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 30173
I20260806 09:19:50.264742 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:19:50.265349 11261 external_mini_cluster.cc:1428] Setting key 6fb77b274c2cc73fc3db3288e01274d1
Aug 06 09:19:50 dist-test-slave-mvvj krb5kdc[29795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007990, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:19:50.282642 30304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:50.261620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:44061 (local address 127.10.255.126:39795)
0806 09:19:50.262181 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:50.262186 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:50.263043 (+ 857us) server_negotiation.cc:407] Connection header received
0806 09:19:50.265750 (+ 2707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:50.265755 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:50.265853 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:50.265959 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:50.267972 (+ 2013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.269156 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.270945 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.271422 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.271538 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:50.275549 (+ 4011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:50.275555 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:50.275559 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:50.275606 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:50.278697 (+ 3091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:50.279761 (+ 1064us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:50.279766 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:50.279768 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:50.280036 (+ 268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:50.280613 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:50.280617 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:50.280619 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:50.280948 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:50.281129 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:50.282088 (+ 959us) server_negotiation.cc:299] Negotiation successful
0806 09:19:50.282310 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":235,"threads_started":1}
I20260806 09:19:50.283491 30305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:50.262097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:39795 (local address 127.10.255.67:44061)
0806 09:19:50.262860 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:50.262900 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:50.265328 (+ 2428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:50.266299 (+ 971us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:50.266308 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:50.266991 (+ 683us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:19:50.267741 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:50.267761 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.269352 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.269357 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:50.270725 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:50.270741 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.271694 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.271700 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:50.272018 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:50.272749 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:19:50.272774 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:19:50.275245 (+ 2471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:19:50.278966 (+ 3721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:19:50.278977 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:19:50.278995 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:19:50.279555 (+ 560us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:19:50.280176 (+ 621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:19:50.280180 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:19:50.280182 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:19:50.280442 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:19:50.281107 (+ 665us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:19:50.281115 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:19:50.281501 (+ 386us) client_negotiation.cc:769] Sending connection context
0806 09:19:50.281832 (+ 331us) client_negotiation.cc:240] Negotiation successful
0806 09:19:50.282319 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":288,"threads_started":1}
I20260806 09:19:50.285291 30302 heartbeater.cc:347] Connected to a master server at 127.10.255.126:39795
I20260806 09:19:50.285656 30302 heartbeater.cc:464] Registering TS with master...
I20260806 09:19:50.286466 30302 heartbeater.cc:511] Master 127.10.255.126:39795 requested a full tablet report, sending...
I20260806 09:19:50.288216 29840 ts_manager.cc:194] Registered new tserver with Master: ff0ec81cd3234c6b9c2f117a35b94897 (127.10.255.67:41231)
I20260806 09:19:50.289178 29840 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.67@KRBTEST.COM'} at 127.10.255.67:44061
I20260806 09:19:50.294827 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 09:19:50.316052 30304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:50.299523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37310 (local address 127.10.255.126:39795)
0806 09:19:50.299853 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:50.299860 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:50.300228 (+ 368us) server_negotiation.cc:407] Connection header received
0806 09:19:50.300365 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:50.300369 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:50.300465 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:50.300559 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:50.302425 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.303227 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.304967 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.305423 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.305553 (+ 130us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:50.308758 (+ 3205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:50.308764 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:50.308767 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:50.308819 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:50.312099 (+ 3280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:50.313211 (+ 1112us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:50.313215 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:50.313218 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:50.313369 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:50.314051 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:50.314055 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:50.314057 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:50.314441 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:50.314687 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:50.315253 (+ 566us) server_negotiation.cc:299] Negotiation successful
0806 09:19:50.315567 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260806 09:19:50.321321 29840 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37310:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:19:50.328842 29840 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:19:50.359768 30315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:50.343826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:40931 (local address 127.0.0.1:47254)
0806 09:19:50.345082 (+ 1256us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:50.345129 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:50.345360 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:50.347693 (+ 2333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:50.347705 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:50.347750 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:50.348425 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:50.348443 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.351516 (+ 3073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.351526 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:50.355055 (+ 3529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:50.355076 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.357954 (+ 2878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.357962 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:50.358237 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:50.358285 (+ 48us) client_negotiation.cc:769] Sending connection context
0806 09:19:50.358886 (+ 601us) client_negotiation.cc:240] Negotiation successful
0806 09:19:50.359167 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":953,"thread_start_us":647,"threads_started":1}
I20260806 09:19:50.360610 30316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:50.344357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47254 (local address 127.10.255.65:40931)
0806 09:19:50.346822 (+ 2465us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:50.346837 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:50.346876 (+ 39us) server_negotiation.cc:407] Connection header received
0806 09:19:50.347026 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:50.347038 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:50.347378 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:50.348697 (+ 1319us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:50.349057 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.351273 (+ 2216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.355365 (+ 4092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.357685 (+ 2320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.357883 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:50.358153 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:50.359958 (+ 1805us) server_negotiation.cc:299] Negotiation successful
0806 09:19:50.360196 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2239,"thread_start_us":2049,"threads_started":1}
I20260806 09:19:50.364101 30319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:50.346571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:41231 (local address 127.0.0.1:55468)
0806 09:19:50.354713 (+ 8142us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:50.354746 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:50.354944 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:50.356400 (+ 1456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:50.356405 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:50.356436 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:50.356848 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:50.356861 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.359162 (+ 2301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.359168 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:50.361353 (+ 2185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:50.361369 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.363001 (+ 1632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.363032 (+ 31us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:50.363273 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:50.363316 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 09:19:50.363420 (+ 104us) client_negotiation.cc:240] Negotiation successful
0806 09:19:50.363596 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7942,"mutex_wait_us":23,"thread_start_us":8374,"threads_started":1}
I20260806 09:19:50.364177 30320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:50.347200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55468 (local address 127.10.255.67:41231)
0806 09:19:50.355649 (+ 8449us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:50.355657 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:50.355693 (+ 36us) server_negotiation.cc:407] Connection header received
0806 09:19:50.355798 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:50.355806 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:50.356129 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:50.357054 (+ 925us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:50.357357 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.358961 (+ 1604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.361541 (+ 2580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.362752 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.363230 (+ 478us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:50.363503 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:50.363584 (+ 81us) server_negotiation.cc:299] Negotiation successful
0806 09:19:50.363775 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8262,"thread_start_us":8090,"threads_started":1}
I20260806 09:19:50.365155 29966 tablet_service.cc:1467] Processing CreateTablet for tablet 567174a20eed475c987f3abf59cc3ba0 (DEFAULT_TABLE table=test-table [id=984d67cce5d54e858c1dce5af16f36a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:19:50.366997 29966 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 567174a20eed475c987f3abf59cc3ba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:19:50.367554 30317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:50.344813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:43515 (local address 127.0.0.1:40472)
0806 09:19:50.346047 (+ 1234us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:50.346065 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:50.346175 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:50.355785 (+ 9610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:50.355790 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:50.355825 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:50.356300 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:50.356320 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.358655 (+ 2335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.358661 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:50.364955 (+ 6294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:50.364974 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.366708 (+ 1734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.366716 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:50.366893 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:50.366935 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 09:19:50.367052 (+ 117us) client_negotiation.cc:240] Negotiation successful
0806 09:19:50.367203 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1112,"thread_start_us":971,"threads_started":1}
I20260806 09:19:50.367604 30318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:50.345449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40472 (local address 127.10.255.66:43515)
0806 09:19:50.354153 (+ 8704us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:50.354181 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:50.354243 (+ 62us) server_negotiation.cc:407] Connection header received
0806 09:19:50.354398 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:50.354409 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:50.354734 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:50.356550 (+ 1816us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:50.356844 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.358494 (+ 1650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.365225 (+ 6731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.366472 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.366650 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:50.366866 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:50.367115 (+ 249us) server_negotiation.cc:299] Negotiation successful
0806 09:19:50.367286 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8379,"thread_start_us":8222,"threads_started":1}
I20260806 09:19:50.368954 30236 tablet_service.cc:1467] Processing CreateTablet for tablet 567174a20eed475c987f3abf59cc3ba0 (DEFAULT_TABLE table=test-table [id=984d67cce5d54e858c1dce5af16f36a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:19:50.370797 30236 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 567174a20eed475c987f3abf59cc3ba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:19:50.371232 30101 tablet_service.cc:1467] Processing CreateTablet for tablet 567174a20eed475c987f3abf59cc3ba0 (DEFAULT_TABLE table=test-table [id=984d67cce5d54e858c1dce5af16f36a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:19:50.372929 30101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 567174a20eed475c987f3abf59cc3ba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:19:50.395390 30323 tablet_bootstrap.cc:492] T 567174a20eed475c987f3abf59cc3ba0 P ff0ec81cd3234c6b9c2f117a35b94897: Bootstrap starting.
I20260806 09:19:50.398655 30322 tablet_bootstrap.cc:492] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a: Bootstrap starting.
I20260806 09:19:50.402757 30322 tablet_bootstrap.cc:654] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a: Neither blocks nor log segments found. Creating new log.
I20260806 09:19:50.402757 30323 tablet_bootstrap.cc:654] T 567174a20eed475c987f3abf59cc3ba0 P ff0ec81cd3234c6b9c2f117a35b94897: Neither blocks nor log segments found. Creating new log.
I20260806 09:19:50.402750 30321 tablet_bootstrap.cc:492] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09: Bootstrap starting.
I20260806 09:19:50.404294 30322 log.cc:824] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a: Log is configured to *not* fsync() on all Append() calls
I20260806 09:19:50.404294 30323 log.cc:824] T 567174a20eed475c987f3abf59cc3ba0 P ff0ec81cd3234c6b9c2f117a35b94897: Log is configured to *not* fsync() on all Append() calls
I20260806 09:19:50.406515 30321 tablet_bootstrap.cc:654] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09: Neither blocks nor log segments found. Creating new log.
I20260806 09:19:50.407721 30321 log.cc:824] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09: Log is configured to *not* fsync() on all Append() calls
I20260806 09:19:50.411443 30321 tablet_bootstrap.cc:492] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09: No bootstrap required, opened a new log
I20260806 09:19:50.411466 30322 tablet_bootstrap.cc:492] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a: No bootstrap required, opened a new log
I20260806 09:19:50.411556 30323 tablet_bootstrap.cc:492] T 567174a20eed475c987f3abf59cc3ba0 P ff0ec81cd3234c6b9c2f117a35b94897: No bootstrap required, opened a new log
I20260806 09:19:50.411863 30323 ts_tablet_manager.cc:1397] T 567174a20eed475c987f3abf59cc3ba0 P ff0ec81cd3234c6b9c2f117a35b94897: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.004s
I20260806 09:19:50.411861 30322 ts_tablet_manager.cc:1397] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.004s
I20260806 09:19:50.411842 30321 ts_tablet_manager.cc:1397] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09: Time spent bootstrapping tablet: real 0.014s user 0.006s sys 0.000s
I20260806 09:19:50.421079 30321 raft_consensus.cc:348] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d6215c97db43a9ac8a6b4d2313c22a" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40931 } } peers { permanent_uuid: "ff0ec81cd3234c6b9c2f117a35b94897" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 41231 } } peers { permanent_uuid: "b0feee44e8ba4e9c91e96364c63b5d09" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43515 } }
I20260806 09:19:50.421639 30321 raft_consensus.cc:374] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:19:50.421811 30321 raft_consensus.cc:729] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0feee44e8ba4e9c91e96364c63b5d09, State: Initialized, Role: FOLLOWER
I20260806 09:19:50.422608 30321 consensus_queue.cc:260] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d6215c97db43a9ac8a6b4d2313c22a" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40931 } } peers { permanent_uuid: "ff0ec81cd3234c6b9c2f117a35b94897" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 41231 } } peers { permanent_uuid: "b0feee44e8ba4e9c91e96364c63b5d09" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43515 } }
I20260806 09:19:50.424069 30167 heartbeater.cc:503] Master 127.10.255.126:39795 was elected leader, sending a full tablet report...
I20260806 09:19:50.423779 30322 raft_consensus.cc:348] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d6215c97db43a9ac8a6b4d2313c22a" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40931 } } peers { permanent_uuid: "ff0ec81cd3234c6b9c2f117a35b94897" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 41231 } } peers { permanent_uuid: "b0feee44e8ba4e9c91e96364c63b5d09" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43515 } }
I20260806 09:19:50.423779 30323 raft_consensus.cc:348] T 567174a20eed475c987f3abf59cc3ba0 P ff0ec81cd3234c6b9c2f117a35b94897 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d6215c97db43a9ac8a6b4d2313c22a" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40931 } } peers { permanent_uuid: "ff0ec81cd3234c6b9c2f117a35b94897" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 41231 } } peers { permanent_uuid: "b0feee44e8ba4e9c91e96364c63b5d09" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43515 } }
I20260806 09:19:50.424485 30323 raft_consensus.cc:374] T 567174a20eed475c987f3abf59cc3ba0 P ff0ec81cd3234c6b9c2f117a35b94897 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:19:50.424571 30322 raft_consensus.cc:374] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:19:50.424625 30323 raft_consensus.cc:729] T 567174a20eed475c987f3abf59cc3ba0 P ff0ec81cd3234c6b9c2f117a35b94897 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff0ec81cd3234c6b9c2f117a35b94897, State: Initialized, Role: FOLLOWER
I20260806 09:19:50.424691 30322 raft_consensus.cc:729] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d6215c97db43a9ac8a6b4d2313c22a, State: Initialized, Role: FOLLOWER
I20260806 09:19:50.424906 30321 ts_tablet_manager.cc:1428] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09: Time spent starting tablet: real 0.013s user 0.010s sys 0.002s
I20260806 09:19:50.425463 30322 consensus_queue.cc:260] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d6215c97db43a9ac8a6b4d2313c22a" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40931 } } peers { permanent_uuid: "ff0ec81cd3234c6b9c2f117a35b94897" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 41231 } } peers { permanent_uuid: "b0feee44e8ba4e9c91e96364c63b5d09" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43515 } }
I20260806 09:19:50.425454 30323 consensus_queue.cc:260] T 567174a20eed475c987f3abf59cc3ba0 P ff0ec81cd3234c6b9c2f117a35b94897 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d6215c97db43a9ac8a6b4d2313c22a" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40931 } } peers { permanent_uuid: "ff0ec81cd3234c6b9c2f117a35b94897" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 41231 } } peers { permanent_uuid: "b0feee44e8ba4e9c91e96364c63b5d09" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43515 } }
I20260806 09:19:50.430671 30302 heartbeater.cc:503] Master 127.10.255.126:39795 was elected leader, sending a full tablet report...
I20260806 09:19:50.431898 30323 ts_tablet_manager.cc:1428] T 567174a20eed475c987f3abf59cc3ba0 P ff0ec81cd3234c6b9c2f117a35b94897: Time spent starting tablet: real 0.020s user 0.015s sys 0.003s
I20260806 09:19:50.434063 30322 ts_tablet_manager.cc:1428] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a: Time spent starting tablet: real 0.022s user 0.019s sys 0.002s
W20260806 09:19:50.441370 30168 tablet.cc:2369] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 09:19:50.510578 30303 tablet.cc:2369] T 567174a20eed475c987f3abf59cc3ba0 P ff0ec81cd3234c6b9c2f117a35b94897: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 09:19:50.625885 30032 tablet.cc:2369] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:19:50.692935 30327 raft_consensus.cc:482] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:19:50.693272 30327 raft_consensus.cc:504] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d6215c97db43a9ac8a6b4d2313c22a" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40931 } } peers { permanent_uuid: "ff0ec81cd3234c6b9c2f117a35b94897" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 41231 } } peers { permanent_uuid: "b0feee44e8ba4e9c91e96364c63b5d09" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43515 } }
I20260806 09:19:50.695436 30327 leader_election.cc:288] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48d6215c97db43a9ac8a6b4d2313c22a (127.10.255.65:40931), ff0ec81cd3234c6b9c2f117a35b94897 (127.10.255.67:41231)
I20260806 09:19:50.699590 30328 raft_consensus.cc:482] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:19:50.700053 30328 raft_consensus.cc:504] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d6215c97db43a9ac8a6b4d2313c22a" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40931 } } peers { permanent_uuid: "ff0ec81cd3234c6b9c2f117a35b94897" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 41231 } } peers { permanent_uuid: "b0feee44e8ba4e9c91e96364c63b5d09" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43515 } }
I20260806 09:19:50.706449 30316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:50.696059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:50059 (local address 127.10.255.65:40931)
0806 09:19:50.696313 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:50.696322 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:50.696690 (+ 368us) server_negotiation.cc:407] Connection header received
0806 09:19:50.697034 (+ 344us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:50.697040 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:50.697127 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:50.697235 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:50.698267 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.699615 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.702729 (+ 3114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.704654 (+ 1925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.704856 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:50.704976 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:50.705935 (+ 959us) server_negotiation.cc:299] Negotiation successful
0806 09:19:50.706136 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 09:19:50.706147 30328 leader_election.cc:288] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff0ec81cd3234c6b9c2f117a35b94897 (127.10.255.67:41231), b0feee44e8ba4e9c91e96364c63b5d09 (127.10.255.66:43515)
I20260806 09:19:50.706832 30330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:50.695763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:40931 (local address 127.10.255.66:50059)
0806 09:19:50.696535 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:50.696569 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:50.696759 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:50.697499 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:50.697505 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:50.697535 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:50.698083 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:50.698097 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.699864 (+ 1767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.699872 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:50.702507 (+ 2635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:50.702526 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.705306 (+ 2780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.705316 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:50.705658 (+ 342us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:50.705720 (+ 62us) client_negotiation.cc:769] Sending connection context
0806 09:19:50.706200 (+ 480us) client_negotiation.cc:240] Negotiation successful
0806 09:19:50.706369 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":632,"mutex_wait_us":6,"thread_start_us":563,"threads_started":1}
I20260806 09:19:50.708472 30320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:50.697037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:52241 (local address 127.10.255.67:41231)
0806 09:19:50.697334 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:50.697344 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:50.698307 (+ 963us) server_negotiation.cc:407] Connection header received
0806 09:19:50.698681 (+ 374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:50.698689 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:50.698792 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:50.698885 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:50.699754 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.700864 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.705675 (+ 4811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.707001 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.707183 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:50.707278 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:50.708067 (+ 789us) server_negotiation.cc:299] Negotiation successful
0806 09:19:50.708216 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260806 09:19:50.708166 29986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "567174a20eed475c987f3abf59cc3ba0" candidate_uuid: "b0feee44e8ba4e9c91e96364c63b5d09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d6215c97db43a9ac8a6b4d2313c22a" is_pre_election: true
I20260806 09:19:50.708792 29986 raft_consensus.cc:2454] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b0feee44e8ba4e9c91e96364c63b5d09 in term 0.
I20260806 09:19:50.709880 30055 leader_election.cc:302] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d6215c97db43a9ac8a6b4d2313c22a, b0feee44e8ba4e9c91e96364c63b5d09; no voters:
I20260806 09:19:50.710538 30327 raft_consensus.cc:2781] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:19:50.710726 30327 raft_consensus.cc:482] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:19:50.710861 30327 raft_consensus.cc:3037] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:19:50.714349 30318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:50.703339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:46177 (local address 127.10.255.66:43515)
0806 09:19:50.703525 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:50.703532 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:50.706210 (+ 2678us) server_negotiation.cc:407] Connection header received
0806 09:19:50.706453 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:50.706460 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:50.706537 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:50.706597 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:50.707463 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.708567 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.711488 (+ 2921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.712901 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.713115 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:50.713191 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:50.713863 (+ 672us) server_negotiation.cc:299] Negotiation successful
0806 09:19:50.714025 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":71}
I20260806 09:19:50.715246 30333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:50.702703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:43515 (local address 127.10.255.65:46177)
0806 09:19:50.706095 (+ 3392us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:50.706126 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:50.706312 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:50.706791 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:50.706796 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:50.706833 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:50.707274 (+ 441us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:50.707289 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.708764 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.708775 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:50.711291 (+ 2516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:50.711304 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.713422 (+ 2118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.713430 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:50.713629 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:50.713668 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 09:19:50.714665 (+ 997us) client_negotiation.cc:240] Negotiation successful
0806 09:19:50.714832 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3247,"thread_start_us":3071,"threads_started":1}
I20260806 09:19:50.715816 30327 raft_consensus.cc:504] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d6215c97db43a9ac8a6b4d2313c22a" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40931 } } peers { permanent_uuid: "ff0ec81cd3234c6b9c2f117a35b94897" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 41231 } } peers { permanent_uuid: "b0feee44e8ba4e9c91e96364c63b5d09" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43515 } }
I20260806 09:19:50.716194 30332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:50.702536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:41231 (local address 127.10.255.65:45889)
0806 09:19:50.703329 (+ 793us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:50.703351 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:50.703492 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:50.709264 (+ 5772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:50.709270 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:50.709297 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:50.709756 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:50.709769 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.711302 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.711308 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:50.713476 (+ 2168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:50.713490 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.715390 (+ 1900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.715397 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:50.715571 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:50.715616 (+ 45us) client_negotiation.cc:769] Sending connection context
0806 09:19:50.715709 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 09:19:50.715890 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":626,"thread_start_us":735,"threads_started":1}
I20260806 09:19:50.716452 30320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:50.703099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:45889 (local address 127.10.255.67:41231)
0806 09:19:50.708754 (+ 5655us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:50.708761 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:50.708777 (+ 16us) server_negotiation.cc:407] Connection header received
0806 09:19:50.708838 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:50.708845 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:50.708929 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:50.709022 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:50.709939 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.711117 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.713687 (+ 2570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.714940 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.715121 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:50.715207 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:50.715938 (+ 731us) server_negotiation.cc:299] Negotiation successful
0806 09:19:50.716086 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5542,"thread_start_us":12346,"threads_started":1}
I20260806 09:19:50.717044 30331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:50.696815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:41231 (local address 127.10.255.66:52241)
0806 09:19:50.698205 (+ 1390us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:50.698228 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:50.698382 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:50.699056 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:50.699061 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:50.699085 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:50.699538 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:50.699549 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.701208 (+ 1659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.701212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:50.705458 (+ 4246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:50.705482 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.707637 (+ 2155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.707643 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:50.707859 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:50.707902 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 09:19:50.715468 (+ 7566us) client_negotiation.cc:240] Negotiation successful
0806 09:19:50.715628 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1170,"mutex_wait_us":1440,"thread_start_us":856,"threads_started":1}
I20260806 09:19:50.716926 30122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "567174a20eed475c987f3abf59cc3ba0" candidate_uuid: "48d6215c97db43a9ac8a6b4d2313c22a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b0feee44e8ba4e9c91e96364c63b5d09" is_pre_election: true
I20260806 09:19:50.717518 30122 raft_consensus.cc:2379] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48d6215c97db43a9ac8a6b4d2313c22a in current term 1: Already voted for candidate b0feee44e8ba4e9c91e96364c63b5d09 in this term.
I20260806 09:19:50.717561 29986 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "567174a20eed475c987f3abf59cc3ba0" candidate_uuid: "b0feee44e8ba4e9c91e96364c63b5d09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d6215c97db43a9ac8a6b4d2313c22a"
I20260806 09:19:50.717811 29986 raft_consensus.cc:3037] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:19:50.718197 30257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "567174a20eed475c987f3abf59cc3ba0" candidate_uuid: "48d6215c97db43a9ac8a6b4d2313c22a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0ec81cd3234c6b9c2f117a35b94897" is_pre_election: true
I20260806 09:19:50.718266 30256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "567174a20eed475c987f3abf59cc3ba0" candidate_uuid: "b0feee44e8ba4e9c91e96364c63b5d09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0ec81cd3234c6b9c2f117a35b94897" is_pre_election: true
I20260806 09:19:50.718952 30257 raft_consensus.cc:2454] T 567174a20eed475c987f3abf59cc3ba0 P ff0ec81cd3234c6b9c2f117a35b94897 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48d6215c97db43a9ac8a6b4d2313c22a in term 0.
I20260806 09:19:50.719481 30327 leader_election.cc:288] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09 [CANDIDATE]: Term 1 election: Requested vote from peers 48d6215c97db43a9ac8a6b4d2313c22a (127.10.255.65:40931), ff0ec81cd3234c6b9c2f117a35b94897 (127.10.255.67:41231)
I20260806 09:19:50.719699 29918 leader_election.cc:302] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48d6215c97db43a9ac8a6b4d2313c22a, ff0ec81cd3234c6b9c2f117a35b94897; no voters: b0feee44e8ba4e9c91e96364c63b5d09
I20260806 09:19:50.720266 30256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "567174a20eed475c987f3abf59cc3ba0" candidate_uuid: "b0feee44e8ba4e9c91e96364c63b5d09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0ec81cd3234c6b9c2f117a35b94897"
I20260806 09:19:50.720498 30256 raft_consensus.cc:3037] T 567174a20eed475c987f3abf59cc3ba0 P ff0ec81cd3234c6b9c2f117a35b94897 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:19:50.721626 29986 raft_consensus.cc:2454] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0feee44e8ba4e9c91e96364c63b5d09 in term 1.
I20260806 09:19:50.721849 30328 raft_consensus.cc:2741] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260806 09:19:50.722208 30055 leader_election.cc:302] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d6215c97db43a9ac8a6b4d2313c22a, b0feee44e8ba4e9c91e96364c63b5d09; no voters:
I20260806 09:19:50.722631 30327 raft_consensus.cc:2781] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:19:50.723196 30327 raft_consensus.cc:686] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09 [term 1 LEADER]: Becoming Leader. State: Replica: b0feee44e8ba4e9c91e96364c63b5d09, State: Running, Role: LEADER
I20260806 09:19:50.723673 30256 raft_consensus.cc:2454] T 567174a20eed475c987f3abf59cc3ba0 P ff0ec81cd3234c6b9c2f117a35b94897 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b0feee44e8ba4e9c91e96364c63b5d09 in term 1.
I20260806 09:19:50.723872 30327 consensus_queue.cc:237] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d6215c97db43a9ac8a6b4d2313c22a" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40931 } } peers { permanent_uuid: "ff0ec81cd3234c6b9c2f117a35b94897" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 41231 } } peers { permanent_uuid: "b0feee44e8ba4e9c91e96364c63b5d09" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43515 } }
I20260806 09:19:50.729713 29840 catalog_manager.cc:5495] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09 reported cstate change: term changed from 0 to 1, leader changed from <none> to b0feee44e8ba4e9c91e96364c63b5d09 (127.10.255.66). New cstate: current_term: 1 leader_uuid: "b0feee44e8ba4e9c91e96364c63b5d09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "48d6215c97db43a9ac8a6b4d2313c22a" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff0ec81cd3234c6b9c2f117a35b94897" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 41231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b0feee44e8ba4e9c91e96364c63b5d09" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 43515 } health_report { overall_health: HEALTHY } } }
I20260806 09:19:50.836900 30318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:50.829671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40484 (local address 127.10.255.66:43515)
0806 09:19:50.829851 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:50.829855 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:50.830469 (+ 614us) server_negotiation.cc:407] Connection header received
0806 09:19:50.830654 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:50.830659 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:50.830810 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:50.830951 (+ 141us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:19:50.831521 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.832459 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.834029 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.834465 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.834569 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:50.835293 (+ 724us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:19:50.836054 (+ 761us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:19:50.836260 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:50.836495 (+ 235us) server_negotiation.cc:299] Negotiation successful
0806 09:19:50.836629 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 09:19:50.846163 30256 raft_consensus.cc:1261] T 567174a20eed475c987f3abf59cc3ba0 P ff0ec81cd3234c6b9c2f117a35b94897 [term 1 FOLLOWER]: Refusing update from remote peer b0feee44e8ba4e9c91e96364c63b5d09: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:19:50.846199 29986 raft_consensus.cc:1261] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a [term 1 FOLLOWER]: Refusing update from remote peer b0feee44e8ba4e9c91e96364c63b5d09: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:19:50.847266 30335 consensus_queue.cc:1035] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48d6215c97db43a9ac8a6b4d2313c22a" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 40931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:19:50.847699 30327 consensus_queue.cc:1035] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0ec81cd3234c6b9c2f117a35b94897" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 41231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:19:50.862071 30339 mvcc.cc:205] Tried to move back new op lower bound from 7315488730493804544 to 7315488730009624576. Current Snapshot: MvccSnapshot[applied={T|T < 7315488730493804544}]
I20260806 09:19:50.878167 29840 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37310:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:19:50.878464 29840 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37310:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:19:50.882562 29840 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b6dc1cbfe14e45258129090e41e9d44f: Sending DeleteTablet for 3 replicas of tablet 567174a20eed475c987f3abf59cc3ba0
I20260806 09:19:50.884243 30101 tablet_service.cc:1514] Processing DeleteTablet for tablet 567174a20eed475c987f3abf59cc3ba0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:19:50 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:40472
I20260806 09:19:50.884212 29966 tablet_service.cc:1514] Processing DeleteTablet for tablet 567174a20eed475c987f3abf59cc3ba0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:19:50 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:47254
I20260806 09:19:50.884229 30236 tablet_service.cc:1514] Processing DeleteTablet for tablet 567174a20eed475c987f3abf59cc3ba0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:19:50 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:55468
I20260806 09:19:50.888981 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 29901
I20260806 09:19:50.898250 30350 tablet_replica.cc:330] T 567174a20eed475c987f3abf59cc3ba0 P ff0ec81cd3234c6b9c2f117a35b94897: stopping tablet replica
I20260806 09:19:50.898854 30350 raft_consensus.cc:2229] T 567174a20eed475c987f3abf59cc3ba0 P ff0ec81cd3234c6b9c2f117a35b94897 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:19:50.899434 30350 raft_consensus.cc:2258] T 567174a20eed475c987f3abf59cc3ba0 P ff0ec81cd3234c6b9c2f117a35b94897 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:19:50.902097 30350 ts_tablet_manager.cc:1905] T 567174a20eed475c987f3abf59cc3ba0 P ff0ec81cd3234c6b9c2f117a35b94897: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:19:50.909943 30350 ts_tablet_manager.cc:1918] T 567174a20eed475c987f3abf59cc3ba0 P ff0ec81cd3234c6b9c2f117a35b94897: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:19:50.910208 30350 log.cc:1196] T 567174a20eed475c987f3abf59cc3ba0 P ff0ec81cd3234c6b9c2f117a35b94897: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/567174a20eed475c987f3abf59cc3ba0
I20260806 09:19:50.910817 30350 ts_tablet_manager.cc:1939] T 567174a20eed475c987f3abf59cc3ba0 P ff0ec81cd3234c6b9c2f117a35b94897: Deleting consensus metadata
I20260806 09:19:50.911554 30351 tablet_replica.cc:330] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a: stopping tablet replica
I20260806 09:19:50.911935 30349 tablet_replica.cc:330] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09: stopping tablet replica
I20260806 09:19:50.912488 30349 raft_consensus.cc:2229] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09 [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:19:50.912989 29825 catalog_manager.cc:4841] TS ff0ec81cd3234c6b9c2f117a35b94897 (127.10.255.67:41231): tablet 567174a20eed475c987f3abf59cc3ba0 (table test-table [id=984d67cce5d54e858c1dce5af16f36a5]) successfully deleted
I20260806 09:19:50.913196 30351 raft_consensus.cc:2229] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:19:50.913390 30349 raft_consensus.cc:2258] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:19:50.913822 30351 raft_consensus.cc:2258] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:19:50.915585 30349 ts_tablet_manager.cc:1905] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:19:50.915632 30351 ts_tablet_manager.cc:1905] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:19:50.923431 30351 ts_tablet_manager.cc:1918] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:19:50.923667 30351 log.cc:1196] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-0/wal/wals/567174a20eed475c987f3abf59cc3ba0
I20260806 09:19:50.923657 30349 ts_tablet_manager.cc:1918] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
Aug 06 09:19:50 dist-test-slave-mvvj krb5kdc[29795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007987, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.65@KRBTEST.COM
I20260806 09:19:50.924072 30349 log.cc:1196] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/567174a20eed475c987f3abf59cc3ba0
I20260806 09:19:50.924355 30351 ts_tablet_manager.cc:1939] T 567174a20eed475c987f3abf59cc3ba0 P 48d6215c97db43a9ac8a6b4d2313c22a: Deleting consensus metadata
I20260806 09:19:50.924842 30349 ts_tablet_manager.cc:1939] T 567174a20eed475c987f3abf59cc3ba0 P b0feee44e8ba4e9c91e96364c63b5d09: Deleting consensus metadata
I20260806 09:19:50.926666 29825 catalog_manager.cc:4841] TS 48d6215c97db43a9ac8a6b4d2313c22a (127.10.255.65:40931): tablet 567174a20eed475c987f3abf59cc3ba0 (table test-table [id=984d67cce5d54e858c1dce5af16f36a5]) successfully deleted
I20260806 09:19:50.927084 29824 catalog_manager.cc:4841] TS b0feee44e8ba4e9c91e96364c63b5d09 (127.10.255.66:43515): tablet 567174a20eed475c987f3abf59cc3ba0 (table test-table [id=984d67cce5d54e858c1dce5af16f36a5]) successfully deleted
I20260806 09:19:50.934254 30316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:50.890777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47266 (local address 127.10.255.65:40931)
0806 09:19:50.891047 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:50.891057 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:50.894138 (+ 3081us) server_negotiation.cc:407] Connection header received
0806 09:19:50.894255 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:50.894264 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:50.894401 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:50.894534 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:50.907270 (+ 12736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.909009 (+ 1739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.914754 (+ 5745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:50.915476 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:50.915612 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:50.925341 (+ 9729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:50.925359 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:50.925378 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:50.925443 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:50.930619 (+ 5176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:50.931625 (+ 1006us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:50.931637 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:50.931641 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:50.931903 (+ 262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:50.932391 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:50.932397 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:50.932401 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:50.932931 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:50.933239 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:50.933584 (+ 345us) server_negotiation.cc:299] Negotiation successful
0806 09:19:50.933850 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 09:19:50.935077 30026 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:51.053855 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 29901
I20260806 09:19:51.073107 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 30038
Aug 06 09:19:51 dist-test-slave-mvvj krb5kdc[29795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007987, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.66@KRBTEST.COM
I20260806 09:19:51.093912 30318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:51.074031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40498 (local address 127.10.255.66:43515)
0806 09:19:51.074249 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:51.074256 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:51.074279 (+ 23us) server_negotiation.cc:407] Connection header received
0806 09:19:51.074430 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:51.074436 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:51.074533 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:51.074742 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:51.076400 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:51.077629 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:51.079026 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:51.079769 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:51.079959 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:51.085635 (+ 5676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:51.085659 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:51.085687 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:51.085770 (+ 83us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:51.090303 (+ 4533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:51.091304 (+ 1001us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:51.091322 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:51.091326 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:51.091499 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:51.092058 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:51.092064 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:51.092068 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:51.092628 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:51.092962 (+ 334us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:51.093268 (+ 306us) server_negotiation.cc:299] Negotiation successful
0806 09:19:51.093533 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 09:19:51.094846 30162 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:51.216879 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 30038
I20260806 09:19:51.237429 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 30173
Aug 06 09:19:51 dist-test-slave-mvvj krb5kdc[29795](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007987, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.67@KRBTEST.COM
I20260806 09:19:51.255173 30355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:51.238332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55476 (local address 127.10.255.67:41231)
0806 09:19:51.238887 (+ 555us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:51.238892 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:51.238911 (+ 19us) server_negotiation.cc:407] Connection header received
0806 09:19:51.238972 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:51.238976 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:51.239051 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:51.239155 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:51.240838 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:51.241573 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:51.243131 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:51.243602 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:51.243725 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:51.248755 (+ 5030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:51.248775 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:51.248792 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:51.248842 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:51.252284 (+ 3442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:51.253164 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:51.253171 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:51.253173 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:51.253316 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:51.253700 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:51.253704 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:51.253706 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:51.254188 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:51.254431 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:51.254711 (+ 280us) server_negotiation.cc:299] Negotiation successful
0806 09:19:51.254893 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":312,"threads_started":1}
I20260806 09:19:51.256008 30297 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:51.348889 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 30173
I20260806 09:19:51.367405 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 29808
I20260806 09:19:51.369005 29870 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:51.488374 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 29808
2026-08-06T09:19:51Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (5048 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-06T09:19:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:19:51Z Disabled control of system clock
I20260806 09:19:51.575488 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:46157
--webserver_interface=127.10.255.126
--webserver_port=0
--builtin_ntp_servers=127.10.255.84:39237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:46157
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 09:19:51.944732 30361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:19:51.945058 30361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:19:51.945215 30361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:19:51.952814 30361 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:19:51.952948 30361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:19:51.953027 30361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:19:51.953119 30361 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:19:51.953238 30361 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:19:51.963096 30361 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:39237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:46157
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:46157
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:51.964569 30361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:51.966544 30361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:19:51.979403 30367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:51.979492 30369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:51.979889 30366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:51.981285 30361 server_base.cc:1034] running on GCE node
I20260806 09:19:51.982308 30361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:51.984126 30361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:51.985421 30361 hybrid_clock.cc:648] HybridClock initialized: now 1786007991985364 us; error 47 us; skew 500 ppm
I20260806 09:19:51.985846 30361 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:19:51.988667 30361 webserver.cc:460] Webserver started at http://127.10.255.126:38333/ using document root <none> and password file <none>
I20260806 09:19:51.989476 30361 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:51.989625 30361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:51.989997 30361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:19:51.993310 30361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "1ec6a75a48f64992b27c9ccba4490844"
format_stamp: "Formatted at 2026-08-06 09:19:51 on dist-test-slave-mvvj"
server_key: "e1ab3d0cacd87aa191ea695d9a11ff37"
server_key_iv: "119be4d3756a5002a419c972e536162e"
server_key_version: "encryptionkey@0"
I20260806 09:19:51.994280 30361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "1ec6a75a48f64992b27c9ccba4490844"
format_stamp: "Formatted at 2026-08-06 09:19:51 on dist-test-slave-mvvj"
server_key: "e1ab3d0cacd87aa191ea695d9a11ff37"
server_key_iv: "119be4d3756a5002a419c972e536162e"
server_key_version: "encryptionkey@0"
I20260806 09:19:52.000262 30361 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260806 09:19:52.004511 30375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:52.006220 30361 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 09:19:52.006501 30361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "1ec6a75a48f64992b27c9ccba4490844"
format_stamp: "Formatted at 2026-08-06 09:19:51 on dist-test-slave-mvvj"
server_key: "e1ab3d0cacd87aa191ea695d9a11ff37"
server_key_iv: "119be4d3756a5002a419c972e536162e"
server_key_version: "encryptionkey@0"
I20260806 09:19:52.006789 30361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:52.035202 30361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:52.036250 30361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:52.036590 30361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:52.057693 30361 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:46157
I20260806 09:19:52.057713 30427 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:46157 every 8 connection(s)
I20260806 09:19:52.059240 30361 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:19:52.063900 30428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:19:52.066231 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 30361
I20260806 09:19:52.066493 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:19:52.066990 11261 external_mini_cluster.cc:1428] Setting key cb81172686f2508bbbc04377b03bd51d
I20260806 09:19:52.076849 30428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ec6a75a48f64992b27c9ccba4490844: Bootstrap starting.
I20260806 09:19:52.080578 30428 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ec6a75a48f64992b27c9ccba4490844: Neither blocks nor log segments found. Creating new log.
I20260806 09:19:52.081862 30428 log.cc:824] T 00000000000000000000000000000000 P 1ec6a75a48f64992b27c9ccba4490844: Log is configured to *not* fsync() on all Append() calls
I20260806 09:19:52.084028 30431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:52.069304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53770 (local address 127.10.255.126:46157)
0806 09:19:52.070572 (+ 1268us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:52.070585 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:52.070643 (+ 58us) server_negotiation.cc:407] Connection header received
0806 09:19:52.072886 (+ 2243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:52.072914 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:52.073709 (+ 795us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:52.074281 (+ 572us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:52.075124 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:52.076569 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:52.078157 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:52.078944 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:52.079176 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:52.080805 (+ 1629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:52.080825 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:52.080842 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:19:52.081535 (+ 693us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:52.081617 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:19:52.081643 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:52.081823 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:52.082092 (+ 269us) server_negotiation.cc:299] Negotiation successful
0806 09:19:52.082470 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":773,"thread_start_us":484,"threads_started":1}
I20260806 09:19:52.086297 30428 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ec6a75a48f64992b27c9ccba4490844: No bootstrap required, opened a new log
I20260806 09:19:52.095970 30428 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ec6a75a48f64992b27c9ccba4490844 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ec6a75a48f64992b27c9ccba4490844" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 46157 } }
I20260806 09:19:52.096493 30428 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1ec6a75a48f64992b27c9ccba4490844 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:19:52.096643 30428 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ec6a75a48f64992b27c9ccba4490844 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ec6a75a48f64992b27c9ccba4490844, State: Initialized, Role: FOLLOWER
I20260806 09:19:52.097411 30428 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ec6a75a48f64992b27c9ccba4490844 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ec6a75a48f64992b27c9ccba4490844" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 46157 } }
I20260806 09:19:52.097716 30428 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1ec6a75a48f64992b27c9ccba4490844 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:19:52.097896 30428 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ec6a75a48f64992b27c9ccba4490844 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:19:52.098106 30428 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ec6a75a48f64992b27c9ccba4490844 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:19:52.101171 30428 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ec6a75a48f64992b27c9ccba4490844 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ec6a75a48f64992b27c9ccba4490844" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 46157 } }
I20260806 09:19:52.101799 30428 leader_election.cc:302] T 00000000000000000000000000000000 P 1ec6a75a48f64992b27c9ccba4490844 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ec6a75a48f64992b27c9ccba4490844; no voters:
I20260806 09:19:52.102634 30428 leader_election.cc:288] T 00000000000000000000000000000000 P 1ec6a75a48f64992b27c9ccba4490844 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:19:52.102861 30433 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ec6a75a48f64992b27c9ccba4490844 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:19:52.103696 30433 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ec6a75a48f64992b27c9ccba4490844 [term 1 LEADER]: Becoming Leader. State: Replica: 1ec6a75a48f64992b27c9ccba4490844, State: Running, Role: LEADER
I20260806 09:19:52.104305 30433 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ec6a75a48f64992b27c9ccba4490844 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ec6a75a48f64992b27c9ccba4490844" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 46157 } }
I20260806 09:19:52.105182 30428 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ec6a75a48f64992b27c9ccba4490844 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:19:52.107262 30434 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ec6a75a48f64992b27c9ccba4490844 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1ec6a75a48f64992b27c9ccba4490844" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ec6a75a48f64992b27c9ccba4490844" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 46157 } } }
I20260806 09:19:52.107733 30434 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ec6a75a48f64992b27c9ccba4490844 [sys.catalog]: This master's current role is: LEADER
I20260806 09:19:52.108855 30438 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:19:52.108662 30435 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ec6a75a48f64992b27c9ccba4490844 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ec6a75a48f64992b27c9ccba4490844. Latest consensus state: current_term: 1 leader_uuid: "1ec6a75a48f64992b27c9ccba4490844" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ec6a75a48f64992b27c9ccba4490844" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 46157 } } }
I20260806 09:19:52.109006 30435 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ec6a75a48f64992b27c9ccba4490844 [sys.catalog]: This master's current role is: LEADER
I20260806 09:19:52.116209 30438 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:19:52.128031 30438 catalog_manager.cc:1347] Generated new cluster ID: a8ebbe0e81e04b05b5cb6bbe4b500928
I20260806 09:19:52.128186 30438 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:19:52.155857 30438 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:19:52.157471 30438 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:19:52.166307 30438 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1ec6a75a48f64992b27c9ccba4490844: Generated new TSK 0
I20260806 09:19:52.167306 30438 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:19:52.177172 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:46157
--builtin_ntp_servers=127.10.255.84:39237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 09:19:52.560163 30452 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:19:52.560511 30452 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:19:52.560698 30452 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:19:52.569232 30452 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:19:52.569372 30452 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:19:52.569561 30452 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:19:52.580531 30452 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:39237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:46157
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:52.582190 30452 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:52.584378 30452 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:19:52.601054 30460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:52.601114 30458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:52.600997 30457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:52.601899 30452 server_base.cc:1034] running on GCE node
I20260806 09:19:52.602782 30452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:52.604142 30452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:52.605487 30452 hybrid_clock.cc:648] HybridClock initialized: now 1786007992605356 us; error 71 us; skew 500 ppm
I20260806 09:19:52.605908 30452 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:19:52.608896 30452 webserver.cc:460] Webserver started at http://127.10.255.65:39287/ using document root <none> and password file <none>
I20260806 09:19:52.609730 30452 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:52.609879 30452 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:52.610232 30452 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:19:52.614554 30452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "c567f15f7fb143d695cff0a6011f8bb2"
format_stamp: "Formatted at 2026-08-06 09:19:52 on dist-test-slave-mvvj"
server_key: "080834040f5789f42d8cfc8ff7c799b2"
server_key_iv: "4c8f846afdf88b88ce341c86bfd6dd01"
server_key_version: "encryptionkey@0"
I20260806 09:19:52.615479 30452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "c567f15f7fb143d695cff0a6011f8bb2"
format_stamp: "Formatted at 2026-08-06 09:19:52 on dist-test-slave-mvvj"
server_key: "080834040f5789f42d8cfc8ff7c799b2"
server_key_iv: "4c8f846afdf88b88ce341c86bfd6dd01"
server_key_version: "encryptionkey@0"
I20260806 09:19:52.621757 30452 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260806 09:19:52.626307 30466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:52.628336 30452 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:19:52.628717 30452 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "c567f15f7fb143d695cff0a6011f8bb2"
format_stamp: "Formatted at 2026-08-06 09:19:52 on dist-test-slave-mvvj"
server_key: "080834040f5789f42d8cfc8ff7c799b2"
server_key_iv: "4c8f846afdf88b88ce341c86bfd6dd01"
server_key_version: "encryptionkey@0"
I20260806 09:19:52.629010 30452 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:52.650187 30452 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:52.651168 30452 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:52.651537 30452 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:52.652813 30452 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:19:52.654436 30452 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:19:52.654582 30452 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:52.654721 30452 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:19:52.654795 30452 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:52.691956 30452 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:35011
I20260806 09:19:52.692010 30579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:35011 every 8 connection(s)
I20260806 09:19:52.693419 30452 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:19:52.696054 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 30452
I20260806 09:19:52.696242 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:19:52.696883 11261 external_mini_cluster.cc:1428] Setting key 22221e2e257da3de07a6d6a5ddedb398
I20260806 09:19:52.699828 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:46157
--builtin_ntp_servers=127.10.255.84:39237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 09:19:52.710039 30582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:52.696567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:55559 (local address 127.10.255.126:46157)
0806 09:19:52.697130 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:52.697137 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:52.698859 (+ 1722us) server_negotiation.cc:407] Connection header received
0806 09:19:52.701266 (+ 2407us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:52.701276 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:52.701383 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:52.701525 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:52.702964 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:52.704171 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:52.706047 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:52.706866 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:52.707048 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:52.709024 (+ 1976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:52.709055 (+ 31us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:52.709058 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:19:52.709082 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:52.709128 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:19:52.709141 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:52.709262 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:52.709527 (+ 265us) server_negotiation.cc:299] Negotiation successful
0806 09:19:52.709648 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":391,"thread_start_us":261,"threads_started":1}
I20260806 09:19:52.711194 30583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:52.697363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:46157 (local address 127.10.255.65:55559)
0806 09:19:52.698668 (+ 1305us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:52.698722 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:52.700875 (+ 2153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:52.701861 (+ 986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:52.701872 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:52.701989 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:19:52.702725 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:52.702748 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:52.704400 (+ 1652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:52.704405 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:52.705801 (+ 1396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:52.705831 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:52.707215 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:52.707223 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:52.707509 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:52.708486 (+ 977us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 09:19:52.708489 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:19:52.708594 (+ 105us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 09:19:52.708703 (+ 109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:19:52.709266 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:19:52.709282 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:19:52.709293 (+ 11us) client_negotiation.cc:769] Sending connection context
0806 09:19:52.709515 (+ 222us) client_negotiation.cc:240] Negotiation successful
0806 09:19:52.709998 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"thread_start_us":412,"threads_started":1}
I20260806 09:19:52.713502 30580 heartbeater.cc:347] Connected to a master server at 127.10.255.126:46157
I20260806 09:19:52.713913 30580 heartbeater.cc:464] Registering TS with master...
I20260806 09:19:52.714825 30580 heartbeater.cc:511] Master 127.10.255.126:46157 requested a full tablet report, sending...
I20260806 09:19:52.717509 30392 ts_manager.cc:194] Registered new tserver with Master: c567f15f7fb143d695cff0a6011f8bb2 (127.10.255.65:35011)
I20260806 09:19:52.720094 30392 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.255.65:55559
W20260806 09:19:53.080165 30584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:19:53.080475 30584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:19:53.080569 30584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:19:53.088173 30584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:19:53.088297 30584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:19:53.088408 30584 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:19:53.098446 30584 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:39237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:46157
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:53.099771 30584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:53.101670 30584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:19:53.117357 30592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:53.117581 30590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:53.117889 30589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:53.118073 30584 server_base.cc:1034] running on GCE node
I20260806 09:19:53.119620 30584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:53.122125 30584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:53.123430 30584 hybrid_clock.cc:648] HybridClock initialized: now 1786007993123300 us; error 111 us; skew 500 ppm
I20260806 09:19:53.124037 30584 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:19:53.126973 30584 webserver.cc:460] Webserver started at http://127.10.255.66:34817/ using document root <none> and password file <none>
I20260806 09:19:53.127811 30584 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:53.128060 30584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:53.128437 30584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:19:53.132385 30584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "1e718ef572fa4f57a51c07b7394338cb"
format_stamp: "Formatted at 2026-08-06 09:19:53 on dist-test-slave-mvvj"
server_key: "1646a001da5f7c79d674d9c11e842b94"
server_key_iv: "3c3e6039bb1630e304925d9aa07b617f"
server_key_version: "encryptionkey@0"
I20260806 09:19:53.133438 30584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "1e718ef572fa4f57a51c07b7394338cb"
format_stamp: "Formatted at 2026-08-06 09:19:53 on dist-test-slave-mvvj"
server_key: "1646a001da5f7c79d674d9c11e842b94"
server_key_iv: "3c3e6039bb1630e304925d9aa07b617f"
server_key_version: "encryptionkey@0"
I20260806 09:19:53.139648 30584 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260806 09:19:53.144196 30598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:53.145972 30584 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:19:53.146237 30584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "1e718ef572fa4f57a51c07b7394338cb"
format_stamp: "Formatted at 2026-08-06 09:19:53 on dist-test-slave-mvvj"
server_key: "1646a001da5f7c79d674d9c11e842b94"
server_key_iv: "3c3e6039bb1630e304925d9aa07b617f"
server_key_version: "encryptionkey@0"
I20260806 09:19:53.146548 30584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:53.172413 30584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:53.173444 30584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:53.173817 30584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:53.175027 30584 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:19:53.177093 30584 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:19:53.177234 30584 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:53.177383 30584 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:19:53.177474 30584 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:53.214362 30584 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:35601
I20260806 09:19:53.214463 30711 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:35601 every 8 connection(s)
I20260806 09:19:53.215809 30584 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:19:53.216333 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 30584
I20260806 09:19:53.216550 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:19:53.217181 11261 external_mini_cluster.cc:1428] Setting key 3c6c8a2bf0755653fc5ef3eb34ae01be
I20260806 09:19:53.220925 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:46157
--builtin_ntp_servers=127.10.255.84:39237
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 09:19:53.233898 30714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:53.220015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:60387 (local address 127.10.255.126:46157)
0806 09:19:53.220588 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:53.220594 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:53.222184 (+ 1590us) server_negotiation.cc:407] Connection header received
0806 09:19:53.225160 (+ 2976us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:53.225165 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:53.225238 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:53.225341 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:53.226884 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:53.227697 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:53.230470 (+ 2773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:53.230949 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:53.231113 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:53.232728 (+ 1615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:53.232737 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:53.232745 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:19:53.232775 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:53.232832 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:19:53.232851 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:53.232953 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:53.233222 (+ 269us) server_negotiation.cc:299] Negotiation successful
0806 09:19:53.233421 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":324,"threads_started":1}
I20260806 09:19:53.235026 30715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:53.220758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:46157 (local address 127.10.255.66:60387)
0806 09:19:53.221956 (+ 1198us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:53.222007 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:53.224792 (+ 2785us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:53.225631 (+ 839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:53.225645 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:53.225778 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:19:53.226647 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:53.226675 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:53.227928 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:53.227937 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:53.230228 (+ 2291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:53.230251 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:53.231261 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:53.231268 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:53.231503 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:53.232338 (+ 835us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 09:19:53.232342 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:19:53.232394 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 09:19:53.232496 (+ 102us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:19:53.232959 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:19:53.232968 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:19:53.232975 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 09:19:53.233170 (+ 195us) client_negotiation.cc:240] Negotiation successful
0806 09:19:53.233590 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":363,"threads_started":1}
I20260806 09:19:53.236832 30712 heartbeater.cc:347] Connected to a master server at 127.10.255.126:46157
I20260806 09:19:53.237192 30712 heartbeater.cc:464] Registering TS with master...
I20260806 09:19:53.238014 30712 heartbeater.cc:511] Master 127.10.255.126:46157 requested a full tablet report, sending...
I20260806 09:19:53.239790 30392 ts_manager.cc:194] Registered new tserver with Master: 1e718ef572fa4f57a51c07b7394338cb (127.10.255.66:35601)
I20260806 09:19:53.241150 30392 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.255.66:60387
W20260806 09:19:53.587788 30716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:19:53.588186 30716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:19:53.588354 30716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:19:53.596114 30716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:19:53.596225 30716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:19:53.596398 30716 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:19:53.606446 30716 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:39237
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:46157
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:53.608144 30716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:53.610241 30716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:19:53.627044 30721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:53.626981 30724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:53.627017 30722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:53.627970 30716 server_base.cc:1034] running on GCE node
I20260806 09:19:53.628719 30716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:53.629827 30716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:53.631114 30716 hybrid_clock.cc:648] HybridClock initialized: now 1786007993631024 us; error 69 us; skew 500 ppm
I20260806 09:19:53.631513 30716 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:19:53.634591 30716 webserver.cc:460] Webserver started at http://127.10.255.67:43651/ using document root <none> and password file <none>
I20260806 09:19:53.635465 30716 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:53.635623 30716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:53.636050 30716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:19:53.639294 30716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "e4d7e8f7c95b48dcb23d086af31227c7"
format_stamp: "Formatted at 2026-08-06 09:19:53 on dist-test-slave-mvvj"
server_key: "fa33a207e2b8658d220987df1048a990"
server_key_iv: "a281c75fba22e43412d11b696ce01591"
server_key_version: "encryptionkey@0"
I20260806 09:19:53.640462 30716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "e4d7e8f7c95b48dcb23d086af31227c7"
format_stamp: "Formatted at 2026-08-06 09:19:53 on dist-test-slave-mvvj"
server_key: "fa33a207e2b8658d220987df1048a990"
server_key_iv: "a281c75fba22e43412d11b696ce01591"
server_key_version: "encryptionkey@0"
I20260806 09:19:53.646751 30716 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 09:19:53.651237 30730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:53.653107 30716 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:19:53.653360 30716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "e4d7e8f7c95b48dcb23d086af31227c7"
format_stamp: "Formatted at 2026-08-06 09:19:53 on dist-test-slave-mvvj"
server_key: "fa33a207e2b8658d220987df1048a990"
server_key_iv: "a281c75fba22e43412d11b696ce01591"
server_key_version: "encryptionkey@0"
I20260806 09:19:53.653647 30716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:53.673688 30716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:53.674727 30716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:53.675088 30716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:53.676337 30716 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:19:53.678042 30716 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:19:53.678190 30716 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:53.678325 30716 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:19:53.678438 30716 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:53.716652 30716 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:38491
I20260806 09:19:53.716722 30845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:38491 every 8 connection(s)
I20260806 09:19:53.718160 30716 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:19:53.724928 30580 heartbeater.cc:503] Master 127.10.255.126:46157 was elected leader, sending a full tablet report...
I20260806 09:19:53.725576 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 30716
I20260806 09:19:53.725802 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:19:53.726395 11261 external_mini_cluster.cc:1428] Setting key d019882dc8924fa70823adf53a6283ba
I20260806 09:19:53.734397 30714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:53.721524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:33283 (local address 127.10.255.126:46157)
0806 09:19:53.721757 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:53.721765 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:53.723365 (+ 1600us) server_negotiation.cc:407] Connection header received
0806 09:19:53.725962 (+ 2597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:53.725969 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:53.726096 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:53.726215 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:53.728035 (+ 1820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:53.728878 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:53.730806 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:53.731270 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:53.731438 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:53.733332 (+ 1894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:53.733338 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:53.733342 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:19:53.733364 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:53.733401 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:19:53.733415 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:53.733528 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:53.733814 (+ 286us) server_negotiation.cc:299] Negotiation successful
0806 09:19:53.733963 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260806 09:19:53.735608 30848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:53.722095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:46157 (local address 127.10.255.67:33283)
0806 09:19:53.723161 (+ 1066us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:53.723209 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:53.725603 (+ 2394us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:53.726690 (+ 1087us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:53.726701 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:53.726815 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:19:53.727781 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:53.727804 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:53.729065 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:53.729071 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:53.730636 (+ 1565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:53.730651 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:53.731560 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:53.731568 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:53.731902 (+ 334us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:53.732851 (+ 949us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 09:19:53.732856 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:19:53.732923 (+ 67us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 09:19:53.733022 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:19:53.733539 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:19:53.733554 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:19:53.733564 (+ 10us) client_negotiation.cc:769] Sending connection context
0806 09:19:53.733783 (+ 219us) client_negotiation.cc:240] Negotiation successful
0806 09:19:53.734290 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":557,"thread_start_us":329,"threads_started":1}
I20260806 09:19:53.737641 30846 heartbeater.cc:347] Connected to a master server at 127.10.255.126:46157
I20260806 09:19:53.737998 30846 heartbeater.cc:464] Registering TS with master...
I20260806 09:19:53.738893 30846 heartbeater.cc:511] Master 127.10.255.126:46157 requested a full tablet report, sending...
I20260806 09:19:53.740737 30392 ts_manager.cc:194] Registered new tserver with Master: e4d7e8f7c95b48dcb23d086af31227c7 (127.10.255.67:38491)
I20260806 09:19:53.742007 30392 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.255.67:33283
I20260806 09:19:53.742465 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 09:19:53.754652 30714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:53.747402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53772 (local address 127.10.255.126:46157)
0806 09:19:53.747638 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:53.747644 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:53.748077 (+ 433us) server_negotiation.cc:407] Connection header received
0806 09:19:53.748280 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:53.748284 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:53.748359 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:53.748466 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:53.749197 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:53.750052 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:53.751928 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:53.752431 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:53.752547 (+ 116us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:53.753768 (+ 1221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:53.753772 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:53.753776 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:19:53.753796 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:53.753831 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:19:53.753842 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:53.753965 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:53.754205 (+ 240us) server_negotiation.cc:299] Negotiation successful
0806 09:19:53.754287 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260806 09:19:53.759454 30392 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53772:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:19:53.767315 30392 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:19:53.806916 30858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:53.782059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:35011 (local address 127.0.0.1:46862)
0806 09:19:53.794245 (+ 12186us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:53.794273 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:53.794446 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:53.797627 (+ 3181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:53.797637 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:53.797696 (+ 59us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:53.798292 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:53.798316 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:53.801149 (+ 2833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:53.801157 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:53.803817 (+ 2660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:53.803891 (+ 74us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:53.806154 (+ 2263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:53.806161 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:53.806323 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:53.806358 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 09:19:53.806466 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 09:19:53.806619 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11989,"mutex_wait_us":285,"spinlock_wait_cycles":9728,"thread_start_us":10161,"threads_started":1}
I20260806 09:19:53.808221 30863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:53.795271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:35601 (local address 127.0.0.1:43718)
0806 09:19:53.798887 (+ 3616us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:53.798903 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:53.799125 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:53.799722 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:53.799726 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:53.799753 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:53.800163 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:53.800177 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:53.802016 (+ 1839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:53.802023 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:53.804891 (+ 2868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:53.804908 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:53.807257 (+ 2349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:53.807264 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:53.807504 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:53.807548 (+ 44us) client_negotiation.cc:769] Sending connection context
0806 09:19:53.807647 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 09:19:53.807795 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3505,"mutex_wait_us":1,"thread_start_us":3204,"threads_started":1}
I20260806 09:19:53.808411 30860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:53.781405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:38491 (local address 127.0.0.1:32950)
0806 09:19:53.792786 (+ 11381us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:53.792846 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:53.793106 (+ 260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:53.797627 (+ 4521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:53.797637 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:53.797688 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:53.799136 (+ 1448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:53.799151 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:53.801395 (+ 2244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:53.801400 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:53.804529 (+ 3129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:53.804547 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:53.807393 (+ 2846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:53.807402 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:53.807622 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:53.807673 (+ 51us) client_negotiation.cc:769] Sending connection context
0806 09:19:53.807771 (+ 98us) client_negotiation.cc:240] Negotiation successful
0806 09:19:53.807962 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11022,"mutex_wait_us":944,"spinlock_wait_cycles":768,"thread_start_us":12415,"threads_started":1}
I20260806 09:19:53.808437 30861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:53.782580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46862 (local address 127.10.255.65:35011)
0806 09:19:53.795237 (+ 12657us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:53.795251 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:53.795297 (+ 46us) server_negotiation.cc:407] Connection header received
0806 09:19:53.795451 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:53.795465 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:53.795793 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:53.798387 (+ 2594us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:53.798775 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:53.800952 (+ 2177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:53.804135 (+ 3183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:53.805638 (+ 1503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:53.805792 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:53.807639 (+ 1847us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:53.807725 (+ 86us) server_negotiation.cc:299] Negotiation successful
0806 09:19:53.807942 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12394,"thread_start_us":12101,"threads_started":1}
I20260806 09:19:53.808673 30862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:53.794814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43718 (local address 127.10.255.66:35601)
0806 09:19:53.798215 (+ 3401us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:53.798228 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:53.799028 (+ 800us) server_negotiation.cc:407] Connection header received
0806 09:19:53.799319 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:53.799326 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:53.799526 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:53.799730 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:53.800390 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:53.801828 (+ 1438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:53.805200 (+ 3372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:53.806909 (+ 1709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:53.807300 (+ 391us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:53.807570 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:53.807724 (+ 154us) server_negotiation.cc:299] Negotiation successful
0806 09:19:53.807965 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3188,"thread_start_us":3043,"threads_started":1}
I20260806 09:19:53.809268 30859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:53.781697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32950 (local address 127.10.255.67:38491)
0806 09:19:53.796535 (+ 14838us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:53.796546 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:53.796610 (+ 64us) server_negotiation.cc:407] Connection header received
0806 09:19:53.796718 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:53.796725 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:53.796981 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:53.797202 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:53.799410 (+ 2208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:53.801209 (+ 1799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:53.804820 (+ 3611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:53.806728 (+ 1908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:53.806890 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:53.807223 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:53.808702 (+ 1479us) server_negotiation.cc:299] Negotiation successful
0806 09:19:53.808914 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14627,"thread_start_us":15629,"threads_started":1}
I20260806 09:19:53.813222 30779 tablet_service.cc:1467] Processing CreateTablet for tablet 068a62b252554f40a15215ae0dfe5afd (DEFAULT_TABLE table=test-table [id=6dab310728fc44d98361fc26a7390137]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:19:53.813315 30646 tablet_service.cc:1467] Processing CreateTablet for tablet 068a62b252554f40a15215ae0dfe5afd (DEFAULT_TABLE table=test-table [id=6dab310728fc44d98361fc26a7390137]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:19:53.813828 30514 tablet_service.cc:1467] Processing CreateTablet for tablet 068a62b252554f40a15215ae0dfe5afd (DEFAULT_TABLE table=test-table [id=6dab310728fc44d98361fc26a7390137]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:19:53.814836 30779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 068a62b252554f40a15215ae0dfe5afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:19:53.815043 30646 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 068a62b252554f40a15215ae0dfe5afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:19:53.815418 30514 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 068a62b252554f40a15215ae0dfe5afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:19:53.829944 30864 tablet_bootstrap.cc:492] T 068a62b252554f40a15215ae0dfe5afd P e4d7e8f7c95b48dcb23d086af31227c7: Bootstrap starting.
I20260806 09:19:53.832518 30866 tablet_bootstrap.cc:492] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb: Bootstrap starting.
I20260806 09:19:53.835009 30864 tablet_bootstrap.cc:654] T 068a62b252554f40a15215ae0dfe5afd P e4d7e8f7c95b48dcb23d086af31227c7: Neither blocks nor log segments found. Creating new log.
I20260806 09:19:53.837224 30866 tablet_bootstrap.cc:654] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb: Neither blocks nor log segments found. Creating new log.
I20260806 09:19:53.837186 30864 log.cc:824] T 068a62b252554f40a15215ae0dfe5afd P e4d7e8f7c95b48dcb23d086af31227c7: Log is configured to *not* fsync() on all Append() calls
I20260806 09:19:53.838704 30866 log.cc:824] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb: Log is configured to *not* fsync() on all Append() calls
I20260806 09:19:53.839048 30865 tablet_bootstrap.cc:492] T 068a62b252554f40a15215ae0dfe5afd P c567f15f7fb143d695cff0a6011f8bb2: Bootstrap starting.
I20260806 09:19:53.841704 30864 tablet_bootstrap.cc:492] T 068a62b252554f40a15215ae0dfe5afd P e4d7e8f7c95b48dcb23d086af31227c7: No bootstrap required, opened a new log
I20260806 09:19:53.843004 30864 ts_tablet_manager.cc:1397] T 068a62b252554f40a15215ae0dfe5afd P e4d7e8f7c95b48dcb23d086af31227c7: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.007s
I20260806 09:19:53.843956 30865 tablet_bootstrap.cc:654] T 068a62b252554f40a15215ae0dfe5afd P c567f15f7fb143d695cff0a6011f8bb2: Neither blocks nor log segments found. Creating new log.
I20260806 09:19:53.845323 30866 tablet_bootstrap.cc:492] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb: No bootstrap required, opened a new log
I20260806 09:19:53.845402 30865 log.cc:824] T 068a62b252554f40a15215ae0dfe5afd P c567f15f7fb143d695cff0a6011f8bb2: Log is configured to *not* fsync() on all Append() calls
I20260806 09:19:53.845676 30866 ts_tablet_manager.cc:1397] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.007s
I20260806 09:19:53.852488 30864 raft_consensus.cc:348] T 068a62b252554f40a15215ae0dfe5afd P e4d7e8f7c95b48dcb23d086af31227c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d7e8f7c95b48dcb23d086af31227c7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38491 } } peers { permanent_uuid: "1e718ef572fa4f57a51c07b7394338cb" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35601 } } peers { permanent_uuid: "c567f15f7fb143d695cff0a6011f8bb2" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35011 } }
I20260806 09:19:53.853111 30864 raft_consensus.cc:374] T 068a62b252554f40a15215ae0dfe5afd P e4d7e8f7c95b48dcb23d086af31227c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:19:53.853233 30864 raft_consensus.cc:729] T 068a62b252554f40a15215ae0dfe5afd P e4d7e8f7c95b48dcb23d086af31227c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4d7e8f7c95b48dcb23d086af31227c7, State: Initialized, Role: FOLLOWER
I20260806 09:19:53.853971 30864 consensus_queue.cc:260] T 068a62b252554f40a15215ae0dfe5afd P e4d7e8f7c95b48dcb23d086af31227c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d7e8f7c95b48dcb23d086af31227c7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38491 } } peers { permanent_uuid: "1e718ef572fa4f57a51c07b7394338cb" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35601 } } peers { permanent_uuid: "c567f15f7fb143d695cff0a6011f8bb2" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35011 } }
I20260806 09:19:53.855269 30846 heartbeater.cc:503] Master 127.10.255.126:46157 was elected leader, sending a full tablet report...
I20260806 09:19:53.855383 30865 tablet_bootstrap.cc:492] T 068a62b252554f40a15215ae0dfe5afd P c567f15f7fb143d695cff0a6011f8bb2: No bootstrap required, opened a new log
I20260806 09:19:53.855712 30865 ts_tablet_manager.cc:1397] T 068a62b252554f40a15215ae0dfe5afd P c567f15f7fb143d695cff0a6011f8bb2: Time spent bootstrapping tablet: real 0.017s user 0.006s sys 0.007s
I20260806 09:19:53.856050 30864 ts_tablet_manager.cc:1428] T 068a62b252554f40a15215ae0dfe5afd P e4d7e8f7c95b48dcb23d086af31227c7: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260806 09:19:53.857930 30866 raft_consensus.cc:348] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d7e8f7c95b48dcb23d086af31227c7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38491 } } peers { permanent_uuid: "1e718ef572fa4f57a51c07b7394338cb" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35601 } } peers { permanent_uuid: "c567f15f7fb143d695cff0a6011f8bb2" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35011 } }
I20260806 09:19:53.858390 30866 raft_consensus.cc:374] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:19:53.858484 30866 raft_consensus.cc:729] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e718ef572fa4f57a51c07b7394338cb, State: Initialized, Role: FOLLOWER
I20260806 09:19:53.859194 30866 consensus_queue.cc:260] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d7e8f7c95b48dcb23d086af31227c7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38491 } } peers { permanent_uuid: "1e718ef572fa4f57a51c07b7394338cb" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35601 } } peers { permanent_uuid: "c567f15f7fb143d695cff0a6011f8bb2" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35011 } }
I20260806 09:19:53.861708 30866 ts_tablet_manager.cc:1428] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb: Time spent starting tablet: real 0.016s user 0.017s sys 0.001s
I20260806 09:19:53.862201 30712 heartbeater.cc:503] Master 127.10.255.126:46157 was elected leader, sending a full tablet report...
I20260806 09:19:53.866361 30865 raft_consensus.cc:348] T 068a62b252554f40a15215ae0dfe5afd P c567f15f7fb143d695cff0a6011f8bb2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d7e8f7c95b48dcb23d086af31227c7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38491 } } peers { permanent_uuid: "1e718ef572fa4f57a51c07b7394338cb" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35601 } } peers { permanent_uuid: "c567f15f7fb143d695cff0a6011f8bb2" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35011 } }
I20260806 09:19:53.866850 30865 raft_consensus.cc:374] T 068a62b252554f40a15215ae0dfe5afd P c567f15f7fb143d695cff0a6011f8bb2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:19:53.866969 30865 raft_consensus.cc:729] T 068a62b252554f40a15215ae0dfe5afd P c567f15f7fb143d695cff0a6011f8bb2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c567f15f7fb143d695cff0a6011f8bb2, State: Initialized, Role: FOLLOWER
I20260806 09:19:53.867626 30865 consensus_queue.cc:260] T 068a62b252554f40a15215ae0dfe5afd P c567f15f7fb143d695cff0a6011f8bb2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d7e8f7c95b48dcb23d086af31227c7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38491 } } peers { permanent_uuid: "1e718ef572fa4f57a51c07b7394338cb" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35601 } } peers { permanent_uuid: "c567f15f7fb143d695cff0a6011f8bb2" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35011 } }
I20260806 09:19:53.869611 30865 ts_tablet_manager.cc:1428] T 068a62b252554f40a15215ae0dfe5afd P c567f15f7fb143d695cff0a6011f8bb2: Time spent starting tablet: real 0.014s user 0.013s sys 0.001s
W20260806 09:19:53.946225 30581 tablet.cc:2369] T 068a62b252554f40a15215ae0dfe5afd P c567f15f7fb143d695cff0a6011f8bb2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 09:19:53.970112 30713 tablet.cc:2369] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 09:19:53.970340 30847 tablet.cc:2369] T 068a62b252554f40a15215ae0dfe5afd P e4d7e8f7c95b48dcb23d086af31227c7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:19:54.102069 30871 raft_consensus.cc:482] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:19:54.102425 30871 raft_consensus.cc:504] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d7e8f7c95b48dcb23d086af31227c7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38491 } } peers { permanent_uuid: "1e718ef572fa4f57a51c07b7394338cb" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35601 } } peers { permanent_uuid: "c567f15f7fb143d695cff0a6011f8bb2" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35011 } }
I20260806 09:19:54.104269 30871 leader_election.cc:288] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4d7e8f7c95b48dcb23d086af31227c7 (127.10.255.67:38491), c567f15f7fb143d695cff0a6011f8bb2 (127.10.255.65:35011)
I20260806 09:19:54.111955 30861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:54.105077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:36677 (local address 127.10.255.65:35011)
0806 09:19:54.105330 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:54.105339 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:54.106164 (+ 825us) server_negotiation.cc:407] Connection header received
0806 09:19:54.106417 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:54.106421 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:54.106544 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:54.106653 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:54.107287 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:54.108056 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:54.110086 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:54.110955 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:54.111156 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:54.111231 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:54.111546 (+ 315us) server_negotiation.cc:299] Negotiation successful
0806 09:19:54.111679 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260806 09:19:54.112017 30859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:54.104847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:33023 (local address 127.10.255.67:38491)
0806 09:19:54.105096 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:54.105106 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:54.106090 (+ 984us) server_negotiation.cc:407] Connection header received
0806 09:19:54.106382 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:54.106386 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:54.106455 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:54.106571 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:54.107223 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:54.107983 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:54.110077 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:54.110874 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:54.111080 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:54.111154 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:54.111569 (+ 415us) server_negotiation.cc:299] Negotiation successful
0806 09:19:54.111705 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260806 09:19:54.112185 30873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:54.104514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:38491 (local address 127.10.255.66:33023)
0806 09:19:54.105940 (+ 1426us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:54.105965 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:54.106180 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:54.106591 (+ 411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:54.106596 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:54.106622 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:54.107060 (+ 438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:54.107072 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:54.108145 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:54.108150 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:54.109855 (+ 1705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:54.109868 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:54.111096 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:54.111103 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:54.111329 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:54.111379 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 09:19:54.111540 (+ 161us) client_negotiation.cc:240] Negotiation successful
0806 09:19:54.111690 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1129,"mutex_wait_us":109,"spinlock_wait_cycles":768,"thread_start_us":837,"threads_started":1}
I20260806 09:19:54.112275 30874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:54.105038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:35011 (local address 127.10.255.66:36677)
0806 09:19:54.106020 (+ 982us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:54.106040 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:54.106262 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:54.106669 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:54.106673 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:54.106701 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:54.107124 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:54.107134 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:54.108229 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:54.108234 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:54.109864 (+ 1630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:54.109878 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:54.111156 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:54.111162 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:54.111372 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:54.111396 (+ 24us) client_negotiation.cc:769] Sending connection context
0806 09:19:54.111502 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 09:19:54.111651 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":745,"mutex_wait_us":131,"spinlock_wait_cycles":23808,"thread_start_us":490,"threads_started":1}
I20260806 09:19:54.113478 30799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "068a62b252554f40a15215ae0dfe5afd" candidate_uuid: "1e718ef572fa4f57a51c07b7394338cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4d7e8f7c95b48dcb23d086af31227c7" is_pre_election: true
I20260806 09:19:54.113534 30534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "068a62b252554f40a15215ae0dfe5afd" candidate_uuid: "1e718ef572fa4f57a51c07b7394338cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c567f15f7fb143d695cff0a6011f8bb2" is_pre_election: true
I20260806 09:19:54.114058 30799 raft_consensus.cc:2454] T 068a62b252554f40a15215ae0dfe5afd P e4d7e8f7c95b48dcb23d086af31227c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e718ef572fa4f57a51c07b7394338cb in term 0.
I20260806 09:19:54.114125 30534 raft_consensus.cc:2454] T 068a62b252554f40a15215ae0dfe5afd P c567f15f7fb143d695cff0a6011f8bb2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e718ef572fa4f57a51c07b7394338cb in term 0.
I20260806 09:19:54.115000 30602 leader_election.cc:302] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1e718ef572fa4f57a51c07b7394338cb, c567f15f7fb143d695cff0a6011f8bb2, e4d7e8f7c95b48dcb23d086af31227c7; no voters:
I20260806 09:19:54.115474 30871 raft_consensus.cc:2781] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:19:54.115643 30871 raft_consensus.cc:482] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:19:54.115768 30871 raft_consensus.cc:3037] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:19:54.120040 30871 raft_consensus.cc:504] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d7e8f7c95b48dcb23d086af31227c7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38491 } } peers { permanent_uuid: "1e718ef572fa4f57a51c07b7394338cb" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35601 } } peers { permanent_uuid: "c567f15f7fb143d695cff0a6011f8bb2" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35011 } }
I20260806 09:19:54.121025 30871 leader_election.cc:288] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb [CANDIDATE]: Term 1 election: Requested vote from peers e4d7e8f7c95b48dcb23d086af31227c7 (127.10.255.67:38491), c567f15f7fb143d695cff0a6011f8bb2 (127.10.255.65:35011)
I20260806 09:19:54.122010 30534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "068a62b252554f40a15215ae0dfe5afd" candidate_uuid: "1e718ef572fa4f57a51c07b7394338cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c567f15f7fb143d695cff0a6011f8bb2"
I20260806 09:19:54.122320 30534 raft_consensus.cc:3037] T 068a62b252554f40a15215ae0dfe5afd P c567f15f7fb143d695cff0a6011f8bb2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:19:54.122454 30799 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "068a62b252554f40a15215ae0dfe5afd" candidate_uuid: "1e718ef572fa4f57a51c07b7394338cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4d7e8f7c95b48dcb23d086af31227c7"
I20260806 09:19:54.122742 30799 raft_consensus.cc:3037] T 068a62b252554f40a15215ae0dfe5afd P e4d7e8f7c95b48dcb23d086af31227c7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:19:54.126705 30534 raft_consensus.cc:2454] T 068a62b252554f40a15215ae0dfe5afd P c567f15f7fb143d695cff0a6011f8bb2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e718ef572fa4f57a51c07b7394338cb in term 1.
I20260806 09:19:54.126737 30799 raft_consensus.cc:2454] T 068a62b252554f40a15215ae0dfe5afd P e4d7e8f7c95b48dcb23d086af31227c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e718ef572fa4f57a51c07b7394338cb in term 1.
I20260806 09:19:54.127454 30602 leader_election.cc:302] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e718ef572fa4f57a51c07b7394338cb, e4d7e8f7c95b48dcb23d086af31227c7; no voters:
I20260806 09:19:54.127923 30871 raft_consensus.cc:2781] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:19:54.128674 30871 raft_consensus.cc:686] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb [term 1 LEADER]: Becoming Leader. State: Replica: 1e718ef572fa4f57a51c07b7394338cb, State: Running, Role: LEADER
I20260806 09:19:54.129376 30871 consensus_queue.cc:237] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d7e8f7c95b48dcb23d086af31227c7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38491 } } peers { permanent_uuid: "1e718ef572fa4f57a51c07b7394338cb" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35601 } } peers { permanent_uuid: "c567f15f7fb143d695cff0a6011f8bb2" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35011 } }
I20260806 09:19:54.134899 30392 catalog_manager.cc:5495] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e718ef572fa4f57a51c07b7394338cb (127.10.255.66). New cstate: current_term: 1 leader_uuid: "1e718ef572fa4f57a51c07b7394338cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4d7e8f7c95b48dcb23d086af31227c7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38491 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e718ef572fa4f57a51c07b7394338cb" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35601 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c567f15f7fb143d695cff0a6011f8bb2" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35011 } health_report { overall_health: UNKNOWN } } }
I20260806 09:19:54.179229 30862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:54.173313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43726 (local address 127.10.255.66:35601)
0806 09:19:54.173551 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:54.173555 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:54.173574 (+ 19us) server_negotiation.cc:407] Connection header received
0806 09:19:54.173759 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:54.173764 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:54.173857 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:54.173995 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:19:54.174360 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:54.175154 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:54.176747 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:54.177204 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:54.177311 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:54.177961 (+ 650us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:19:54.178521 (+ 560us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:19:54.178724 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:54.178895 (+ 171us) server_negotiation.cc:299] Negotiation successful
0806 09:19:54.178943 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 09:19:54.188017 30799 raft_consensus.cc:1261] T 068a62b252554f40a15215ae0dfe5afd P e4d7e8f7c95b48dcb23d086af31227c7 [term 1 FOLLOWER]: Refusing update from remote peer 1e718ef572fa4f57a51c07b7394338cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:19:54.188019 30534 raft_consensus.cc:1261] T 068a62b252554f40a15215ae0dfe5afd P c567f15f7fb143d695cff0a6011f8bb2 [term 1 FOLLOWER]: Refusing update from remote peer 1e718ef572fa4f57a51c07b7394338cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:19:54.189136 30871 consensus_queue.cc:1035] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c567f15f7fb143d695cff0a6011f8bb2" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 35011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:19:54.189450 30875 consensus_queue.cc:1035] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4d7e8f7c95b48dcb23d086af31227c7" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 38491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:19:54.201830 30878 mvcc.cc:205] Tried to move back new op lower bound from 7315488744183050240 to 7315488743958462464. Current Snapshot: MvccSnapshot[applied={T|T < 7315488744183050240}]
I20260806 09:19:54.218189 30391 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53772:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:19:54.218593 30391 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53772:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:19:54.223537 30391 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1ec6a75a48f64992b27c9ccba4490844: Sending DeleteTablet for 3 replicas of tablet 068a62b252554f40a15215ae0dfe5afd
I20260806 09:19:54.224925 30646 tablet_service.cc:1514] Processing DeleteTablet for tablet 068a62b252554f40a15215ae0dfe5afd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:19:54 UTC) from {username='slave'} at 127.0.0.1:43718
I20260806 09:19:54.225045 30779 tablet_service.cc:1514] Processing DeleteTablet for tablet 068a62b252554f40a15215ae0dfe5afd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:19:54 UTC) from {username='slave'} at 127.0.0.1:32950
I20260806 09:19:54.225179 30514 tablet_service.cc:1514] Processing DeleteTablet for tablet 068a62b252554f40a15215ae0dfe5afd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:19:54 UTC) from {username='slave'} at 127.0.0.1:46862
I20260806 09:19:54.228570 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 30452
I20260806 09:19:54.243428 30889 tablet_replica.cc:330] T 068a62b252554f40a15215ae0dfe5afd P e4d7e8f7c95b48dcb23d086af31227c7: stopping tablet replica
I20260806 09:19:54.244042 30889 raft_consensus.cc:2229] T 068a62b252554f40a15215ae0dfe5afd P e4d7e8f7c95b48dcb23d086af31227c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:19:54.244644 30889 raft_consensus.cc:2258] T 068a62b252554f40a15215ae0dfe5afd P e4d7e8f7c95b48dcb23d086af31227c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:19:54.246991 30890 tablet_replica.cc:330] T 068a62b252554f40a15215ae0dfe5afd P c567f15f7fb143d695cff0a6011f8bb2: stopping tablet replica
I20260806 09:19:54.247532 30890 raft_consensus.cc:2229] T 068a62b252554f40a15215ae0dfe5afd P c567f15f7fb143d695cff0a6011f8bb2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:19:54.247975 30888 tablet_replica.cc:330] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb: stopping tablet replica
I20260806 09:19:54.248206 30890 raft_consensus.cc:2258] T 068a62b252554f40a15215ae0dfe5afd P c567f15f7fb143d695cff0a6011f8bb2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:19:54.248380 30888 raft_consensus.cc:2229] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:19:54.249141 30888 raft_consensus.cc:2258] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:19:54.251895 30889 ts_tablet_manager.cc:1905] T 068a62b252554f40a15215ae0dfe5afd P e4d7e8f7c95b48dcb23d086af31227c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:19:54.254680 30888 ts_tablet_manager.cc:1905] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:19:54.255558 30861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:54.230995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46872 (local address 127.10.255.65:35011)
0806 09:19:54.231184 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:54.231191 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:54.240429 (+ 9238us) server_negotiation.cc:407] Connection header received
0806 09:19:54.240661 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:54.240671 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:54.240822 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:54.240946 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:54.243892 (+ 2946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:54.245157 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:54.247449 (+ 2292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:54.248283 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:54.248416 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:54.253287 (+ 4871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:54.253300 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:54.253318 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:19:54.254143 (+ 825us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:54.254217 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:19:54.254251 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:54.254379 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:54.254625 (+ 246us) server_negotiation.cc:299] Negotiation successful
0806 09:19:54.254850 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 09:19:54.257218 30575 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:54.260182 30889 ts_tablet_manager.cc:1918] T 068a62b252554f40a15215ae0dfe5afd P e4d7e8f7c95b48dcb23d086af31227c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:19:54.260397 30889 log.cc:1196] T 068a62b252554f40a15215ae0dfe5afd P e4d7e8f7c95b48dcb23d086af31227c7: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/068a62b252554f40a15215ae0dfe5afd
I20260806 09:19:54.261014 30889 ts_tablet_manager.cc:1939] T 068a62b252554f40a15215ae0dfe5afd P e4d7e8f7c95b48dcb23d086af31227c7: Deleting consensus metadata
I20260806 09:19:54.262743 30888 ts_tablet_manager.cc:1918] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:19:54.262938 30888 log.cc:1196] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/068a62b252554f40a15215ae0dfe5afd
I20260806 09:19:54.263535 30888 ts_tablet_manager.cc:1939] T 068a62b252554f40a15215ae0dfe5afd P 1e718ef572fa4f57a51c07b7394338cb: Deleting consensus metadata
I20260806 09:19:54.263630 30379 catalog_manager.cc:4841] TS e4d7e8f7c95b48dcb23d086af31227c7 (127.10.255.67:38491): tablet 068a62b252554f40a15215ae0dfe5afd (table test-table [id=6dab310728fc44d98361fc26a7390137]) successfully deleted
I20260806 09:19:54.265791 30379 catalog_manager.cc:4841] TS 1e718ef572fa4f57a51c07b7394338cb (127.10.255.66:35601): tablet 068a62b252554f40a15215ae0dfe5afd (table test-table [id=6dab310728fc44d98361fc26a7390137]) successfully deleted
I20260806 09:19:54.356783 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 30452
W20260806 09:19:54.376848 30378 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.255.65:35011 (error 108)
I20260806 09:19:54.377746 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 30584
I20260806 09:19:54.379325 30894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:54.378354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:35011 (local address 127.0.0.1:46888)
0806 09:19:54.378936 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:54.379099 (+ 163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.65:35011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":333,"threads_started":1}
W20260806 09:19:54.379654 30378 catalog_manager.cc:4584] TS c567f15f7fb143d695cff0a6011f8bb2 (127.10.255.65:35011): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 068a62b252554f40a15215ae0dfe5afd: Network error: Client connection negotiation failed: client connection to 127.10.255.65:35011: connect: Connection refused (error 111)
I20260806 09:19:54.386940 30862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:54.379049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43728 (local address 127.10.255.66:35601)
0806 09:19:54.379239 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:54.379246 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:54.379272 (+ 26us) server_negotiation.cc:407] Connection header received
0806 09:19:54.379357 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:54.379364 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:54.379477 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:54.379604 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:54.380132 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:54.380968 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:54.382993 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:54.383508 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:54.383625 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:54.385251 (+ 1626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:54.385261 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:54.385277 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:19:54.385979 (+ 702us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:54.386034 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:19:54.386058 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:54.386177 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:54.386396 (+ 219us) server_negotiation.cc:299] Negotiation successful
0806 09:19:54.386509 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 09:19:54.387760 30706 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:54.433790 30894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:54.433183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:35011 (local address 127.0.0.1:46900)
0806 09:19:54.433475 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:54.433594 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.65:35011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260806 09:19:54.435127 30894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:54.434609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:35011 (local address 127.0.0.1:46916)
0806 09:19:54.434790 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:54.434929 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.65:35011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260806 09:19:54.496001 30894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:54.495333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:35011 (local address 127.0.0.1:46926)
0806 09:19:54.495629 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:54.495745 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.65:35011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260806 09:19:54.497340 30894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:54.496870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:35011 (local address 127.0.0.1:46932)
0806 09:19:54.497064 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:54.497158 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.65:35011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260806 09:19:54.510656 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 30584
I20260806 09:19:54.531698 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 30716
I20260806 09:19:54.540211 30859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:54.532839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32956 (local address 127.10.255.67:38491)
0806 09:19:54.533031 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:54.533035 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:54.533055 (+ 20us) server_negotiation.cc:407] Connection header received
0806 09:19:54.533119 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:54.533124 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:54.533209 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:54.533300 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:54.533914 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:54.534838 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:54.536684 (+ 1846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:54.537149 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:54.537266 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:54.538629 (+ 1363us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:54.538640 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:54.538656 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:19:54.539311 (+ 655us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:54.539367 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:19:54.539391 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:54.539495 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:54.539705 (+ 210us) server_negotiation.cc:299] Negotiation successful
0806 09:19:54.539817 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 09:19:54.540942 30841 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:54.578255 30894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:54.577647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:35011 (local address 127.0.0.1:46946)
0806 09:19:54.577939 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:54.578056 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.65:35011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260806 09:19:54.579633 30894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:54.579120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:35011 (local address 127.0.0.1:46960)
0806 09:19:54.579367 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:54.579461 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.65:35011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
I20260806 09:19:54.642145 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 30716
I20260806 09:19:54.660863 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 30361
I20260806 09:19:54.662323 30423 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:54.777287 30894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:54.776499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:35011 (local address 127.0.0.1:46966)
0806 09:19:54.776901 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:54.777057 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.65:35011: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202}
I20260806 09:19:54.777297 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 30361
2026-08-06T09:19:54Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3288 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:19:54 dist-test-slave-mvvj krb5kdc[30900](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:19:54 dist-test-slave-mvvj krb5kdc[30900](info): set up 2 sockets
Aug 06 09:19:54 dist-test-slave-mvvj krb5kdc[30900](info): commencing operation
krb5kdc: starting...
W20260806 09:19:55.958694 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:19:56 dist-test-slave-mvvj krb5kdc[30900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007996, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:19:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:19:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:19:56.255951 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:36145
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:34897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:36145
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:19:56.618993 30913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:19:56.619419 30913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:19:56.619666 30913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:19:56.628010 30913 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:19:56.628201 30913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:19:56.628286 30913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:19:56.628379 30913 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:19:56.628485 30913 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:19:56.639778 30913 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:34897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:36145
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:36145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:56.641320 30913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:56.642765 30913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:19:56.655921 30918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:56.655949 30919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:56.656164 30921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:56.656697 30913 server_base.cc:1034] running on GCE node
I20260806 09:19:56.657641 30913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:56.659273 30913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:56.660606 30913 hybrid_clock.cc:648] HybridClock initialized: now 1786007996660538 us; error 52 us; skew 500 ppm
I20260806 09:19:56.661049 30913 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:19:56 dist-test-slave-mvvj krb5kdc[30900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007996, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:19:56.671267 30913 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:19:56.673306 30913 webserver.cc:460] Webserver started at http://127.10.255.126:34501/ using document root <none> and password file <none>
I20260806 09:19:56.674216 30913 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:56.674381 30913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:56.674726 30913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:19:56.678210 30913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "8b856d9da1ad48668a5b55592f247a3d"
format_stamp: "Formatted at 2026-08-06 09:19:56 on dist-test-slave-mvvj"
server_key: "af5ebb8480f3f0e660f10ac8d8f57b17"
server_key_iv: "8be6a99d15e45dc6e2fe220e2d1be49d"
server_key_version: "encryptionkey@0"
I20260806 09:19:56.679147 30913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "8b856d9da1ad48668a5b55592f247a3d"
format_stamp: "Formatted at 2026-08-06 09:19:56 on dist-test-slave-mvvj"
server_key: "af5ebb8480f3f0e660f10ac8d8f57b17"
server_key_iv: "8be6a99d15e45dc6e2fe220e2d1be49d"
server_key_version: "encryptionkey@0"
I20260806 09:19:56.685221 30913 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260806 09:19:56.689513 30928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:56.691185 30913 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.004s
I20260806 09:19:56.691426 30913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "8b856d9da1ad48668a5b55592f247a3d"
format_stamp: "Formatted at 2026-08-06 09:19:56 on dist-test-slave-mvvj"
server_key: "af5ebb8480f3f0e660f10ac8d8f57b17"
server_key_iv: "8be6a99d15e45dc6e2fe220e2d1be49d"
server_key_version: "encryptionkey@0"
I20260806 09:19:56.691676 30913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:56.706511 30913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:56.711982 30913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:56.712380 30913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:56.734463 30913 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:36145
I20260806 09:19:56.734500 30979 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:36145 every 8 connection(s)
I20260806 09:19:56.736083 30913 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:19:56.740372 30980 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:19:56.745800 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 30913
I20260806 09:19:56.746030 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:19:56.746619 11261 external_mini_cluster.cc:1428] Setting key 857491aeaad9dacc4adb20e2f2df513d
I20260806 09:19:56.753397 30980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b856d9da1ad48668a5b55592f247a3d: Bootstrap starting.
I20260806 09:19:56.757619 30980 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b856d9da1ad48668a5b55592f247a3d: Neither blocks nor log segments found. Creating new log.
I20260806 09:19:56.758932 30980 log.cc:824] T 00000000000000000000000000000000 P 8b856d9da1ad48668a5b55592f247a3d: Log is configured to *not* fsync() on all Append() calls
I20260806 09:19:56.762048 30980 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b856d9da1ad48668a5b55592f247a3d: No bootstrap required, opened a new log
Aug 06 09:19:56 dist-test-slave-mvvj krb5kdc[30900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007996, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:19:56.773614 30980 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b856d9da1ad48668a5b55592f247a3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b856d9da1ad48668a5b55592f247a3d" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36145 } }
I20260806 09:19:56.774144 30980 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b856d9da1ad48668a5b55592f247a3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:19:56.774262 30980 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b856d9da1ad48668a5b55592f247a3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b856d9da1ad48668a5b55592f247a3d, State: Initialized, Role: FOLLOWER
I20260806 09:19:56.774377 30983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:56.748774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47574 (local address 127.10.255.126:36145)
0806 09:19:56.749817 (+ 1043us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:56.749834 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:56.749881 (+ 47us) server_negotiation.cc:407] Connection header received
0806 09:19:56.751935 (+ 2054us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:56.751967 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:56.752452 (+ 485us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:56.752905 (+ 453us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:56.754936 (+ 2031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:56.756527 (+ 1591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:56.758417 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:56.759217 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:56.759363 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:56.764126 (+ 4763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:56.764138 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:56.764164 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:56.764225 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:56.768720 (+ 4495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:56.769688 (+ 968us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:56.769698 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:56.769709 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:56.769969 (+ 260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:56.770543 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:56.770548 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:56.770552 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:56.771489 (+ 937us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:56.771865 (+ 376us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:56.772387 (+ 522us) server_negotiation.cc:299] Negotiation successful
0806 09:19:56.772904 (+ 517us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":812,"thread_start_us":446,"threads_started":1}
I20260806 09:19:56.774943 30980 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b856d9da1ad48668a5b55592f247a3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b856d9da1ad48668a5b55592f247a3d" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36145 } }
I20260806 09:19:56.775215 30980 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b856d9da1ad48668a5b55592f247a3d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:19:56.775358 30980 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b856d9da1ad48668a5b55592f247a3d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:19:56.775575 30980 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b856d9da1ad48668a5b55592f247a3d [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:19:56.778146 30980 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b856d9da1ad48668a5b55592f247a3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b856d9da1ad48668a5b55592f247a3d" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36145 } }
I20260806 09:19:56.778748 30980 leader_election.cc:302] T 00000000000000000000000000000000 P 8b856d9da1ad48668a5b55592f247a3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b856d9da1ad48668a5b55592f247a3d; no voters:
I20260806 09:19:56.779397 30980 leader_election.cc:288] T 00000000000000000000000000000000 P 8b856d9da1ad48668a5b55592f247a3d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:19:56.779556 30985 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b856d9da1ad48668a5b55592f247a3d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:19:56.780347 30985 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b856d9da1ad48668a5b55592f247a3d [term 1 LEADER]: Becoming Leader. State: Replica: 8b856d9da1ad48668a5b55592f247a3d, State: Running, Role: LEADER
I20260806 09:19:56.780915 30985 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b856d9da1ad48668a5b55592f247a3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b856d9da1ad48668a5b55592f247a3d" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36145 } }
I20260806 09:19:56.781536 30980 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b856d9da1ad48668a5b55592f247a3d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:19:56.784176 30987 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b856d9da1ad48668a5b55592f247a3d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b856d9da1ad48668a5b55592f247a3d. Latest consensus state: current_term: 1 leader_uuid: "8b856d9da1ad48668a5b55592f247a3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b856d9da1ad48668a5b55592f247a3d" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36145 } } }
I20260806 09:19:56.784658 30987 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b856d9da1ad48668a5b55592f247a3d [sys.catalog]: This master's current role is: LEADER
I20260806 09:19:56.785002 30986 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b856d9da1ad48668a5b55592f247a3d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b856d9da1ad48668a5b55592f247a3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b856d9da1ad48668a5b55592f247a3d" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36145 } } }
I20260806 09:19:56.785316 30986 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b856d9da1ad48668a5b55592f247a3d [sys.catalog]: This master's current role is: LEADER
I20260806 09:19:56.796664 30994 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:19:56.801640 30994 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:19:56.812359 30994 catalog_manager.cc:1347] Generated new cluster ID: dd53c29040b94203ac912162b6f9b72e
I20260806 09:19:56.812525 30994 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:19:56.841606 30994 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:19:56.843732 30994 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:19:56.863865 30994 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b856d9da1ad48668a5b55592f247a3d: Generated new TSK 0
I20260806 09:19:56.865185 30994 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.255.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
Entry for principal kudu/127.10.255.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab.
I20260806 09:19:56.941696 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:36145
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:34897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:19:57.309708 31006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:19:57.310055 31006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:19:57.310204 31006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:19:57.318163 31006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:19:57.318310 31006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:19:57.318529 31006 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:19:57.329221 31006 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:34897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.65.keytab
--principal=kudu/127.10.255.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:36145
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:57.330739 31006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:57.332208 31006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:19:57.346526 31011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:57.346709 31014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:57.346730 31012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:57.348205 31006 server_base.cc:1034] running on GCE node
I20260806 09:19:57.348954 31006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:57.350111 31006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:57.351403 31006 hybrid_clock.cc:648] HybridClock initialized: now 1786007997351312 us; error 71 us; skew 500 ppm
I20260806 09:19:57.351826 31006 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:19:57 dist-test-slave-mvvj krb5kdc[30900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007997, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:19:57.355684 31006 init.cc:377] Logged in from keytab as kudu/127.10.255.65@KRBTEST.COM (short username kudu)
I20260806 09:19:57.357728 31006 webserver.cc:460] Webserver started at http://127.10.255.65:37395/ using document root <none> and password file <none>
I20260806 09:19:57.358526 31006 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:57.358685 31006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:57.359054 31006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:19:57.362443 31006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "c2c36832e85440229dbd8c8c4bd78239"
format_stamp: "Formatted at 2026-08-06 09:19:57 on dist-test-slave-mvvj"
server_key: "b6648ec1ea4415cc6dec57bffe8465b0"
server_key_iv: "b4066b1c0dc609177f38120241eef2f3"
server_key_version: "encryptionkey@0"
I20260806 09:19:57.363659 31006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "c2c36832e85440229dbd8c8c4bd78239"
format_stamp: "Formatted at 2026-08-06 09:19:57 on dist-test-slave-mvvj"
server_key: "b6648ec1ea4415cc6dec57bffe8465b0"
server_key_iv: "b4066b1c0dc609177f38120241eef2f3"
server_key_version: "encryptionkey@0"
I20260806 09:19:57.370185 31006 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 09:19:57.374660 31021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:57.376291 31006 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 09:19:57.376502 31006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "c2c36832e85440229dbd8c8c4bd78239"
format_stamp: "Formatted at 2026-08-06 09:19:57 on dist-test-slave-mvvj"
server_key: "b6648ec1ea4415cc6dec57bffe8465b0"
server_key_iv: "b4066b1c0dc609177f38120241eef2f3"
server_key_version: "encryptionkey@0"
I20260806 09:19:57.376753 31006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:57.399133 31006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:57.403743 31006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:57.404100 31006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:57.405191 31006 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:19:57.406657 31006 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:19:57.406765 31006 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:57.406912 31006 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:19:57.406983 31006 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:57.444096 31006 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:42715
I20260806 09:19:57.444190 31134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:42715 every 8 connection(s)
I20260806 09:19:57.445453 31006 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:19:57.452522 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 31006
I20260806 09:19:57.452759 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:19:57.453222 11261 external_mini_cluster.cc:1428] Setting key 9c4ea4ebc06e3fe647c67d95d4ae4f9a
Aug 06 09:19:57 dist-test-slave-mvvj krb5kdc[30900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007997, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.65@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:19:57.470477 31137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:57.448338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:34851 (local address 127.10.255.126:36145)
0806 09:19:57.448848 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:57.448853 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:57.449734 (+ 881us) server_negotiation.cc:407] Connection header received
0806 09:19:57.451716 (+ 1982us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:57.451723 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:57.451880 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:57.452020 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:57.453814 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:57.454610 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:57.457162 (+ 2552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:57.458027 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:57.458201 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:57.464006 (+ 5805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:57.464012 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:57.464015 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:57.464081 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:57.467046 (+ 2965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:57.467963 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:57.467969 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:57.467972 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:57.468120 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:57.468601 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:57.468607 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:57.468610 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:57.468896 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:57.469070 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:57.469847 (+ 777us) server_negotiation.cc:299] Negotiation successful
0806 09:19:57.470097 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":286,"threads_started":1}
I20260806 09:19:57.471485 31138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:57.448798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:36145 (local address 127.10.255.65:34851)
0806 09:19:57.449558 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:57.449600 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:57.451419 (+ 1819us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:57.452283 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:57.452292 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:57.452960 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:19:57.453625 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:57.453645 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:57.454799 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:57.454803 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:57.456944 (+ 2141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:57.456964 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:57.458435 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:57.458448 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:57.458837 (+ 389us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:57.459731 (+ 894us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:19:57.459769 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:19:57.463684 (+ 3915us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:19:57.467253 (+ 3569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:19:57.467264 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:19:57.467283 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:19:57.467776 (+ 493us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:19:57.468244 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:19:57.468249 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:19:57.468253 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:19:57.468461 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:19:57.469033 (+ 572us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:19:57.469042 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:19:57.469423 (+ 381us) client_negotiation.cc:769] Sending connection context
0806 09:19:57.469705 (+ 282us) client_negotiation.cc:240] Negotiation successful
0806 09:19:57.470260 (+ 555us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":517,"thread_start_us":282,"threads_started":1}
I20260806 09:19:57.473438 31135 heartbeater.cc:347] Connected to a master server at 127.10.255.126:36145
I20260806 09:19:57.473795 31135 heartbeater.cc:464] Registering TS with master...
I20260806 09:19:57.474661 31135 heartbeater.cc:511] Master 127.10.255.126:36145 requested a full tablet report, sending...
I20260806 09:19:57.477247 30945 ts_manager.cc:194] Registered new tserver with Master: c2c36832e85440229dbd8c8c4bd78239 (127.10.255.65:42715)
I20260806 09:19:57.479437 30945 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.65@KRBTEST.COM'} at 127.10.255.65:34851
WARNING: no policy specified for kudu/127.10.255.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
Entry for principal kudu/127.10.255.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab.
I20260806 09:19:57.519484 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:36145
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:34897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:19:57.880511 31141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:19:57.880833 31141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:19:57.881027 31141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:19:57.889281 31141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:19:57.889447 31141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:19:57.889662 31141 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:19:57.900934 31141 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:34897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.66.keytab
--principal=kudu/127.10.255.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:36145
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:57.902376 31141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:57.903846 31141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:19:57.918853 31146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:57.918879 31147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:57.919523 31149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:57.919811 31141 server_base.cc:1034] running on GCE node
I20260806 09:19:57.920650 31141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:57.921849 31141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:57.923111 31141 hybrid_clock.cc:648] HybridClock initialized: now 1786007997923019 us; error 88 us; skew 500 ppm
I20260806 09:19:57.923480 31141 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:19:57 dist-test-slave-mvvj krb5kdc[30900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007997, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:19:57.927037 31141 init.cc:377] Logged in from keytab as kudu/127.10.255.66@KRBTEST.COM (short username kudu)
I20260806 09:19:57.928809 31141 webserver.cc:460] Webserver started at http://127.10.255.66:40865/ using document root <none> and password file <none>
I20260806 09:19:57.929697 31141 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:57.929858 31141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:57.930243 31141 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:19:57.933571 31141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "3639eb9c5b824eb68a5bc9cf88d109b0"
format_stamp: "Formatted at 2026-08-06 09:19:57 on dist-test-slave-mvvj"
server_key: "3c304a15e93d7f5b7fd7e9c14ecae91a"
server_key_iv: "cbc97d26cdf8854a6638c4a4096d1628"
server_key_version: "encryptionkey@0"
I20260806 09:19:57.934429 31141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "3639eb9c5b824eb68a5bc9cf88d109b0"
format_stamp: "Formatted at 2026-08-06 09:19:57 on dist-test-slave-mvvj"
server_key: "3c304a15e93d7f5b7fd7e9c14ecae91a"
server_key_iv: "cbc97d26cdf8854a6638c4a4096d1628"
server_key_version: "encryptionkey@0"
I20260806 09:19:57.940346 31141 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 09:19:57.944484 31156 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:57.945964 31141 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 09:19:57.946182 31141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "3639eb9c5b824eb68a5bc9cf88d109b0"
format_stamp: "Formatted at 2026-08-06 09:19:57 on dist-test-slave-mvvj"
server_key: "3c304a15e93d7f5b7fd7e9c14ecae91a"
server_key_iv: "cbc97d26cdf8854a6638c4a4096d1628"
server_key_version: "encryptionkey@0"
I20260806 09:19:57.946424 31141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:57.967422 31141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:57.972493 31141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:57.972818 31141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:57.973881 31141 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:19:57.975374 31141 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:19:57.975482 31141 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:57.975643 31141 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:19:57.975718 31141 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:58.013809 31141 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:34001
I20260806 09:19:58.013870 31269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:34001 every 8 connection(s)
I20260806 09:19:58.015420 31141 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:19:58.021656 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 31141
I20260806 09:19:58.021914 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:19:58.022397 11261 external_mini_cluster.cc:1428] Setting key 161a603fc317557155fdc3eb64e0c330
Aug 06 09:19:58 dist-test-slave-mvvj krb5kdc[30900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007997, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.66@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:19:58.039152 31272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:58.018685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:44937 (local address 127.10.255.126:36145)
0806 09:19:58.019420 (+ 735us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:58.019427 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:58.020652 (+ 1225us) server_negotiation.cc:407] Connection header received
0806 09:19:58.023125 (+ 2473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:58.023135 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:58.023264 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:58.023367 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:58.025354 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.026111 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.027788 (+ 1677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.028320 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.028468 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:58.032341 (+ 3873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:58.032346 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:58.032349 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:58.032387 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:58.035691 (+ 3304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:58.036565 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:58.036570 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:58.036572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:58.036714 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:58.037214 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:58.037218 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:58.037220 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:58.037527 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:58.037692 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:58.038471 (+ 779us) server_negotiation.cc:299] Negotiation successful
0806 09:19:58.038728 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":453,"threads_started":1}
I20260806 09:19:58.040282 31273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:58.019494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:36145 (local address 127.10.255.66:44937)
0806 09:19:58.020440 (+ 946us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:58.020498 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:58.022765 (+ 2267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:58.023736 (+ 971us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:58.023746 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:58.024526 (+ 780us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:19:58.025160 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:58.025178 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.026296 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.026300 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:58.027622 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:58.027636 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.028587 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.028595 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:58.028844 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:58.029635 (+ 791us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:19:58.029663 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:19:58.032051 (+ 2388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:19:58.035884 (+ 3833us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:19:58.035896 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:19:58.035923 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:19:58.036399 (+ 476us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:19:58.036849 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:19:58.036854 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:19:58.036857 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:19:58.037072 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:19:58.037666 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:19:58.037675 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:19:58.038058 (+ 383us) client_negotiation.cc:769] Sending connection context
0806 09:19:58.038342 (+ 284us) client_negotiation.cc:240] Negotiation successful
0806 09:19:58.038975 (+ 633us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":658,"thread_start_us":409,"threads_started":1}
I20260806 09:19:58.041993 31270 heartbeater.cc:347] Connected to a master server at 127.10.255.126:36145
I20260806 09:19:58.042328 31270 heartbeater.cc:464] Registering TS with master...
I20260806 09:19:58.043157 31270 heartbeater.cc:511] Master 127.10.255.126:36145 requested a full tablet report, sending...
I20260806 09:19:58.044947 30945 ts_manager.cc:194] Registered new tserver with Master: 3639eb9c5b824eb68a5bc9cf88d109b0 (127.10.255.66:34001)
I20260806 09:19:58.046345 30945 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.66@KRBTEST.COM'} at 127.10.255.66:44937
WARNING: no policy specified for kudu/127.10.255.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
Entry for principal kudu/127.10.255.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab.
I20260806 09:19:58.087985 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:36145
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:34897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:19:58.464035 31276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:19:58.464370 31276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:19:58.464542 31276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:19:58.472528 31276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:19:58.472669 31276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:19:58.472882 31276 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:19:58.483278 31135 heartbeater.cc:503] Master 127.10.255.126:36145 was elected leader, sending a full tablet report...
I20260806 09:19:58.484102 31276 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:34897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.67.keytab
--principal=kudu/127.10.255.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:36145
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:19:58.486009 31276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:19:58.487535 31276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:19:58.503618 31281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:58.503914 31284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:19:58.503937 31282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:19:58.504958 31276 server_base.cc:1034] running on GCE node
I20260806 09:19:58.505854 31276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:19:58.506974 31276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:19:58.508203 31276 hybrid_clock.cc:648] HybridClock initialized: now 1786007998508127 us; error 68 us; skew 500 ppm
I20260806 09:19:58.508750 31276 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:19:58 dist-test-slave-mvvj krb5kdc[30900](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007998, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:19:58.512928 31276 init.cc:377] Logged in from keytab as kudu/127.10.255.67@KRBTEST.COM (short username kudu)
I20260806 09:19:58.514803 31276 webserver.cc:460] Webserver started at http://127.10.255.67:34479/ using document root <none> and password file <none>
I20260806 09:19:58.515609 31276 fs_manager.cc:359] Metadata directory not provided
I20260806 09:19:58.515762 31276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:19:58.516167 31276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:19:58.519567 31276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "0e5eef5210b04fe49bb6676a861c2664"
format_stamp: "Formatted at 2026-08-06 09:19:58 on dist-test-slave-mvvj"
server_key: "794401bcb89542c2bbedbaab36495018"
server_key_iv: "14936f3c57bf3a3d0669c71df320df88"
server_key_version: "encryptionkey@0"
I20260806 09:19:58.520757 31276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "0e5eef5210b04fe49bb6676a861c2664"
format_stamp: "Formatted at 2026-08-06 09:19:58 on dist-test-slave-mvvj"
server_key: "794401bcb89542c2bbedbaab36495018"
server_key_iv: "14936f3c57bf3a3d0669c71df320df88"
server_key_version: "encryptionkey@0"
I20260806 09:19:58.528044 31276 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 09:19:58.532692 31291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:58.534305 31276 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 09:19:58.534533 31276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "0e5eef5210b04fe49bb6676a861c2664"
format_stamp: "Formatted at 2026-08-06 09:19:58 on dist-test-slave-mvvj"
server_key: "794401bcb89542c2bbedbaab36495018"
server_key_iv: "14936f3c57bf3a3d0669c71df320df88"
server_key_version: "encryptionkey@0"
I20260806 09:19:58.534801 31276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:19:58.556340 31276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:19:58.561547 31276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:19:58.561897 31276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:19:58.563026 31276 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:19:58.564649 31276 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:19:58.564760 31276 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:58.564920 31276 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:19:58.564996 31276 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:19:58.602384 31276 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:45897
I20260806 09:19:58.602495 31404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:45897 every 8 connection(s)
I20260806 09:19:58.603772 31276 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:19:58.608215 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 31276
I20260806 09:19:58.608433 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:19:58.608932 11261 external_mini_cluster.cc:1428] Setting key 536e2b9692bf68e891c790811c637a32
Aug 06 09:19:58 dist-test-slave-mvvj krb5kdc[30900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007998, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.67@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:19:58.627197 31407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:58.606786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:50723 (local address 127.10.255.126:36145)
0806 09:19:58.607395 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:58.607399 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:58.608276 (+ 877us) server_negotiation.cc:407] Connection header received
0806 09:19:58.610764 (+ 2488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:58.610769 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:58.610884 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:58.611013 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:58.613133 (+ 2120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.613946 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.615643 (+ 1697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.616124 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.616388 (+ 264us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:58.620887 (+ 4499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:58.620893 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:58.620897 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:58.620946 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:58.623653 (+ 2707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:58.624601 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:58.624606 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:58.624609 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:58.624744 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:58.625250 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:58.625254 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:58.625257 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:58.625558 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:58.625746 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:58.626517 (+ 771us) server_negotiation.cc:299] Negotiation successful
0806 09:19:58.626784 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":361,"threads_started":1}
I20260806 09:19:58.628334 31408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:58.607210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:36145 (local address 127.10.255.67:50723)
0806 09:19:58.608054 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:58.608094 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:58.610407 (+ 2313us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:58.611354 (+ 947us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:58.611368 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:58.612128 (+ 760us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:19:58.612931 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:58.612964 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.614131 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.614135 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:58.615420 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:58.615433 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.616502 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.616512 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:58.616840 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:58.617742 (+ 902us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:19:58.617772 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:19:58.620578 (+ 2806us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:19:58.623885 (+ 3307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:19:58.623896 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:19:58.623923 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:19:58.624432 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:19:58.624871 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:19:58.624876 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:19:58.624880 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:19:58.625108 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:19:58.625708 (+ 600us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:19:58.625717 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:19:58.626118 (+ 401us) client_negotiation.cc:769] Sending connection context
0806 09:19:58.626411 (+ 293us) client_negotiation.cc:240] Negotiation successful
0806 09:19:58.627010 (+ 599us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":287,"threads_started":1}
I20260806 09:19:58.629952 31405 heartbeater.cc:347] Connected to a master server at 127.10.255.126:36145
I20260806 09:19:58.630312 31405 heartbeater.cc:464] Registering TS with master...
I20260806 09:19:58.631124 31405 heartbeater.cc:511] Master 127.10.255.126:36145 requested a full tablet report, sending...
I20260806 09:19:58.632737 30945 ts_manager.cc:194] Registered new tserver with Master: 0e5eef5210b04fe49bb6676a861c2664 (127.10.255.67:45897)
I20260806 09:19:58.633617 30945 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.255.67@KRBTEST.COM'} at 127.10.255.67:50723
I20260806 09:19:58.638098 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 09:19:58.657609 31407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:58.642737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47586 (local address 127.10.255.126:36145)
0806 09:19:58.642941 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:58.642949 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:58.643532 (+ 583us) server_negotiation.cc:407] Connection header received
0806 09:19:58.643807 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:58.643819 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:58.643952 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:58.644074 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:58.645785 (+ 1711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.646763 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.648125 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.648548 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.648695 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:58.651561 (+ 2866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:58.651567 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:58.651570 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:58.651610 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:58.654579 (+ 2969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:58.655386 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:58.655390 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:58.655392 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:58.655578 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:58.656000 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:58.656012 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:58.656015 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:58.656372 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:58.656677 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:58.657024 (+ 347us) server_negotiation.cc:299] Negotiation successful
0806 09:19:58.657272 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 09:19:58.662115 30945 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47586:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:19:58.669553 30945 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:19:58.699381 31419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:58.684258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37100 (local address 127.10.255.66:34001)
0806 09:19:58.684978 (+ 720us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:58.684989 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:58.685317 (+ 328us) server_negotiation.cc:407] Connection header received
0806 09:19:58.685810 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:58.685823 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:58.686143 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:58.686415 (+ 272us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:58.687786 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.690354 (+ 2568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.695178 (+ 4824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.697463 (+ 2285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.697649 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:58.697919 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:58.698777 (+ 858us) server_negotiation.cc:299] Negotiation successful
0806 09:19:58.698996 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":542,"thread_start_us":1629,"threads_started":1}
I20260806 09:19:58.699525 31418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:58.684114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:34001 (local address 127.0.0.1:37100)
0806 09:19:58.685064 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:58.685111 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:58.685492 (+ 381us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:58.686791 (+ 1299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:58.686804 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:58.686853 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:58.687463 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:58.687484 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.690685 (+ 3201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.690697 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:58.694750 (+ 4053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:58.694790 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.698099 (+ 3309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.698113 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:58.698445 (+ 332us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:58.698527 (+ 82us) client_negotiation.cc:769] Sending connection context
0806 09:19:58.698697 (+ 170us) client_negotiation.cc:240] Negotiation successful
0806 09:19:58.699008 (+ 311us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":344,"threads_started":1}
I20260806 09:19:58.704670 31205 tablet_service.cc:1467] Processing CreateTablet for tablet cec30f61dced4bcc848540222f354a05 (DEFAULT_TABLE table=test-table [id=f81af06d083445eda150c662adc18f88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:19:58.706507 31205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cec30f61dced4bcc848540222f354a05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:19:58.706723 31420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:58.684856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:45897 (local address 127.0.0.1:37116)
0806 09:19:58.696234 (+ 11378us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:58.696261 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:58.696417 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:58.698638 (+ 2221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:58.698642 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:58.698700 (+ 58us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:58.699150 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:58.699166 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.701155 (+ 1989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.701161 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:58.703209 (+ 2048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:58.703229 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.705739 (+ 2510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.705752 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:58.705958 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:58.705997 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 09:19:58.706105 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 09:19:58.706279 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11200,"mutex_wait_us":37,"thread_start_us":12996,"threads_started":1}
I20260806 09:19:58.707085 31422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:58.685564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37116 (local address 127.10.255.67:45897)
0806 09:19:58.697120 (+ 11556us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:58.697132 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:58.697177 (+ 45us) server_negotiation.cc:407] Connection header received
0806 09:19:58.697292 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:58.697301 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:58.697654 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:58.698337 (+ 683us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:58.699466 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.700966 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.703417 (+ 2451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.705038 (+ 1621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.705206 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:58.705474 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:58.706548 (+ 1074us) server_negotiation.cc:299] Negotiation successful
0806 09:19:58.706731 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11326,"thread_start_us":11139,"threads_started":1}
I20260806 09:19:58.708324 31421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:58.685376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:42715 (local address 127.0.0.1:48210)
0806 09:19:58.698123 (+ 12747us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:58.698144 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:58.698296 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:58.699359 (+ 1063us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:58.699367 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:58.699402 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:58.700919 (+ 1517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:58.700937 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.702892 (+ 1955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.702901 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:58.705065 (+ 2164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:58.705097 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.707506 (+ 2409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.707513 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:58.707691 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:58.707726 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 09:19:58.707823 (+ 97us) client_negotiation.cc:240] Negotiation successful
0806 09:19:58.708000 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12575,"thread_start_us":12387,"threads_started":1}
I20260806 09:19:58.708489 31423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:58.686097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48210 (local address 127.10.255.65:42715)
0806 09:19:58.697568 (+ 11471us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:58.697580 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:58.698461 (+ 881us) server_negotiation.cc:407] Connection header received
0806 09:19:58.698597 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:58.698605 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:58.698861 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:58.699066 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:58.701226 (+ 2160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.702744 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.705296 (+ 2552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.707038 (+ 1742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.707208 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:58.707468 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:58.707962 (+ 494us) server_negotiation.cc:299] Negotiation successful
0806 09:19:58.708143 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11261,"thread_start_us":11065,"threads_started":1}
I20260806 09:19:58.711344 31340 tablet_service.cc:1467] Processing CreateTablet for tablet cec30f61dced4bcc848540222f354a05 (DEFAULT_TABLE table=test-table [id=f81af06d083445eda150c662adc18f88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:19:58.713160 31340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cec30f61dced4bcc848540222f354a05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:19:58.713043 31070 tablet_service.cc:1467] Processing CreateTablet for tablet cec30f61dced4bcc848540222f354a05 (DEFAULT_TABLE table=test-table [id=f81af06d083445eda150c662adc18f88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:19:58.714766 31070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cec30f61dced4bcc848540222f354a05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:19:58.724021 31424 tablet_bootstrap.cc:492] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0: Bootstrap starting.
I20260806 09:19:58.728336 31424 tablet_bootstrap.cc:654] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0: Neither blocks nor log segments found. Creating new log.
I20260806 09:19:58.728511 31425 tablet_bootstrap.cc:492] T cec30f61dced4bcc848540222f354a05 P 0e5eef5210b04fe49bb6676a861c2664: Bootstrap starting.
I20260806 09:19:58.730532 31424 log.cc:824] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0: Log is configured to *not* fsync() on all Append() calls
I20260806 09:19:58.731601 31426 tablet_bootstrap.cc:492] T cec30f61dced4bcc848540222f354a05 P c2c36832e85440229dbd8c8c4bd78239: Bootstrap starting.
I20260806 09:19:58.733316 31425 tablet_bootstrap.cc:654] T cec30f61dced4bcc848540222f354a05 P 0e5eef5210b04fe49bb6676a861c2664: Neither blocks nor log segments found. Creating new log.
I20260806 09:19:58.734905 31425 log.cc:824] T cec30f61dced4bcc848540222f354a05 P 0e5eef5210b04fe49bb6676a861c2664: Log is configured to *not* fsync() on all Append() calls
I20260806 09:19:58.735791 31426 tablet_bootstrap.cc:654] T cec30f61dced4bcc848540222f354a05 P c2c36832e85440229dbd8c8c4bd78239: Neither blocks nor log segments found. Creating new log.
I20260806 09:19:58.735999 31424 tablet_bootstrap.cc:492] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0: No bootstrap required, opened a new log
I20260806 09:19:58.736397 31424 ts_tablet_manager.cc:1397] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.003s
I20260806 09:19:58.737332 31426 log.cc:824] T cec30f61dced4bcc848540222f354a05 P c2c36832e85440229dbd8c8c4bd78239: Log is configured to *not* fsync() on all Append() calls
I20260806 09:19:58.745486 31425 tablet_bootstrap.cc:492] T cec30f61dced4bcc848540222f354a05 P 0e5eef5210b04fe49bb6676a861c2664: No bootstrap required, opened a new log
I20260806 09:19:58.745995 31425 ts_tablet_manager.cc:1397] T cec30f61dced4bcc848540222f354a05 P 0e5eef5210b04fe49bb6676a861c2664: Time spent bootstrapping tablet: real 0.018s user 0.012s sys 0.003s
I20260806 09:19:58.752764 31424 raft_consensus.cc:348] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3639eb9c5b824eb68a5bc9cf88d109b0" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 34001 } } peers { permanent_uuid: "0e5eef5210b04fe49bb6676a861c2664" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45897 } } peers { permanent_uuid: "c2c36832e85440229dbd8c8c4bd78239" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 42715 } }
I20260806 09:19:58.753476 31424 raft_consensus.cc:374] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:19:58.753657 31424 raft_consensus.cc:729] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3639eb9c5b824eb68a5bc9cf88d109b0, State: Initialized, Role: FOLLOWER
I20260806 09:19:58.754390 31426 tablet_bootstrap.cc:492] T cec30f61dced4bcc848540222f354a05 P c2c36832e85440229dbd8c8c4bd78239: No bootstrap required, opened a new log
I20260806 09:19:58.754766 31426 ts_tablet_manager.cc:1397] T cec30f61dced4bcc848540222f354a05 P c2c36832e85440229dbd8c8c4bd78239: Time spent bootstrapping tablet: real 0.024s user 0.014s sys 0.005s
I20260806 09:19:58.754590 31424 consensus_queue.cc:260] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3639eb9c5b824eb68a5bc9cf88d109b0" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 34001 } } peers { permanent_uuid: "0e5eef5210b04fe49bb6676a861c2664" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45897 } } peers { permanent_uuid: "c2c36832e85440229dbd8c8c4bd78239" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 42715 } }
I20260806 09:19:58.758934 31425 raft_consensus.cc:348] T cec30f61dced4bcc848540222f354a05 P 0e5eef5210b04fe49bb6676a861c2664 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3639eb9c5b824eb68a5bc9cf88d109b0" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 34001 } } peers { permanent_uuid: "0e5eef5210b04fe49bb6676a861c2664" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45897 } } peers { permanent_uuid: "c2c36832e85440229dbd8c8c4bd78239" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 42715 } }
I20260806 09:19:58.759552 31425 raft_consensus.cc:374] T cec30f61dced4bcc848540222f354a05 P 0e5eef5210b04fe49bb6676a861c2664 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:19:58.759703 31425 raft_consensus.cc:729] T cec30f61dced4bcc848540222f354a05 P 0e5eef5210b04fe49bb6676a861c2664 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e5eef5210b04fe49bb6676a861c2664, State: Initialized, Role: FOLLOWER
I20260806 09:19:58.760591 31425 consensus_queue.cc:260] T cec30f61dced4bcc848540222f354a05 P 0e5eef5210b04fe49bb6676a861c2664 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3639eb9c5b824eb68a5bc9cf88d109b0" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 34001 } } peers { permanent_uuid: "0e5eef5210b04fe49bb6676a861c2664" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45897 } } peers { permanent_uuid: "c2c36832e85440229dbd8c8c4bd78239" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 42715 } }
I20260806 09:19:58.761080 31270 heartbeater.cc:503] Master 127.10.255.126:36145 was elected leader, sending a full tablet report...
I20260806 09:19:58.761803 31424 ts_tablet_manager.cc:1428] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0: Time spent starting tablet: real 0.025s user 0.015s sys 0.007s
I20260806 09:19:58.762933 31405 heartbeater.cc:503] Master 127.10.255.126:36145 was elected leader, sending a full tablet report...
I20260806 09:19:58.763857 31425 ts_tablet_manager.cc:1428] T cec30f61dced4bcc848540222f354a05 P 0e5eef5210b04fe49bb6676a861c2664: Time spent starting tablet: real 0.018s user 0.011s sys 0.004s
W20260806 09:19:58.767876 31271 tablet.cc:2369] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:19:58.768062 31426 raft_consensus.cc:348] T cec30f61dced4bcc848540222f354a05 P c2c36832e85440229dbd8c8c4bd78239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3639eb9c5b824eb68a5bc9cf88d109b0" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 34001 } } peers { permanent_uuid: "0e5eef5210b04fe49bb6676a861c2664" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45897 } } peers { permanent_uuid: "c2c36832e85440229dbd8c8c4bd78239" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 42715 } }
I20260806 09:19:58.768735 31426 raft_consensus.cc:374] T cec30f61dced4bcc848540222f354a05 P c2c36832e85440229dbd8c8c4bd78239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:19:58.768886 31426 raft_consensus.cc:729] T cec30f61dced4bcc848540222f354a05 P c2c36832e85440229dbd8c8c4bd78239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2c36832e85440229dbd8c8c4bd78239, State: Initialized, Role: FOLLOWER
I20260806 09:19:58.769526 31426 consensus_queue.cc:260] T cec30f61dced4bcc848540222f354a05 P c2c36832e85440229dbd8c8c4bd78239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3639eb9c5b824eb68a5bc9cf88d109b0" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 34001 } } peers { permanent_uuid: "0e5eef5210b04fe49bb6676a861c2664" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45897 } } peers { permanent_uuid: "c2c36832e85440229dbd8c8c4bd78239" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 42715 } }
I20260806 09:19:58.771081 31426 ts_tablet_manager.cc:1428] T cec30f61dced4bcc848540222f354a05 P c2c36832e85440229dbd8c8c4bd78239: Time spent starting tablet: real 0.016s user 0.014s sys 0.000s
W20260806 09:19:58.855708 31406 tablet.cc:2369] T cec30f61dced4bcc848540222f354a05 P 0e5eef5210b04fe49bb6676a861c2664: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:19:58.909163 31430 raft_consensus.cc:482] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:19:58.909492 31430 raft_consensus.cc:504] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3639eb9c5b824eb68a5bc9cf88d109b0" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 34001 } } peers { permanent_uuid: "0e5eef5210b04fe49bb6676a861c2664" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45897 } } peers { permanent_uuid: "c2c36832e85440229dbd8c8c4bd78239" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 42715 } }
I20260806 09:19:58.911360 31430 leader_election.cc:288] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e5eef5210b04fe49bb6676a861c2664 (127.10.255.67:45897), c2c36832e85440229dbd8c8c4bd78239 (127.10.255.65:42715)
I20260806 09:19:58.920475 31423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:58.911819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:38757 (local address 127.10.255.65:42715)
0806 09:19:58.912118 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:58.912125 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:58.912808 (+ 683us) server_negotiation.cc:407] Connection header received
0806 09:19:58.913096 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:58.913101 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:58.913177 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:58.913279 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:58.913832 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.914720 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.917605 (+ 2885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.919118 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.919344 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:58.919461 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:58.920023 (+ 562us) server_negotiation.cc:299] Negotiation successful
0806 09:19:58.920185 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 09:19:58.920485 31422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:58.912012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:49787 (local address 127.10.255.67:45897)
0806 09:19:58.912248 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:58.912255 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:58.913392 (+ 1137us) server_negotiation.cc:407] Connection header received
0806 09:19:58.913641 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:58.913651 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:58.913715 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:58.913824 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:19:58.914440 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.915336 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.917799 (+ 2463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.919291 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.919485 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:58.919558 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:58.920010 (+ 452us) server_negotiation.cc:299] Negotiation successful
0806 09:19:58.920186 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 09:19:58.920825 31434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:58.912435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:45897 (local address 127.10.255.66:49787)
0806 09:19:58.913269 (+ 834us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:58.913284 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:58.913479 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:58.913840 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:58.913845 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:58.913868 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:58.914222 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:58.914231 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.915471 (+ 1240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.915481 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:58.917617 (+ 2136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:58.917630 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.919515 (+ 1885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.919521 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:58.919693 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:58.919788 (+ 95us) client_negotiation.cc:769] Sending connection context
0806 09:19:58.919921 (+ 133us) client_negotiation.cc:240] Negotiation successful
0806 09:19:58.920180 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":714,"mutex_wait_us":163,"spinlock_wait_cycles":1920,"thread_start_us":465,"threads_started":1}
I20260806 09:19:58.920837 31433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:58.911903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:42715 (local address 127.10.255.66:38757)
0806 09:19:58.912668 (+ 765us) negotiation.cc:107] Waiting for socket to connect
0806 09:19:58.912690 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 09:19:58.912903 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:19:58.913301 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:19:58.913305 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:19:58.913334 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:19:58.913674 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:58.913685 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.914872 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.914876 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:58.917327 (+ 2451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:19:58.917345 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:19:58.919462 (+ 2117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:19:58.919470 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:19:58.919690 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:58.919788 (+ 98us) client_negotiation.cc:769] Sending connection context
0806 09:19:58.919921 (+ 133us) client_negotiation.cc:240] Negotiation successful
0806 09:19:58.920171 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":650,"mutex_wait_us":128,"thread_start_us":461,"threads_started":1}
I20260806 09:19:58.922166 31360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec30f61dced4bcc848540222f354a05" candidate_uuid: "3639eb9c5b824eb68a5bc9cf88d109b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e5eef5210b04fe49bb6676a861c2664" is_pre_election: true
I20260806 09:19:58.922156 31090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec30f61dced4bcc848540222f354a05" candidate_uuid: "3639eb9c5b824eb68a5bc9cf88d109b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c36832e85440229dbd8c8c4bd78239" is_pre_election: true
I20260806 09:19:58.922721 31360 raft_consensus.cc:2454] T cec30f61dced4bcc848540222f354a05 P 0e5eef5210b04fe49bb6676a861c2664 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3639eb9c5b824eb68a5bc9cf88d109b0 in term 0.
I20260806 09:19:58.922773 31090 raft_consensus.cc:2454] T cec30f61dced4bcc848540222f354a05 P c2c36832e85440229dbd8c8c4bd78239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3639eb9c5b824eb68a5bc9cf88d109b0 in term 0.
I20260806 09:19:58.923544 31158 leader_election.cc:302] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0e5eef5210b04fe49bb6676a861c2664, 3639eb9c5b824eb68a5bc9cf88d109b0, c2c36832e85440229dbd8c8c4bd78239; no voters:
I20260806 09:19:58.924110 31430 raft_consensus.cc:2781] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:19:58.924248 31430 raft_consensus.cc:482] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:19:58.924404 31430 raft_consensus.cc:3037] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:19:58.926963 31430 raft_consensus.cc:504] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3639eb9c5b824eb68a5bc9cf88d109b0" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 34001 } } peers { permanent_uuid: "0e5eef5210b04fe49bb6676a861c2664" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45897 } } peers { permanent_uuid: "c2c36832e85440229dbd8c8c4bd78239" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 42715 } }
I20260806 09:19:58.927805 31430 leader_election.cc:288] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0 [CANDIDATE]: Term 1 election: Requested vote from peers 0e5eef5210b04fe49bb6676a861c2664 (127.10.255.67:45897), c2c36832e85440229dbd8c8c4bd78239 (127.10.255.65:42715)
I20260806 09:19:58.928422 31360 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec30f61dced4bcc848540222f354a05" candidate_uuid: "3639eb9c5b824eb68a5bc9cf88d109b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e5eef5210b04fe49bb6676a861c2664"
I20260806 09:19:58.928507 31090 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec30f61dced4bcc848540222f354a05" candidate_uuid: "3639eb9c5b824eb68a5bc9cf88d109b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c36832e85440229dbd8c8c4bd78239"
I20260806 09:19:58.928735 31090 raft_consensus.cc:3037] T cec30f61dced4bcc848540222f354a05 P c2c36832e85440229dbd8c8c4bd78239 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:19:58.928736 31360 raft_consensus.cc:3037] T cec30f61dced4bcc848540222f354a05 P 0e5eef5210b04fe49bb6676a861c2664 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:19:58.932226 31090 raft_consensus.cc:2454] T cec30f61dced4bcc848540222f354a05 P c2c36832e85440229dbd8c8c4bd78239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3639eb9c5b824eb68a5bc9cf88d109b0 in term 1.
I20260806 09:19:58.932226 31360 raft_consensus.cc:2454] T cec30f61dced4bcc848540222f354a05 P 0e5eef5210b04fe49bb6676a861c2664 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3639eb9c5b824eb68a5bc9cf88d109b0 in term 1.
I20260806 09:19:58.932824 31158 leader_election.cc:302] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0e5eef5210b04fe49bb6676a861c2664, 3639eb9c5b824eb68a5bc9cf88d109b0, c2c36832e85440229dbd8c8c4bd78239; no voters:
I20260806 09:19:58.933240 31430 raft_consensus.cc:2781] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:19:58.933812 31430 raft_consensus.cc:686] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0 [term 1 LEADER]: Becoming Leader. State: Replica: 3639eb9c5b824eb68a5bc9cf88d109b0, State: Running, Role: LEADER
I20260806 09:19:58.934439 31430 consensus_queue.cc:237] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3639eb9c5b824eb68a5bc9cf88d109b0" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 34001 } } peers { permanent_uuid: "0e5eef5210b04fe49bb6676a861c2664" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45897 } } peers { permanent_uuid: "c2c36832e85440229dbd8c8c4bd78239" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 42715 } }
I20260806 09:19:58.939973 30944 catalog_manager.cc:5495] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3639eb9c5b824eb68a5bc9cf88d109b0 (127.10.255.66). New cstate: current_term: 1 leader_uuid: "3639eb9c5b824eb68a5bc9cf88d109b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3639eb9c5b824eb68a5bc9cf88d109b0" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 34001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e5eef5210b04fe49bb6676a861c2664" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45897 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c36832e85440229dbd8c8c4bd78239" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 42715 } health_report { overall_health: UNKNOWN } } }
W20260806 09:19:58.948257 31136 tablet.cc:2369] T cec30f61dced4bcc848540222f354a05 P c2c36832e85440229dbd8c8c4bd78239: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:19:59.011384 31419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:59.005121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37116 (local address 127.10.255.66:34001)
0806 09:19:59.005389 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:59.005397 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:59.005519 (+ 122us) server_negotiation.cc:407] Connection header received
0806 09:19:59.005806 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:59.005810 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:59.005906 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:59.006137 (+ 231us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:19:59.006531 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:59.007304 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:59.008885 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:59.009333 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:59.009486 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:59.010040 (+ 554us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:19:59.010592 (+ 552us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:19:59.010768 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:59.010873 (+ 105us) server_negotiation.cc:299] Negotiation successful
0806 09:19:59.010968 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260806 09:19:59.023219 31360 raft_consensus.cc:1261] T cec30f61dced4bcc848540222f354a05 P 0e5eef5210b04fe49bb6676a861c2664 [term 1 FOLLOWER]: Refusing update from remote peer 3639eb9c5b824eb68a5bc9cf88d109b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:19:59.023233 31090 raft_consensus.cc:1261] T cec30f61dced4bcc848540222f354a05 P c2c36832e85440229dbd8c8c4bd78239 [term 1 FOLLOWER]: Refusing update from remote peer 3639eb9c5b824eb68a5bc9cf88d109b0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:19:59.024431 31435 consensus_queue.cc:1035] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e5eef5210b04fe49bb6676a861c2664" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 45897 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:19:59.024883 31430 consensus_queue.cc:1035] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c36832e85440229dbd8c8c4bd78239" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 42715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:19:59.040591 31438 mvcc.cc:205] Tried to move back new op lower bound from 7315488763986911232 to 7315488763639779328. Current Snapshot: MvccSnapshot[applied={T|T < 7315488763986911232}]
I20260806 09:19:59.042366 31440 mvcc.cc:205] Tried to move back new op lower bound from 7315488763986911232 to 7315488763639779328. Current Snapshot: MvccSnapshot[applied={T|T < 7315488763986911232}]
I20260806 09:19:59.056234 30945 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:19:59.056586 30945 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47586:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:19:59.060932 30945 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8b856d9da1ad48668a5b55592f247a3d: Sending DeleteTablet for 3 replicas of tablet cec30f61dced4bcc848540222f354a05
I20260806 09:19:59.062284 31070 tablet_service.cc:1514] Processing DeleteTablet for tablet cec30f61dced4bcc848540222f354a05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:19:59 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:48210
I20260806 09:19:59.062327 31340 tablet_service.cc:1514] Processing DeleteTablet for tablet cec30f61dced4bcc848540222f354a05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:19:59 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:37116
I20260806 09:19:59.062579 31205 tablet_service.cc:1514] Processing DeleteTablet for tablet cec30f61dced4bcc848540222f354a05 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:19:59 UTC) from {username='kudu', principal='kudu/127.10.255.126@KRBTEST.COM'} at 127.0.0.1:37100
I20260806 09:19:59.064896 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 31006
I20260806 09:19:59.074586 31449 tablet_replica.cc:330] T cec30f61dced4bcc848540222f354a05 P 0e5eef5210b04fe49bb6676a861c2664: stopping tablet replica
I20260806 09:19:59.075325 31449 raft_consensus.cc:2229] T cec30f61dced4bcc848540222f354a05 P 0e5eef5210b04fe49bb6676a861c2664 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:19:59.076074 31449 raft_consensus.cc:2258] T cec30f61dced4bcc848540222f354a05 P 0e5eef5210b04fe49bb6676a861c2664 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:19:59.076776 31448 tablet_replica.cc:330] T cec30f61dced4bcc848540222f354a05 P c2c36832e85440229dbd8c8c4bd78239: stopping tablet replica
I20260806 09:19:59.077687 31448 raft_consensus.cc:2229] T cec30f61dced4bcc848540222f354a05 P c2c36832e85440229dbd8c8c4bd78239 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:19:59.078361 31448 raft_consensus.cc:2258] T cec30f61dced4bcc848540222f354a05 P c2c36832e85440229dbd8c8c4bd78239 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:19:59.080731 31449 ts_tablet_manager.cc:1905] T cec30f61dced4bcc848540222f354a05 P 0e5eef5210b04fe49bb6676a861c2664: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:19:59.080736 31448 ts_tablet_manager.cc:1905] T cec30f61dced4bcc848540222f354a05 P c2c36832e85440229dbd8c8c4bd78239: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 06 09:19:59 dist-test-slave-mvvj krb5kdc[30900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007996, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.65@KRBTEST.COM
I20260806 09:19:59.089697 31450 tablet_replica.cc:330] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0: stopping tablet replica
I20260806 09:19:59.090332 31450 raft_consensus.cc:2229] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0 [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:19:59.091292 31450 raft_consensus.cc:2258] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:19:59.091569 31449 ts_tablet_manager.cc:1918] T cec30f61dced4bcc848540222f354a05 P 0e5eef5210b04fe49bb6676a861c2664: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:19:59.092290 31448 ts_tablet_manager.cc:1918] T cec30f61dced4bcc848540222f354a05 P c2c36832e85440229dbd8c8c4bd78239: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:19:59.092593 31448 log.cc:1196] T cec30f61dced4bcc848540222f354a05 P c2c36832e85440229dbd8c8c4bd78239: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-0/wal/wals/cec30f61dced4bcc848540222f354a05
I20260806 09:19:59.093343 31448 ts_tablet_manager.cc:1939] T cec30f61dced4bcc848540222f354a05 P c2c36832e85440229dbd8c8c4bd78239: Deleting consensus metadata
I20260806 09:19:59.094095 31450 ts_tablet_manager.cc:1905] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:19:59.095938 30932 catalog_manager.cc:4841] TS c2c36832e85440229dbd8c8c4bd78239 (127.10.255.65:42715): tablet cec30f61dced4bcc848540222f354a05 (table test-table [id=f81af06d083445eda150c662adc18f88]) successfully deleted
I20260806 09:19:59.096580 31449 log.cc:1196] T cec30f61dced4bcc848540222f354a05 P 0e5eef5210b04fe49bb6676a861c2664: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/cec30f61dced4bcc848540222f354a05
I20260806 09:19:59.096939 31423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:59.066140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48218 (local address 127.10.255.65:42715)
0806 09:19:59.066339 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:59.066345 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:59.071662 (+ 5317us) server_negotiation.cc:407] Connection header received
0806 09:19:59.072694 (+ 1032us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:59.072703 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:59.072820 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:59.072948 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:59.076617 (+ 3669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:59.078250 (+ 1633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:59.080738 (+ 2488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:59.081479 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:59.081619 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:59.088554 (+ 6935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:59.088575 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:59.088595 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:59.088651 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:59.093060 (+ 4409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:59.094127 (+ 1067us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:59.094138 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:59.094141 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:59.094326 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:59.094850 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:59.094858 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:59.094864 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:59.095345 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:59.095649 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:59.096299 (+ 650us) server_negotiation.cc:299] Negotiation successful
0806 09:19:59.096554 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260806 09:19:59.097249 31449 ts_tablet_manager.cc:1939] T cec30f61dced4bcc848540222f354a05 P 0e5eef5210b04fe49bb6676a861c2664: Deleting consensus metadata
I20260806 09:19:59.098939 31130 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:59.099360 30930 catalog_manager.cc:4841] TS 0e5eef5210b04fe49bb6676a861c2664 (127.10.255.67:45897): tablet cec30f61dced4bcc848540222f354a05 (table test-table [id=f81af06d083445eda150c662adc18f88]) successfully deleted
I20260806 09:19:59.104151 31450 ts_tablet_manager.cc:1918] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:19:59.104367 31450 log.cc:1196] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/cec30f61dced4bcc848540222f354a05
I20260806 09:19:59.104974 31450 ts_tablet_manager.cc:1939] T cec30f61dced4bcc848540222f354a05 P 3639eb9c5b824eb68a5bc9cf88d109b0: Deleting consensus metadata
I20260806 09:19:59.107093 30932 catalog_manager.cc:4841] TS 3639eb9c5b824eb68a5bc9cf88d109b0 (127.10.255.66:34001): tablet cec30f61dced4bcc848540222f354a05 (table test-table [id=f81af06d083445eda150c662adc18f88]) successfully deleted
I20260806 09:19:59.204378 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 31006
I20260806 09:19:59.223978 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 31141
Aug 06 09:19:59 dist-test-slave-mvvj krb5kdc[30900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007996, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.66@KRBTEST.COM
I20260806 09:19:59.243505 31419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:59.225023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37132 (local address 127.10.255.66:34001)
0806 09:19:59.225239 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:59.225246 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:59.225425 (+ 179us) server_negotiation.cc:407] Connection header received
0806 09:19:59.225679 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:59.225685 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:59.225801 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:59.225926 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:59.227384 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:59.228673 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:59.230112 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:59.230614 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:59.230776 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:59.236046 (+ 5270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:59.236066 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:59.236084 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:59.236138 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:59.240326 (+ 4188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:59.241328 (+ 1002us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:59.241335 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:59.241338 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:59.241499 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:59.241998 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:59.242002 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:59.242004 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:59.242420 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:59.242717 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:59.243002 (+ 285us) server_negotiation.cc:299] Negotiation successful
0806 09:19:59.243181 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 09:19:59.244336 31265 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:59.362934 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 31141
I20260806 09:19:59.383809 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 31276
Aug 06 09:19:59 dist-test-slave-mvvj krb5kdc[30900](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786007996, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.67@KRBTEST.COM
I20260806 09:19:59.401507 31422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:19:59.384848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37126 (local address 127.10.255.67:45897)
0806 09:19:59.385057 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 09:19:59.385063 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:19:59.385095 (+ 32us) server_negotiation.cc:407] Connection header received
0806 09:19:59.385209 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:19:59.385215 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:19:59.385321 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:19:59.385440 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:19:59.386875 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:59.387623 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:59.389176 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:19:59.389614 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:19:59.389763 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:19:59.394711 (+ 4948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:19:59.394732 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:19:59.394749 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:19:59.394793 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:19:59.398115 (+ 3322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:59.399122 (+ 1007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:59.399131 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:59.399134 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:59.399318 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:19:59.399770 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:19:59.399773 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:19:59.399776 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:19:59.400278 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:19:59.400512 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0806 09:19:59.400960 (+ 448us) server_negotiation.cc:299] Negotiation successful
0806 09:19:59.401147 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 09:19:59.402228 31400 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:59.499222 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 31276
I20260806 09:19:59.517836 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 30913
I20260806 09:19:59.519204 30975 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:19:59.636739 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 30913
2026-08-06T09:19:59Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4862 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-06T09:19:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:19:59Z Disabled control of system clock
I20260806 09:19:59.725728 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:42325
--webserver_interface=127.10.255.126
--webserver_port=0
--builtin_ntp_servers=127.10.255.84:39957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:42325
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 09:20:00.093093 31459 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:00.093437 31459 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:00.093528 31459 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:00.101296 31459 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:00.101437 31459 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:00.101481 31459 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:00.101547 31459 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:00.101588 31459 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:00.111442 31459 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:39957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:42325
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:42325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:00.112895 31459 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:00.114883 31459 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:00.129349 31464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:00.129307 31465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:00.129349 31467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:00.130645 31459 server_base.cc:1034] running on GCE node
I20260806 09:20:00.131590 31459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:00.133323 31459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:00.134562 31459 hybrid_clock.cc:648] HybridClock initialized: now 1786008000134479 us; error 71 us; skew 500 ppm
I20260806 09:20:00.135007 31459 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:20:00.137665 31459 webserver.cc:460] Webserver started at http://127.10.255.126:37651/ using document root <none> and password file <none>
I20260806 09:20:00.138489 31459 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:00.138695 31459 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:00.139096 31459 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:00.142550 31459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "b2a8d36b2b7a455494c14ad868c082ce"
format_stamp: "Formatted at 2026-08-06 09:20:00 on dist-test-slave-mvvj"
server_key: "7909f7207ebed5a6fc46703d11f17b50"
server_key_iv: "8b2ee13be32cb2562719d0c64b29e431"
server_key_version: "encryptionkey@0"
I20260806 09:20:00.143491 31459 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "b2a8d36b2b7a455494c14ad868c082ce"
format_stamp: "Formatted at 2026-08-06 09:20:00 on dist-test-slave-mvvj"
server_key: "7909f7207ebed5a6fc46703d11f17b50"
server_key_iv: "8b2ee13be32cb2562719d0c64b29e431"
server_key_version: "encryptionkey@0"
I20260806 09:20:00.149379 31459 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260806 09:20:00.153352 31473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:00.154985 31459 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 09:20:00.155233 31459 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "b2a8d36b2b7a455494c14ad868c082ce"
format_stamp: "Formatted at 2026-08-06 09:20:00 on dist-test-slave-mvvj"
server_key: "7909f7207ebed5a6fc46703d11f17b50"
server_key_iv: "8b2ee13be32cb2562719d0c64b29e431"
server_key_version: "encryptionkey@0"
I20260806 09:20:00.155500 31459 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:00.172695 31459 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:00.173653 31459 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:00.173969 31459 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:00.194413 31459 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:42325
I20260806 09:20:00.194437 31526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:42325 every 8 connection(s)
I20260806 09:20:00.196115 31459 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:20:00.200408 31527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:20:00.205597 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 31459
I20260806 09:20:00.205796 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:20:00.206405 11261 external_mini_cluster.cc:1428] Setting key 5323dd0a5494ff8cd66c5a173bdb517a
I20260806 09:20:00.213055 31527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2a8d36b2b7a455494c14ad868c082ce: Bootstrap starting.
I20260806 09:20:00.216504 31527 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b2a8d36b2b7a455494c14ad868c082ce: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:00.217640 31527 log.cc:824] T 00000000000000000000000000000000 P b2a8d36b2b7a455494c14ad868c082ce: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:00.221115 31527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b2a8d36b2b7a455494c14ad868c082ce: No bootstrap required, opened a new log
I20260806 09:20:00.221408 31530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:00.208566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47108 (local address 127.10.255.126:42325)
0806 09:20:00.209715 (+ 1149us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:00.209727 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:00.209779 (+ 52us) server_negotiation.cc:407] Connection header received
0806 09:20:00.211682 (+ 1903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:00.211709 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:00.212337 (+ 628us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:00.212759 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:00.213384 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:00.214724 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:00.216218 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:00.217061 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:00.217279 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:00.218675 (+ 1396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:00.218690 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:00.218714 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:00.219441 (+ 727us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:00.219530 (+ 89us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:00.219554 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:00.219656 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:00.219959 (+ 303us) server_negotiation.cc:299] Negotiation successful
0806 09:20:00.220360 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":673,"thread_start_us":416,"threads_started":1}
I20260806 09:20:00.229504 31527 raft_consensus.cc:348] T 00000000000000000000000000000000 P b2a8d36b2b7a455494c14ad868c082ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2a8d36b2b7a455494c14ad868c082ce" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42325 } }
I20260806 09:20:00.230060 31527 raft_consensus.cc:374] T 00000000000000000000000000000000 P b2a8d36b2b7a455494c14ad868c082ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:20:00.230194 31527 raft_consensus.cc:729] T 00000000000000000000000000000000 P b2a8d36b2b7a455494c14ad868c082ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2a8d36b2b7a455494c14ad868c082ce, State: Initialized, Role: FOLLOWER
I20260806 09:20:00.230845 31527 consensus_queue.cc:260] T 00000000000000000000000000000000 P b2a8d36b2b7a455494c14ad868c082ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2a8d36b2b7a455494c14ad868c082ce" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42325 } }
I20260806 09:20:00.231118 31527 raft_consensus.cc:388] T 00000000000000000000000000000000 P b2a8d36b2b7a455494c14ad868c082ce [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:20:00.231272 31527 raft_consensus.cc:482] T 00000000000000000000000000000000 P b2a8d36b2b7a455494c14ad868c082ce [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:20:00.231455 31527 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b2a8d36b2b7a455494c14ad868c082ce [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:00.233843 31527 raft_consensus.cc:504] T 00000000000000000000000000000000 P b2a8d36b2b7a455494c14ad868c082ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2a8d36b2b7a455494c14ad868c082ce" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42325 } }
I20260806 09:20:00.234414 31527 leader_election.cc:302] T 00000000000000000000000000000000 P b2a8d36b2b7a455494c14ad868c082ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b2a8d36b2b7a455494c14ad868c082ce; no voters:
I20260806 09:20:00.235222 31527 leader_election.cc:288] T 00000000000000000000000000000000 P b2a8d36b2b7a455494c14ad868c082ce [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:20:00.235419 31532 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b2a8d36b2b7a455494c14ad868c082ce [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:20:00.237603 31532 raft_consensus.cc:686] T 00000000000000000000000000000000 P b2a8d36b2b7a455494c14ad868c082ce [term 1 LEADER]: Becoming Leader. State: Replica: b2a8d36b2b7a455494c14ad868c082ce, State: Running, Role: LEADER
I20260806 09:20:00.238054 31527 sys_catalog.cc:564] T 00000000000000000000000000000000 P b2a8d36b2b7a455494c14ad868c082ce [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:20:00.238163 31532 consensus_queue.cc:237] T 00000000000000000000000000000000 P b2a8d36b2b7a455494c14ad868c082ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2a8d36b2b7a455494c14ad868c082ce" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42325 } }
I20260806 09:20:00.241545 31534 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2a8d36b2b7a455494c14ad868c082ce [sys.catalog]: SysCatalogTable state changed. Reason: New leader b2a8d36b2b7a455494c14ad868c082ce. Latest consensus state: current_term: 1 leader_uuid: "b2a8d36b2b7a455494c14ad868c082ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2a8d36b2b7a455494c14ad868c082ce" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42325 } } }
I20260806 09:20:00.242025 31534 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2a8d36b2b7a455494c14ad868c082ce [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:00.242517 31533 sys_catalog.cc:455] T 00000000000000000000000000000000 P b2a8d36b2b7a455494c14ad868c082ce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b2a8d36b2b7a455494c14ad868c082ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b2a8d36b2b7a455494c14ad868c082ce" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 42325 } } }
I20260806 09:20:00.242818 31533 sys_catalog.cc:458] T 00000000000000000000000000000000 P b2a8d36b2b7a455494c14ad868c082ce [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:00.245810 31540 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:20:00.251219 31540 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:20:00.263026 31540 catalog_manager.cc:1347] Generated new cluster ID: 888674e4810847f2a4d2f3734dbac1e0
I20260806 09:20:00.263170 31540 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:20:00.278007 31540 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:20:00.279362 31540 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:20:00.290329 31540 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b2a8d36b2b7a455494c14ad868c082ce: Generated new TSK 0
I20260806 09:20:00.291347 31540 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:20:00.300731 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.65:0
--local_ip_for_outbound_sockets=127.10.255.65
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42325
--builtin_ntp_servers=127.10.255.84:39957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 09:20:00.683291 31551 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:00.683683 31551 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:00.683799 31551 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:00.691605 31551 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:00.691733 31551 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:00.691931 31551 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.65
I20260806 09:20:00.702010 31551 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:39957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.255.65
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42325
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.65
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:00.703415 31551 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:00.705417 31551 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:00.722394 31557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:00.722394 31556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:00.723047 31559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:00.724406 31551 server_base.cc:1034] running on GCE node
I20260806 09:20:00.725536 31551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:00.726816 31551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:00.728101 31551 hybrid_clock.cc:648] HybridClock initialized: now 1786008000728013 us; error 79 us; skew 500 ppm
I20260806 09:20:00.728541 31551 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:20:00.731565 31551 webserver.cc:460] Webserver started at http://127.10.255.65:34969/ using document root <none> and password file <none>
I20260806 09:20:00.732527 31551 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:00.732666 31551 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:00.733045 31551 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:00.736510 31551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-0/data/instance:
uuid: "fe2a5ef8273a45c1b8eec8d1b658ebe9"
format_stamp: "Formatted at 2026-08-06 09:20:00 on dist-test-slave-mvvj"
server_key: "41eb6216e9e6b143faab7361a400a2fd"
server_key_iv: "071957f2283ed75122af514b223b6bb6"
server_key_version: "encryptionkey@0"
I20260806 09:20:00.737533 31551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance:
uuid: "fe2a5ef8273a45c1b8eec8d1b658ebe9"
format_stamp: "Formatted at 2026-08-06 09:20:00 on dist-test-slave-mvvj"
server_key: "41eb6216e9e6b143faab7361a400a2fd"
server_key_iv: "071957f2283ed75122af514b223b6bb6"
server_key_version: "encryptionkey@0"
I20260806 09:20:00.744889 31551 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.004s
I20260806 09:20:00.749753 31565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:00.751400 31551 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.003s
I20260806 09:20:00.751626 31551 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-0/wal
uuid: "fe2a5ef8273a45c1b8eec8d1b658ebe9"
format_stamp: "Formatted at 2026-08-06 09:20:00 on dist-test-slave-mvvj"
server_key: "41eb6216e9e6b143faab7361a400a2fd"
server_key_iv: "071957f2283ed75122af514b223b6bb6"
server_key_version: "encryptionkey@0"
I20260806 09:20:00.751920 31551 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:00.775033 31551 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:00.776140 31551 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:00.776513 31551 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:00.777673 31551 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:20:00.779597 31551 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:20:00.779743 31551 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:00.779929 31551 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:20:00.780033 31551 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:00.818547 31551 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.65:41051
I20260806 09:20:00.818650 31677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.65:41051 every 8 connection(s)
I20260806 09:20:00.820048 31551 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-0/data/info.pb
I20260806 09:20:00.825693 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 31551
I20260806 09:20:00.825912 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-0/wal/instance
I20260806 09:20:00.826577 11261 external_mini_cluster.cc:1428] Setting key 6bc1483cc3cc9b69d081594b8e2a88d7
I20260806 09:20:00.830243 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.66:0
--local_ip_for_outbound_sockets=127.10.255.66
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42325
--builtin_ntp_servers=127.10.255.84:39957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 09:20:00.836858 31680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:00.823280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.65:45879 (local address 127.10.255.126:42325)
0806 09:20:00.823999 (+ 719us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:00.824004 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:00.825300 (+ 1296us) server_negotiation.cc:407] Connection header received
0806 09:20:00.828002 (+ 2702us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:00.828009 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:00.828131 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:00.828267 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:00.829800 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:00.830698 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:00.833489 (+ 2791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:00.833911 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:00.834041 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:00.835950 (+ 1909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:00.835956 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:00.835959 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:00.835982 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:00.836027 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:00.836041 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:00.836119 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:00.836477 (+ 358us) server_negotiation.cc:299] Negotiation successful
0806 09:20:00.836579 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":438,"threads_started":1}
I20260806 09:20:00.838371 31681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:00.823822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42325 (local address 127.10.255.65:45879)
0806 09:20:00.825039 (+ 1217us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:00.825090 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:00.827589 (+ 2499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:00.828495 (+ 906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:00.828504 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:00.828671 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:20:00.829583 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:00.829613 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:00.830909 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:00.830919 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:00.833290 (+ 2371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:00.833312 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:00.834187 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:00.834198 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:00.834567 (+ 369us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:00.835438 (+ 871us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 09:20:00.835443 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:20:00.835523 (+ 80us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 09:20:00.835651 (+ 128us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:20:00.836157 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:20:00.836174 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:20:00.836186 (+ 12us) client_negotiation.cc:769] Sending connection context
0806 09:20:00.836406 (+ 220us) client_negotiation.cc:240] Negotiation successful
0806 09:20:00.836899 (+ 493us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"thread_start_us":424,"threads_started":1}
I20260806 09:20:00.840637 31678 heartbeater.cc:347] Connected to a master server at 127.10.255.126:42325
I20260806 09:20:00.841019 31678 heartbeater.cc:464] Registering TS with master...
I20260806 09:20:00.841993 31678 heartbeater.cc:511] Master 127.10.255.126:42325 requested a full tablet report, sending...
I20260806 09:20:00.844904 31491 ts_manager.cc:194] Registered new tserver with Master: fe2a5ef8273a45c1b8eec8d1b658ebe9 (127.10.255.65:41051)
I20260806 09:20:00.847324 31491 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.255.65:45879
W20260806 09:20:01.193688 31682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:01.194113 31682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:01.194254 31682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:01.202075 31682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:01.202195 31682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:01.202378 31682 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.66
I20260806 09:20:01.212072 31682 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:39957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.255.66
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42325
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.66
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:01.213502 31682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:01.215430 31682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:01.230403 31690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:01.230546 31688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:01.230609 31687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:01.231930 31682 server_base.cc:1034] running on GCE node
I20260806 09:20:01.232684 31682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:01.233887 31682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:01.235128 31682 hybrid_clock.cc:648] HybridClock initialized: now 1786008001235061 us; error 39 us; skew 500 ppm
I20260806 09:20:01.235495 31682 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:20:01.238150 31682 webserver.cc:460] Webserver started at http://127.10.255.66:44377/ using document root <none> and password file <none>
I20260806 09:20:01.239024 31682 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:01.239168 31682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:01.239579 31682 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:01.242990 31682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-1/data/instance:
uuid: "f98ea9d44ed045b7aed86555ffd49b57"
format_stamp: "Formatted at 2026-08-06 09:20:01 on dist-test-slave-mvvj"
server_key: "a891007b5aded41717c8f38d1f53643e"
server_key_iv: "b76c8db77a75576196723d68b3b33c0c"
server_key_version: "encryptionkey@0"
I20260806 09:20:01.244175 31682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance:
uuid: "f98ea9d44ed045b7aed86555ffd49b57"
format_stamp: "Formatted at 2026-08-06 09:20:01 on dist-test-slave-mvvj"
server_key: "a891007b5aded41717c8f38d1f53643e"
server_key_iv: "b76c8db77a75576196723d68b3b33c0c"
server_key_version: "encryptionkey@0"
I20260806 09:20:01.250150 31682 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 09:20:01.254213 31697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:01.255927 31682 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 09:20:01.256196 31682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-1/wal
uuid: "f98ea9d44ed045b7aed86555ffd49b57"
format_stamp: "Formatted at 2026-08-06 09:20:01 on dist-test-slave-mvvj"
server_key: "a891007b5aded41717c8f38d1f53643e"
server_key_iv: "b76c8db77a75576196723d68b3b33c0c"
server_key_version: "encryptionkey@0"
I20260806 09:20:01.256469 31682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:01.280664 31682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:01.281587 31682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:01.281915 31682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:01.283015 31682 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:20:01.284631 31682 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:20:01.284756 31682 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:01.284893 31682 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:20:01.284988 31682 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:01.323020 31682 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.66:35447
I20260806 09:20:01.323120 31809 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.66:35447 every 8 connection(s)
I20260806 09:20:01.324565 31682 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-1/data/info.pb
I20260806 09:20:01.326141 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 31682
I20260806 09:20:01.326336 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-1/wal/instance
I20260806 09:20:01.326915 11261 external_mini_cluster.cc:1428] Setting key 82bb2a5170f4fe3d3de2d9a735794e14
I20260806 09:20:01.330461 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.255.67:0
--local_ip_for_outbound_sockets=127.10.255.67
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42325
--builtin_ntp_servers=127.10.255.84:39957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 09:20:01.339465 31680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:01.328016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:32913 (local address 127.10.255.126:42325)
0806 09:20:01.328263 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:01.328269 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:01.330056 (+ 1787us) server_negotiation.cc:407] Connection header received
0806 09:20:01.332194 (+ 2138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:01.332202 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:01.332306 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:01.332426 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:01.333582 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:01.334322 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:01.336072 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:01.336504 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:01.336654 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:01.338379 (+ 1725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:01.338385 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:01.338388 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:01.338422 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:01.338461 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:01.338474 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:01.338583 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:01.338898 (+ 315us) server_negotiation.cc:299] Negotiation successful
0806 09:20:01.339021 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 09:20:01.340988 31812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:01.328685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42325 (local address 127.10.255.66:32913)
0806 09:20:01.329884 (+ 1199us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:01.329927 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:01.331814 (+ 1887us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:01.332679 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:01.332688 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:01.332784 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:20:01.333396 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:01.333414 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:01.334498 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:01.334506 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:01.335825 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:01.335909 (+ 84us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:01.336778 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:01.336788 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:01.337040 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:01.337924 (+ 884us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 09:20:01.337927 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:20:01.337983 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 09:20:01.338124 (+ 141us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:20:01.338616 (+ 492us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:20:01.338651 (+ 35us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:20:01.338660 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 09:20:01.338881 (+ 221us) client_negotiation.cc:240] Negotiation successful
0806 09:20:01.339374 (+ 493us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":699,"thread_start_us":443,"threads_started":1}
I20260806 09:20:01.342725 31810 heartbeater.cc:347] Connected to a master server at 127.10.255.126:42325
I20260806 09:20:01.343075 31810 heartbeater.cc:464] Registering TS with master...
I20260806 09:20:01.344133 31810 heartbeater.cc:511] Master 127.10.255.126:42325 requested a full tablet report, sending...
I20260806 09:20:01.346015 31491 ts_manager.cc:194] Registered new tserver with Master: f98ea9d44ed045b7aed86555ffd49b57 (127.10.255.66:35447)
I20260806 09:20:01.347339 31491 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.255.66:32913
W20260806 09:20:01.711496 31813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:01.711823 31813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:01.712000 31813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:01.719744 31813 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:01.719977 31813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:01.720117 31813 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.255.67
I20260806 09:20:01.733139 31813 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:39957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.255.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.255.67
--webserver_port=0
--tserver_master_addrs=127.10.255.126:42325
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.255.67
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:01.734571 31813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:01.736565 31813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:01.754442 31821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:01.754385 31818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:01.754498 31819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:01.755204 31813 server_base.cc:1034] running on GCE node
I20260806 09:20:01.756206 31813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:01.757493 31813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:01.758805 31813 hybrid_clock.cc:648] HybridClock initialized: now 1786008001758741 us; error 48 us; skew 500 ppm
I20260806 09:20:01.759202 31813 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260806 09:20:01.770493 31813 webserver.cc:460] Webserver started at http://127.10.255.67:42569/ using document root <none> and password file <none>
I20260806 09:20:01.771358 31813 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:01.771529 31813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:01.771934 31813 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:01.775084 31813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-2/data/instance:
uuid: "d96bd70b967c4d48b9178f607bb41a2a"
format_stamp: "Formatted at 2026-08-06 09:20:01 on dist-test-slave-mvvj"
server_key: "f7810123e855beb8fbaf5749a797e625"
server_key_iv: "aa645167a7a5df3e324e766e14cb65b7"
server_key_version: "encryptionkey@0"
I20260806 09:20:01.776052 31813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance:
uuid: "d96bd70b967c4d48b9178f607bb41a2a"
format_stamp: "Formatted at 2026-08-06 09:20:01 on dist-test-slave-mvvj"
server_key: "f7810123e855beb8fbaf5749a797e625"
server_key_iv: "aa645167a7a5df3e324e766e14cb65b7"
server_key_version: "encryptionkey@0"
I20260806 09:20:01.782145 31813 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260806 09:20:01.786366 31827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:01.788128 31813 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:20:01.788334 31813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-2/wal
uuid: "d96bd70b967c4d48b9178f607bb41a2a"
format_stamp: "Formatted at 2026-08-06 09:20:01 on dist-test-slave-mvvj"
server_key: "f7810123e855beb8fbaf5749a797e625"
server_key_iv: "aa645167a7a5df3e324e766e14cb65b7"
server_key_version: "encryptionkey@0"
I20260806 09:20:01.788590 31813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:01.810895 31813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:01.811908 31813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:01.812304 31813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:01.813470 31813 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 09:20:01.815243 31813 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 09:20:01.815376 31813 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:01.815527 31813 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 09:20:01.815623 31813 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:01.851737 31678 heartbeater.cc:503] Master 127.10.255.126:42325 was elected leader, sending a full tablet report...
I20260806 09:20:01.853750 31813 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.67:39697
I20260806 09:20:01.853883 31939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.67:39697 every 8 connection(s)
I20260806 09:20:01.855195 31813 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-2/data/info.pb
I20260806 09:20:01.865012 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 31813
I20260806 09:20:01.865250 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-2/wal/instance
I20260806 09:20:01.865880 11261 external_mini_cluster.cc:1428] Setting key ddab2b09c27f9492d1857d638dbdcc0f
I20260806 09:20:01.871407 31942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:01.858463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.67:43037 (local address 127.10.255.126:42325)
0806 09:20:01.859044 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:01.859049 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:01.860462 (+ 1413us) server_negotiation.cc:407] Connection header received
0806 09:20:01.862471 (+ 2009us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:01.862480 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:01.862587 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:01.862716 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:01.864257 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:01.865157 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:01.867581 (+ 2424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:01.868297 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:01.868409 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:01.870325 (+ 1916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:01.870331 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:01.870334 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:01.870354 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:01.870399 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:01.870412 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:01.870494 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:01.870982 (+ 488us) server_negotiation.cc:299] Negotiation successful
0806 09:20:01.871079 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":307,"threads_started":1}
I20260806 09:20:01.872711 31943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:01.858957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:42325 (local address 127.10.255.67:43037)
0806 09:20:01.860287 (+ 1330us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:01.860337 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:01.862152 (+ 1815us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:01.863138 (+ 986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:01.863150 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:01.863260 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:20:01.864039 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:01.864062 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:01.865405 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:01.865413 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:01.867384 (+ 1971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:01.867409 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:01.868587 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:01.868597 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:01.868912 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:01.869853 (+ 941us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 09:20:01.869857 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:20:01.869906 (+ 49us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 09:20:01.870062 (+ 156us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:20:01.870700 (+ 638us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:20:01.870714 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:20:01.870723 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 09:20:01.870941 (+ 218us) client_negotiation.cc:240] Negotiation successful
0806 09:20:01.871329 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":316,"threads_started":1}
I20260806 09:20:01.874500 31940 heartbeater.cc:347] Connected to a master server at 127.10.255.126:42325
I20260806 09:20:01.874812 31940 heartbeater.cc:464] Registering TS with master...
I20260806 09:20:01.875602 31940 heartbeater.cc:511] Master 127.10.255.126:42325 requested a full tablet report, sending...
I20260806 09:20:01.877283 31491 ts_manager.cc:194] Registered new tserver with Master: d96bd70b967c4d48b9178f607bb41a2a (127.10.255.67:39697)
I20260806 09:20:01.878131 31491 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.255.67:43037
I20260806 09:20:01.882630 11261 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 09:20:01.894511 31942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:01.887239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47124 (local address 127.10.255.126:42325)
0806 09:20:01.887423 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:01.887427 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:01.887953 (+ 526us) server_negotiation.cc:407] Connection header received
0806 09:20:01.888147 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:01.888152 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:01.888223 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:01.888321 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:01.888894 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:01.889766 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:01.891401 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:01.892086 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:01.892255 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:01.893699 (+ 1444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:01.893728 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:01.893733 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:01.893762 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:01.893802 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:01.893821 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:01.893927 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:01.894159 (+ 232us) server_negotiation.cc:299] Negotiation successful
0806 09:20:01.894255 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 09:20:01.899501 31491 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47124:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 09:20:01.907317 31491 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 09:20:01.951624 31955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:01.923628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40786 (local address 127.10.255.65:41051)
0806 09:20:01.939208 (+ 15580us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:01.939218 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:01.939246 (+ 28us) server_negotiation.cc:407] Connection header received
0806 09:20:01.939345 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:01.939355 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:01.939593 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:01.941109 (+ 1516us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:20:01.941421 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:01.943600 (+ 2179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:01.948445 (+ 4845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:01.949957 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:01.950099 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:01.950439 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:01.950863 (+ 424us) server_negotiation.cc:299] Negotiation successful
0806 09:20:01.951137 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15350,"thread_start_us":16107,"threads_started":1}
I20260806 09:20:01.952126 31956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:01.924394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41988 (local address 127.10.255.67:39697)
0806 09:20:01.936815 (+ 12421us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:01.936830 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:01.938973 (+ 2143us) server_negotiation.cc:407] Connection header received
0806 09:20:01.939199 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:01.939206 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:01.939425 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:01.939680 (+ 255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:20:01.941435 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:01.943592 (+ 2157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:01.948337 (+ 4745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:01.949917 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:01.950092 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:01.950434 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:01.951232 (+ 798us) server_negotiation.cc:299] Negotiation successful
0806 09:20:01.951480 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12106,"thread_start_us":12428,"threads_started":1}
I20260806 09:20:01.952677 31954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:01.923329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:41051 (local address 127.0.0.1:40786)
0806 09:20:01.937870 (+ 14541us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:01.937938 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:01.938210 (+ 272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:01.940150 (+ 1940us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:01.940158 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:01.940202 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:20:01.940819 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:01.940838 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:01.943875 (+ 3037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:01.943885 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:01.948147 (+ 4262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:01.948169 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:01.950155 (+ 1986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:01.950162 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:01.950435 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:01.950503 (+ 68us) client_negotiation.cc:769] Sending connection context
0806 09:20:01.952066 (+ 1563us) client_negotiation.cc:240] Negotiation successful
0806 09:20:01.952293 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14181,"mutex_wait_us":71,"thread_start_us":15768,"threads_started":1}
I20260806 09:20:01.953377 31953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:01.923666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:39697 (local address 127.0.0.1:41988)
0806 09:20:01.938820 (+ 15154us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:01.938847 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:01.939009 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:01.940127 (+ 1118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:01.940140 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:01.940181 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:20:01.941127 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:01.941150 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:01.943907 (+ 2757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:01.943915 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:01.948108 (+ 4193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:01.948126 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:01.950763 (+ 2637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:01.950771 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:01.950957 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:01.950997 (+ 40us) client_negotiation.cc:769] Sending connection context
0806 09:20:01.952444 (+ 1447us) client_negotiation.cc:240] Negotiation successful
0806 09:20:01.952615 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14982,"mutex_wait_us":669,"thread_start_us":13657,"threads_started":1}
I20260806 09:20:01.956849 31957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:01.939578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.66:35447 (local address 127.0.0.1:37408)
0806 09:20:01.946764 (+ 7186us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:01.946786 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:01.946917 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:01.948840 (+ 1923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:01.948845 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:01.948876 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:20:01.949253 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:01.949262 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:01.951139 (+ 1877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:01.951144 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:01.953828 (+ 2684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:01.953847 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:01.955990 (+ 2143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:01.955997 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:01.956191 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:01.956227 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 09:20:01.956343 (+ 116us) client_negotiation.cc:240] Negotiation successful
0806 09:20:01.956491 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7036,"thread_start_us":7723,"threads_started":1}
I20260806 09:20:01.957311 31613 tablet_service.cc:1467] Processing CreateTablet for tablet 03b5f36b9c314d41985a37d82bdcbde6 (DEFAULT_TABLE table=test-table [id=152e767b69f24fc08a6af3c0e3660db0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:20:01.958185 31958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:01.939992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37408 (local address 127.10.255.66:35447)
0806 09:20:01.948105 (+ 8113us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:01.948116 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:01.948153 (+ 37us) server_negotiation.cc:407] Connection header received
0806 09:20:01.948264 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:01.948276 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:01.948630 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:01.948858 (+ 228us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:20:01.949472 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:01.950972 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:01.954089 (+ 3117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:01.955692 (+ 1603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:01.955933 (+ 241us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:01.956236 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:01.957506 (+ 1270us) server_negotiation.cc:299] Negotiation successful
0806 09:20:01.957731 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7917,"thread_start_us":7749,"threads_started":1}
I20260806 09:20:01.957865 31875 tablet_service.cc:1467] Processing CreateTablet for tablet 03b5f36b9c314d41985a37d82bdcbde6 (DEFAULT_TABLE table=test-table [id=152e767b69f24fc08a6af3c0e3660db0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:20:01.959066 31613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03b5f36b9c314d41985a37d82bdcbde6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:20:01.959591 31875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03b5f36b9c314d41985a37d82bdcbde6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:20:01.962910 31745 tablet_service.cc:1467] Processing CreateTablet for tablet 03b5f36b9c314d41985a37d82bdcbde6 (DEFAULT_TABLE table=test-table [id=152e767b69f24fc08a6af3c0e3660db0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 09:20:01.964633 31745 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03b5f36b9c314d41985a37d82bdcbde6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:20:01.974907 31959 tablet_bootstrap.cc:492] T 03b5f36b9c314d41985a37d82bdcbde6 P d96bd70b967c4d48b9178f607bb41a2a: Bootstrap starting.
I20260806 09:20:01.979430 31959 tablet_bootstrap.cc:654] T 03b5f36b9c314d41985a37d82bdcbde6 P d96bd70b967c4d48b9178f607bb41a2a: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:01.980779 31959 log.cc:824] T 03b5f36b9c314d41985a37d82bdcbde6 P d96bd70b967c4d48b9178f607bb41a2a: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:01.981271 31960 tablet_bootstrap.cc:492] T 03b5f36b9c314d41985a37d82bdcbde6 P fe2a5ef8273a45c1b8eec8d1b658ebe9: Bootstrap starting.
I20260806 09:20:01.984828 31959 tablet_bootstrap.cc:492] T 03b5f36b9c314d41985a37d82bdcbde6 P d96bd70b967c4d48b9178f607bb41a2a: No bootstrap required, opened a new log
I20260806 09:20:01.985308 31959 ts_tablet_manager.cc:1397] T 03b5f36b9c314d41985a37d82bdcbde6 P d96bd70b967c4d48b9178f607bb41a2a: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.002s
I20260806 09:20:01.985277 31962 tablet_bootstrap.cc:492] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57: Bootstrap starting.
I20260806 09:20:01.985949 31960 tablet_bootstrap.cc:654] T 03b5f36b9c314d41985a37d82bdcbde6 P fe2a5ef8273a45c1b8eec8d1b658ebe9: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:01.987336 31960 log.cc:824] T 03b5f36b9c314d41985a37d82bdcbde6 P fe2a5ef8273a45c1b8eec8d1b658ebe9: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:01.990118 31962 tablet_bootstrap.cc:654] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:01.991586 31962 log.cc:824] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:01.993453 31960 tablet_bootstrap.cc:492] T 03b5f36b9c314d41985a37d82bdcbde6 P fe2a5ef8273a45c1b8eec8d1b658ebe9: No bootstrap required, opened a new log
I20260806 09:20:01.993866 31960 ts_tablet_manager.cc:1397] T 03b5f36b9c314d41985a37d82bdcbde6 P fe2a5ef8273a45c1b8eec8d1b658ebe9: Time spent bootstrapping tablet: real 0.013s user 0.010s sys 0.002s
I20260806 09:20:01.995034 31962 tablet_bootstrap.cc:492] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57: No bootstrap required, opened a new log
I20260806 09:20:01.995330 31962 ts_tablet_manager.cc:1397] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260806 09:20:01.998441 31959 raft_consensus.cc:348] T 03b5f36b9c314d41985a37d82bdcbde6 P d96bd70b967c4d48b9178f607bb41a2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe2a5ef8273a45c1b8eec8d1b658ebe9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41051 } } peers { permanent_uuid: "d96bd70b967c4d48b9178f607bb41a2a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39697 } } peers { permanent_uuid: "f98ea9d44ed045b7aed86555ffd49b57" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35447 } }
I20260806 09:20:01.999571 31959 raft_consensus.cc:374] T 03b5f36b9c314d41985a37d82bdcbde6 P d96bd70b967c4d48b9178f607bb41a2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:20:01.999692 31959 raft_consensus.cc:729] T 03b5f36b9c314d41985a37d82bdcbde6 P d96bd70b967c4d48b9178f607bb41a2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d96bd70b967c4d48b9178f607bb41a2a, State: Initialized, Role: FOLLOWER
I20260806 09:20:02.000483 31959 consensus_queue.cc:260] T 03b5f36b9c314d41985a37d82bdcbde6 P d96bd70b967c4d48b9178f607bb41a2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe2a5ef8273a45c1b8eec8d1b658ebe9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41051 } } peers { permanent_uuid: "d96bd70b967c4d48b9178f607bb41a2a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39697 } } peers { permanent_uuid: "f98ea9d44ed045b7aed86555ffd49b57" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35447 } }
I20260806 09:20:02.001801 31940 heartbeater.cc:503] Master 127.10.255.126:42325 was elected leader, sending a full tablet report...
I20260806 09:20:02.002630 31959 ts_tablet_manager.cc:1428] T 03b5f36b9c314d41985a37d82bdcbde6 P d96bd70b967c4d48b9178f607bb41a2a: Time spent starting tablet: real 0.017s user 0.013s sys 0.001s
I20260806 09:20:02.002892 31960 raft_consensus.cc:348] T 03b5f36b9c314d41985a37d82bdcbde6 P fe2a5ef8273a45c1b8eec8d1b658ebe9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe2a5ef8273a45c1b8eec8d1b658ebe9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41051 } } peers { permanent_uuid: "d96bd70b967c4d48b9178f607bb41a2a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39697 } } peers { permanent_uuid: "f98ea9d44ed045b7aed86555ffd49b57" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35447 } }
I20260806 09:20:02.003508 31960 raft_consensus.cc:374] T 03b5f36b9c314d41985a37d82bdcbde6 P fe2a5ef8273a45c1b8eec8d1b658ebe9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:20:02.003672 31960 raft_consensus.cc:729] T 03b5f36b9c314d41985a37d82bdcbde6 P fe2a5ef8273a45c1b8eec8d1b658ebe9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe2a5ef8273a45c1b8eec8d1b658ebe9, State: Initialized, Role: FOLLOWER
I20260806 09:20:02.004457 31960 consensus_queue.cc:260] T 03b5f36b9c314d41985a37d82bdcbde6 P fe2a5ef8273a45c1b8eec8d1b658ebe9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe2a5ef8273a45c1b8eec8d1b658ebe9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41051 } } peers { permanent_uuid: "d96bd70b967c4d48b9178f607bb41a2a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39697 } } peers { permanent_uuid: "f98ea9d44ed045b7aed86555ffd49b57" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35447 } }
I20260806 09:20:02.007311 31960 ts_tablet_manager.cc:1428] T 03b5f36b9c314d41985a37d82bdcbde6 P fe2a5ef8273a45c1b8eec8d1b658ebe9: Time spent starting tablet: real 0.013s user 0.010s sys 0.002s
I20260806 09:20:02.008945 31962 raft_consensus.cc:348] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe2a5ef8273a45c1b8eec8d1b658ebe9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41051 } } peers { permanent_uuid: "d96bd70b967c4d48b9178f607bb41a2a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39697 } } peers { permanent_uuid: "f98ea9d44ed045b7aed86555ffd49b57" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35447 } }
I20260806 09:20:02.009467 31962 raft_consensus.cc:374] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:20:02.009581 31962 raft_consensus.cc:729] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f98ea9d44ed045b7aed86555ffd49b57, State: Initialized, Role: FOLLOWER
I20260806 09:20:02.010365 31962 consensus_queue.cc:260] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe2a5ef8273a45c1b8eec8d1b658ebe9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41051 } } peers { permanent_uuid: "d96bd70b967c4d48b9178f607bb41a2a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39697 } } peers { permanent_uuid: "f98ea9d44ed045b7aed86555ffd49b57" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35447 } }
I20260806 09:20:02.012276 31810 heartbeater.cc:503] Master 127.10.255.126:42325 was elected leader, sending a full tablet report...
I20260806 09:20:02.012830 31962 ts_tablet_manager.cc:1428] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57: Time spent starting tablet: real 0.017s user 0.013s sys 0.004s
W20260806 09:20:02.073266 31679 tablet.cc:2369] T 03b5f36b9c314d41985a37d82bdcbde6 P fe2a5ef8273a45c1b8eec8d1b658ebe9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 09:20:02.077275 31811 tablet.cc:2369] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 09:20:02.107498 31941 tablet.cc:2369] T 03b5f36b9c314d41985a37d82bdcbde6 P d96bd70b967c4d48b9178f607bb41a2a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:20:02.117178 31967 raft_consensus.cc:482] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 09:20:02.117653 31967 raft_consensus.cc:504] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe2a5ef8273a45c1b8eec8d1b658ebe9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41051 } } peers { permanent_uuid: "d96bd70b967c4d48b9178f607bb41a2a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39697 } } peers { permanent_uuid: "f98ea9d44ed045b7aed86555ffd49b57" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35447 } }
I20260806 09:20:02.119522 31967 leader_election.cc:288] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fe2a5ef8273a45c1b8eec8d1b658ebe9 (127.10.255.65:41051), d96bd70b967c4d48b9178f607bb41a2a (127.10.255.67:39697)
I20260806 09:20:02.128247 31955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:02.120170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:45499 (local address 127.10.255.65:41051)
0806 09:20:02.120395 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:02.120404 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:02.121668 (+ 1264us) server_negotiation.cc:407] Connection header received
0806 09:20:02.122095 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:02.122100 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:02.122197 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:02.122323 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:20:02.123044 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:02.124245 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:02.126368 (+ 2123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:02.127250 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:02.127475 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:02.127556 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:02.127850 (+ 294us) server_negotiation.cc:299] Negotiation successful
0806 09:20:02.127988 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 09:20:02.128407 31968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:02.120084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:41051 (local address 127.10.255.66:45499)
0806 09:20:02.121280 (+ 1196us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:02.121307 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:02.121626 (+ 319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:02.122388 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:02.122396 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:02.122434 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:20:02.122862 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:02.122874 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:02.124411 (+ 1537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:02.124415 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:02.126119 (+ 1704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:02.126141 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:02.127475 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:02.127483 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:02.127657 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:02.127683 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 09:20:02.127797 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 09:20:02.127962 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":907,"mutex_wait_us":47,"thread_start_us":496,"threads_started":1}
I20260806 09:20:02.129166 31956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:02.120116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.255.66:45379 (local address 127.10.255.67:39697)
0806 09:20:02.120401 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:02.120411 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:02.122660 (+ 2249us) server_negotiation.cc:407] Connection header received
0806 09:20:02.122881 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:02.122894 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:02.122986 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:02.123083 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 09:20:02.123610 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:02.124608 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:02.126684 (+ 2076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:02.127986 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:02.128265 (+ 279us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:02.128343 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:02.128743 (+ 400us) server_negotiation.cc:299] Negotiation successful
0806 09:20:02.128893 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260806 09:20:02.129240 31969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:02.120941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.67:39697 (local address 127.10.255.66:45379)
0806 09:20:02.122528 (+ 1587us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:02.122545 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:02.122719 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:02.123113 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:02.123116 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:02.123139 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 09:20:02.123431 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:02.123440 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:02.124761 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:02.124769 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:02.126402 (+ 1633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:02.126416 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:02.128292 (+ 1876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:02.128302 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:02.128532 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:02.128585 (+ 53us) client_negotiation.cc:769] Sending connection context
0806 09:20:02.128696 (+ 111us) client_negotiation.cc:240] Negotiation successful
0806 09:20:02.128844 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1417,"mutex_wait_us":157,"thread_start_us":769,"threads_started":1}
I20260806 09:20:02.129743 31633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03b5f36b9c314d41985a37d82bdcbde6" candidate_uuid: "f98ea9d44ed045b7aed86555ffd49b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2a5ef8273a45c1b8eec8d1b658ebe9" is_pre_election: true
I20260806 09:20:02.130317 31633 raft_consensus.cc:2454] T 03b5f36b9c314d41985a37d82bdcbde6 P fe2a5ef8273a45c1b8eec8d1b658ebe9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f98ea9d44ed045b7aed86555ffd49b57 in term 0.
I20260806 09:20:02.130414 31895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03b5f36b9c314d41985a37d82bdcbde6" candidate_uuid: "f98ea9d44ed045b7aed86555ffd49b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d96bd70b967c4d48b9178f607bb41a2a" is_pre_election: true
I20260806 09:20:02.131019 31895 raft_consensus.cc:2454] T 03b5f36b9c314d41985a37d82bdcbde6 P d96bd70b967c4d48b9178f607bb41a2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f98ea9d44ed045b7aed86555ffd49b57 in term 0.
I20260806 09:20:02.131031 31698 leader_election.cc:302] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f98ea9d44ed045b7aed86555ffd49b57, fe2a5ef8273a45c1b8eec8d1b658ebe9; no voters:
I20260806 09:20:02.131467 31967 raft_consensus.cc:2781] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 09:20:02.131646 31967 raft_consensus.cc:482] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 09:20:02.131776 31967 raft_consensus.cc:3037] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:02.134148 31967 raft_consensus.cc:504] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe2a5ef8273a45c1b8eec8d1b658ebe9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41051 } } peers { permanent_uuid: "d96bd70b967c4d48b9178f607bb41a2a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39697 } } peers { permanent_uuid: "f98ea9d44ed045b7aed86555ffd49b57" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35447 } }
I20260806 09:20:02.134881 31967 leader_election.cc:288] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57 [CANDIDATE]: Term 1 election: Requested vote from peers fe2a5ef8273a45c1b8eec8d1b658ebe9 (127.10.255.65:41051), d96bd70b967c4d48b9178f607bb41a2a (127.10.255.67:39697)
I20260806 09:20:02.135469 31633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03b5f36b9c314d41985a37d82bdcbde6" candidate_uuid: "f98ea9d44ed045b7aed86555ffd49b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fe2a5ef8273a45c1b8eec8d1b658ebe9"
I20260806 09:20:02.135591 31895 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03b5f36b9c314d41985a37d82bdcbde6" candidate_uuid: "f98ea9d44ed045b7aed86555ffd49b57" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d96bd70b967c4d48b9178f607bb41a2a"
I20260806 09:20:02.135716 31633 raft_consensus.cc:3037] T 03b5f36b9c314d41985a37d82bdcbde6 P fe2a5ef8273a45c1b8eec8d1b658ebe9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:02.135911 31895 raft_consensus.cc:3037] T 03b5f36b9c314d41985a37d82bdcbde6 P d96bd70b967c4d48b9178f607bb41a2a [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:02.138350 31633 raft_consensus.cc:2454] T 03b5f36b9c314d41985a37d82bdcbde6 P fe2a5ef8273a45c1b8eec8d1b658ebe9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f98ea9d44ed045b7aed86555ffd49b57 in term 1.
I20260806 09:20:02.138342 31895 raft_consensus.cc:2454] T 03b5f36b9c314d41985a37d82bdcbde6 P d96bd70b967c4d48b9178f607bb41a2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f98ea9d44ed045b7aed86555ffd49b57 in term 1.
I20260806 09:20:02.138931 31699 leader_election.cc:302] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d96bd70b967c4d48b9178f607bb41a2a, f98ea9d44ed045b7aed86555ffd49b57; no voters:
I20260806 09:20:02.139307 31967 raft_consensus.cc:2781] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:20:02.140010 31967 raft_consensus.cc:686] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57 [term 1 LEADER]: Becoming Leader. State: Replica: f98ea9d44ed045b7aed86555ffd49b57, State: Running, Role: LEADER
I20260806 09:20:02.140558 31967 consensus_queue.cc:237] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe2a5ef8273a45c1b8eec8d1b658ebe9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41051 } } peers { permanent_uuid: "d96bd70b967c4d48b9178f607bb41a2a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39697 } } peers { permanent_uuid: "f98ea9d44ed045b7aed86555ffd49b57" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35447 } }
I20260806 09:20:02.146056 31491 catalog_manager.cc:5495] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57 reported cstate change: term changed from 0 to 1, leader changed from <none> to f98ea9d44ed045b7aed86555ffd49b57 (127.10.255.66). New cstate: current_term: 1 leader_uuid: "f98ea9d44ed045b7aed86555ffd49b57" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fe2a5ef8273a45c1b8eec8d1b658ebe9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d96bd70b967c4d48b9178f607bb41a2a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f98ea9d44ed045b7aed86555ffd49b57" member_type: VOTER last_known_addr { host: "127.10.255.66" port: 35447 } health_report { overall_health: HEALTHY } } }
I20260806 09:20:02.203959 31958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:02.197214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37416 (local address 127.10.255.66:35447)
0806 09:20:02.197432 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:02.197438 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:02.197486 (+ 48us) server_negotiation.cc:407] Connection header received
0806 09:20:02.197721 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:02.197727 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:02.197841 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:02.198024 (+ 183us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:20:02.198379 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:02.199477 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:02.201035 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:02.201820 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:02.201968 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:02.202504 (+ 536us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:20:02.203227 (+ 723us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:20:02.203388 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:02.203538 (+ 150us) server_negotiation.cc:299] Negotiation successful
0806 09:20:02.203634 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260806 09:20:02.213481 31895 raft_consensus.cc:1261] T 03b5f36b9c314d41985a37d82bdcbde6 P d96bd70b967c4d48b9178f607bb41a2a [term 1 FOLLOWER]: Refusing update from remote peer f98ea9d44ed045b7aed86555ffd49b57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:20:02.213689 31633 raft_consensus.cc:1261] T 03b5f36b9c314d41985a37d82bdcbde6 P fe2a5ef8273a45c1b8eec8d1b658ebe9 [term 1 FOLLOWER]: Refusing update from remote peer f98ea9d44ed045b7aed86555ffd49b57: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:20:02.214795 31970 consensus_queue.cc:1035] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fe2a5ef8273a45c1b8eec8d1b658ebe9" member_type: VOTER last_known_addr { host: "127.10.255.65" port: 41051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:20:02.215226 31967 consensus_queue.cc:1035] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d96bd70b967c4d48b9178f607bb41a2a" member_type: VOTER last_known_addr { host: "127.10.255.67" port: 39697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:20:02.230242 31974 mvcc.cc:205] Tried to move back new op lower bound from 7315488777054003200 to 7315488776771969024. Current Snapshot: MvccSnapshot[applied={T|T < 7315488777054003200}]
I20260806 09:20:02.231711 31975 mvcc.cc:205] Tried to move back new op lower bound from 7315488777054003200 to 7315488776771969024. Current Snapshot: MvccSnapshot[applied={T|T < 7315488777054003200}]
I20260806 09:20:02.250835 31490 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47124:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:20:02.251207 31490 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47124:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 09:20:02.256443 31490 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b2a8d36b2b7a455494c14ad868c082ce: Sending DeleteTablet for 3 replicas of tablet 03b5f36b9c314d41985a37d82bdcbde6
I20260806 09:20:02.258029 31875 tablet_service.cc:1514] Processing DeleteTablet for tablet 03b5f36b9c314d41985a37d82bdcbde6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:20:02 UTC) from {username='slave'} at 127.0.0.1:41988
I20260806 09:20:02.258148 31745 tablet_service.cc:1514] Processing DeleteTablet for tablet 03b5f36b9c314d41985a37d82bdcbde6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:20:02 UTC) from {username='slave'} at 127.0.0.1:37408
I20260806 09:20:02.259002 31613 tablet_service.cc:1514] Processing DeleteTablet for tablet 03b5f36b9c314d41985a37d82bdcbde6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 09:20:02 UTC) from {username='slave'} at 127.0.0.1:40786
I20260806 09:20:02.261343 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 31551
I20260806 09:20:02.269120 31985 tablet_replica.cc:330] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57: stopping tablet replica
I20260806 09:20:02.269716 31985 raft_consensus.cc:2229] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57 [term 1 LEADER]: Raft consensus shutting down.
I20260806 09:20:02.270596 31985 raft_consensus.cc:2258] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:20:02.273554 31985 ts_tablet_manager.cc:1905] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:20:02.282356 31985 ts_tablet_manager.cc:1918] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:20:02.282593 31985 log.cc:1196] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-1/wal/wals/03b5f36b9c314d41985a37d82bdcbde6
I20260806 09:20:02.283228 31985 ts_tablet_manager.cc:1939] T 03b5f36b9c314d41985a37d82bdcbde6 P f98ea9d44ed045b7aed86555ffd49b57: Deleting consensus metadata
I20260806 09:20:02.284447 31984 tablet_replica.cc:330] T 03b5f36b9c314d41985a37d82bdcbde6 P d96bd70b967c4d48b9178f607bb41a2a: stopping tablet replica
I20260806 09:20:02.284971 31984 raft_consensus.cc:2229] T 03b5f36b9c314d41985a37d82bdcbde6 P d96bd70b967c4d48b9178f607bb41a2a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:20:02.285594 31984 raft_consensus.cc:2258] T 03b5f36b9c314d41985a37d82bdcbde6 P d96bd70b967c4d48b9178f607bb41a2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:20:02.287767 31474 catalog_manager.cc:4841] TS f98ea9d44ed045b7aed86555ffd49b57 (127.10.255.66:35447): tablet 03b5f36b9c314d41985a37d82bdcbde6 (table test-table [id=152e767b69f24fc08a6af3c0e3660db0]) successfully deleted
I20260806 09:20:02.288512 31984 ts_tablet_manager.cc:1905] T 03b5f36b9c314d41985a37d82bdcbde6 P d96bd70b967c4d48b9178f607bb41a2a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:20:02.289753 31986 tablet_replica.cc:330] T 03b5f36b9c314d41985a37d82bdcbde6 P fe2a5ef8273a45c1b8eec8d1b658ebe9: stopping tablet replica
I20260806 09:20:02.290251 31986 raft_consensus.cc:2229] T 03b5f36b9c314d41985a37d82bdcbde6 P fe2a5ef8273a45c1b8eec8d1b658ebe9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 09:20:02.290851 31986 raft_consensus.cc:2258] T 03b5f36b9c314d41985a37d82bdcbde6 P fe2a5ef8273a45c1b8eec8d1b658ebe9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 09:20:02.293617 31986 ts_tablet_manager.cc:1905] T 03b5f36b9c314d41985a37d82bdcbde6 P fe2a5ef8273a45c1b8eec8d1b658ebe9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 09:20:02.296602 31984 ts_tablet_manager.cc:1918] T 03b5f36b9c314d41985a37d82bdcbde6 P d96bd70b967c4d48b9178f607bb41a2a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 09:20:02.296880 31984 log.cc:1196] T 03b5f36b9c314d41985a37d82bdcbde6 P d96bd70b967c4d48b9178f607bb41a2a: Deleting WAL directory at /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786007647474472-11261-0/minicluster-data/ts-2/wal/wals/03b5f36b9c314d41985a37d82bdcbde6
I20260806 09:20:02.297498 31984 ts_tablet_manager.cc:1939] T 03b5f36b9c314d41985a37d82bdcbde6 P d96bd70b967c4d48b9178f607bb41a2a: Deleting consensus metadata
I20260806 09:20:02.298056 31955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:02.263181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40796 (local address 127.10.255.65:41051)
0806 09:20:02.263440 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:02.263449 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:02.288831 (+ 25382us) server_negotiation.cc:407] Connection header received
0806 09:20:02.289057 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:02.289064 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:02.289210 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:02.289337 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:02.290071 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:02.291343 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:02.293636 (+ 2293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:02.294289 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:02.294396 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:02.296085 (+ 1689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:02.296098 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:02.296119 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:02.296988 (+ 869us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:02.297059 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:02.297089 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:02.297189 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:02.297491 (+ 302us) server_negotiation.cc:299] Negotiation successful
0806 09:20:02.297637 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260806 09:20:02.299489 31673 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:20:02.300863 31475 catalog_manager.cc:4841] TS d96bd70b967c4d48b9178f607bb41a2a (127.10.255.67:39697): tablet 03b5f36b9c314d41985a37d82bdcbde6 (table test-table [id=152e767b69f24fc08a6af3c0e3660db0]) successfully deleted
I20260806 09:20:02.395076 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 31551
W20260806 09:20:02.414543 31474 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.255.65:41051 (error 108)
I20260806 09:20:02.414786 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 31682
I20260806 09:20:02.418217 31957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:02.417640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:41051 (local address 127.0.0.1:40804)
0806 09:20:02.417866 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:02.418017 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.65:41051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260806 09:20:02.418581 31474 catalog_manager.cc:4584] TS fe2a5ef8273a45c1b8eec8d1b658ebe9 (127.10.255.65:41051): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 03b5f36b9c314d41985a37d82bdcbde6: Network error: Client connection negotiation failed: client connection to 127.10.255.65:41051: connect: Connection refused (error 111)
I20260806 09:20:02.423365 31958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:02.416305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37430 (local address 127.10.255.66:35447)
0806 09:20:02.416562 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:02.416569 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:02.416591 (+ 22us) server_negotiation.cc:407] Connection header received
0806 09:20:02.416670 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:02.416678 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:02.416801 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:02.416921 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:02.417401 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:02.418449 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:02.419893 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:02.420405 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:02.420578 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:02.421751 (+ 1173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:02.421761 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:02.421776 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:02.422467 (+ 691us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:02.422521 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:02.422555 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:02.422708 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:02.422862 (+ 154us) server_negotiation.cc:299] Negotiation successful
0806 09:20:02.422983 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 09:20:02.424105 31805 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:20:02.472510 31957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:02.472032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:41051 (local address 127.0.0.1:40810)
0806 09:20:02.472258 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:02.472349 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.65:41051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260806 09:20:02.473796 31957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:02.473430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:41051 (local address 127.0.0.1:40816)
0806 09:20:02.473603 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:02.473682 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.65:41051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260806 09:20:02.534600 31957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:02.533961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:41051 (local address 127.0.0.1:40828)
0806 09:20:02.534303 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:02.534405 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.65:41051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164}
I20260806 09:20:02.535955 31957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:02.535459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:41051 (local address 127.0.0.1:40840)
0806 09:20:02.535684 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:02.535761 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.65:41051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260806 09:20:02.544153 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 31682
I20260806 09:20:02.564545 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 31813
I20260806 09:20:02.571955 31956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:02.565413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42004 (local address 127.10.255.67:39697)
0806 09:20:02.565620 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:02.565628 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:02.565653 (+ 25us) server_negotiation.cc:407] Connection header received
0806 09:20:02.565821 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:02.565827 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:02.565960 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:02.566056 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:02.566424 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:02.567117 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:02.568514 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:02.568968 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:02.569098 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:02.570205 (+ 1107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:02.570217 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:02.570233 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:02.570879 (+ 646us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:02.570967 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:02.570998 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:02.571106 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:02.571336 (+ 230us) server_negotiation.cc:299] Negotiation successful
0806 09:20:02.571472 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 09:20:02.572711 31935 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:20:02.616951 31957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:02.616323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:41051 (local address 127.0.0.1:40852)
0806 09:20:02.616600 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:02.616722 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.65:41051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
I20260806 09:20:02.618243 31957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:02.617774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:41051 (local address 127.0.0.1:40862)
0806 09:20:02.618001 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:02.618102 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.65:41051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260806 09:20:02.665098 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 31813
I20260806 09:20:02.684919 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 31459
I20260806 09:20:02.686228 31522 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:20:02.800693 31957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:02.799949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.65:41051 (local address 127.0.0.1:40872)
0806 09:20:02.800210 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:02.800383 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.65:41051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 09:20:02.801198 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 31459
2026-08-06T09:20:02Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3165 ms)
[----------] 6 tests from EncryptionPolicyTest (24189 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:20:02 dist-test-slave-mvvj krb5kdc[31995](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:20:02 dist-test-slave-mvvj krb5kdc[31995](info): set up 2 sockets
Aug 06 09:20:02 dist-test-slave-mvvj krb5kdc[31995](info): commencing operation
krb5kdc: starting...
W20260806 09:20:03.955602 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.005s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:20:04 dist-test-slave-mvvj krb5kdc[31995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:20:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:20:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 09:20:04.259984 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43527
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43527
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:20:04.618605 32008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:04.618963 32008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:04.619083 32008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:04.627801 32008 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:04.628031 32008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:04.628103 32008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:04.628175 32008 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:04.628226 32008 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:04.640086 32008 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43527
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43527
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:04.641537 32008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:04.642982 32008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:04.657066 32013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:04.657130 32016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:04.657155 32014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:04.658181 32008 server_base.cc:1034] running on GCE node
I20260806 09:20:04.659204 32008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:04.660925 32008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:04.662199 32008 hybrid_clock.cc:648] HybridClock initialized: now 1786008004662166 us; error 62 us; skew 500 ppm
I20260806 09:20:04.662670 32008 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:20:04 dist-test-slave-mvvj krb5kdc[31995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008004, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:20:04.666308 32008 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 09:20:04.669167 32008 webserver.cc:460] Webserver started at http://127.0.0.1:33963/ using document root <none> and password file <none>
I20260806 09:20:04.670271 32008 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:04.670480 32008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:04.670857 32008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:04.674703 32008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "7f45946a4b61431785e70caa254a0e5d"
format_stamp: "Formatted at 2026-08-06 09:20:04 on dist-test-slave-mvvj"
server_key: "03d48f7547d80b44a37fe9a7a1d33caf"
server_key_iv: "3b0c40e2be3de7eaa04366e64a6ddc33"
server_key_version: "encryptionkey@0"
I20260806 09:20:04.675792 32008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "7f45946a4b61431785e70caa254a0e5d"
format_stamp: "Formatted at 2026-08-06 09:20:04 on dist-test-slave-mvvj"
server_key: "03d48f7547d80b44a37fe9a7a1d33caf"
server_key_iv: "3b0c40e2be3de7eaa04366e64a6ddc33"
server_key_version: "encryptionkey@0"
I20260806 09:20:04.684437 32008 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.007s sys 0.000s
I20260806 09:20:04.690110 32023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:04.692129 32008 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:20:04.692370 32008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "7f45946a4b61431785e70caa254a0e5d"
format_stamp: "Formatted at 2026-08-06 09:20:04 on dist-test-slave-mvvj"
server_key: "03d48f7547d80b44a37fe9a7a1d33caf"
server_key_iv: "3b0c40e2be3de7eaa04366e64a6ddc33"
server_key_version: "encryptionkey@0"
I20260806 09:20:04.692616 32008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:04.723430 32008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:04.728868 32008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:04.729278 32008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:04.752122 32008 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43527
I20260806 09:20:04.752213 32075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43527 every 8 connection(s)
I20260806 09:20:04.753674 32008 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:20:04.757773 32076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:20:04.760388 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 32008
I20260806 09:20:04.760627 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:20:04.761448 11261 external_mini_cluster.cc:1428] Setting key 29fea55f6df2216e8955c38d8bf91685
I20260806 09:20:04.771586 32076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f45946a4b61431785e70caa254a0e5d: Bootstrap starting.
I20260806 09:20:04.775962 32076 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f45946a4b61431785e70caa254a0e5d: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:04.777529 32076 log.cc:824] T 00000000000000000000000000000000 P 7f45946a4b61431785e70caa254a0e5d: Log is configured to *not* fsync() on all Append() calls
Aug 06 09:20:04 dist-test-slave-mvvj krb5kdc[31995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008004, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 09:20:04.781132 32076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f45946a4b61431785e70caa254a0e5d: No bootstrap required, opened a new log
I20260806 09:20:04.788805 32079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:04.763912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56839 (local address 127.0.0.1:43527)
0806 09:20:04.764902 (+ 990us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:04.764923 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:04.764969 (+ 46us) server_negotiation.cc:407] Connection header received
0806 09:20:04.766903 (+ 1934us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:04.766935 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:04.767393 (+ 458us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:04.767788 (+ 395us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:04.769789 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:04.771372 (+ 1583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:04.773342 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:04.774155 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:04.774313 (+ 158us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:04.780109 (+ 5796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:04.780118 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:04.780135 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:04.780180 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:04.783661 (+ 3481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:04.784822 (+ 1161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:04.784829 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:04.784839 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:04.785026 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:04.785553 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:04.785556 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:04.785558 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:04.786134 (+ 576us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:04.786404 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:04.787069 (+ 665us) server_negotiation.cc:299] Negotiation successful
0806 09:20:04.787518 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":728,"thread_start_us":457,"threads_started":1}
I20260806 09:20:04.790994 32076 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f45946a4b61431785e70caa254a0e5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f45946a4b61431785e70caa254a0e5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43527 } }
I20260806 09:20:04.791404 32076 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f45946a4b61431785e70caa254a0e5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:20:04.791527 32076 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f45946a4b61431785e70caa254a0e5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f45946a4b61431785e70caa254a0e5d, State: Initialized, Role: FOLLOWER
I20260806 09:20:04.792209 32076 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f45946a4b61431785e70caa254a0e5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f45946a4b61431785e70caa254a0e5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43527 } }
I20260806 09:20:04.792490 32076 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f45946a4b61431785e70caa254a0e5d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:20:04.792654 32076 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f45946a4b61431785e70caa254a0e5d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:20:04.792869 32076 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f45946a4b61431785e70caa254a0e5d [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:04.793672 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:20:04.795318 32076 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f45946a4b61431785e70caa254a0e5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f45946a4b61431785e70caa254a0e5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43527 } }
I20260806 09:20:04.795933 32076 leader_election.cc:302] T 00000000000000000000000000000000 P 7f45946a4b61431785e70caa254a0e5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f45946a4b61431785e70caa254a0e5d; no voters:
I20260806 09:20:04.796659 32076 leader_election.cc:288] T 00000000000000000000000000000000 P 7f45946a4b61431785e70caa254a0e5d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:20:04.796806 32081 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f45946a4b61431785e70caa254a0e5d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:20:04.800431 32081 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f45946a4b61431785e70caa254a0e5d [term 1 LEADER]: Becoming Leader. State: Replica: 7f45946a4b61431785e70caa254a0e5d, State: Running, Role: LEADER
I20260806 09:20:04.801060 32081 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f45946a4b61431785e70caa254a0e5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f45946a4b61431785e70caa254a0e5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43527 } }
I20260806 09:20:04.801582 32076 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f45946a4b61431785e70caa254a0e5d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:20:04.804016 32085 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f45946a4b61431785e70caa254a0e5d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f45946a4b61431785e70caa254a0e5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f45946a4b61431785e70caa254a0e5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43527 } } }
I20260806 09:20:04.804517 32085 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f45946a4b61431785e70caa254a0e5d [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:04.804517 32086 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f45946a4b61431785e70caa254a0e5d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f45946a4b61431785e70caa254a0e5d. Latest consensus state: current_term: 1 leader_uuid: "7f45946a4b61431785e70caa254a0e5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f45946a4b61431785e70caa254a0e5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43527 } } }
I20260806 09:20:04.805413 32086 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f45946a4b61431785e70caa254a0e5d [sys.catalog]: This master's current role is: LEADER
W20260806 09:20:04.828835 32102 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7f45946a4b61431785e70caa254a0e5d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 09:20:04.829036 32102 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 09:20:04.829221 32092 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:20:04.831813 32092 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:20:04.831882 32079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:04.800206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50633 (local address 127.0.0.1:43527)
0806 09:20:04.800385 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:04.800391 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:04.803661 (+ 3270us) server_negotiation.cc:407] Connection header received
0806 09:20:04.803962 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:04.803971 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:04.804113 (+ 142us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:04.804251 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:04.807311 (+ 3060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:04.813544 (+ 6233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:04.816573 (+ 3029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:04.817735 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:04.817922 (+ 187us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:04.823247 (+ 5325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:04.823259 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:04.823271 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:04.823338 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:04.827495 (+ 4157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:04.828876 (+ 1381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:04.828882 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:04.828886 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:04.829079 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:04.829752 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:04.829758 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:04.829761 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:04.830356 (+ 595us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:04.830711 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:04.831190 (+ 479us) server_negotiation.cc:299] Negotiation successful
0806 09:20:04.831410 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 09:20:04.841768 32092 catalog_manager.cc:1347] Generated new cluster ID: 0fd51bb996624ea9bad9e4fc6f9d7555
I20260806 09:20:04.841918 32092 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:20:04.888453 32092 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:20:04.890062 32092 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:20:04.906733 32092 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f45946a4b61431785e70caa254a0e5d: Generated new TSK 0
I20260806 09:20:04.907804 32092 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:20:04.922788 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 32008
I20260806 09:20:04.924475 32071 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:20:05.024662 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 32008
W20260806 09:20:05.045187 31993 connection.cc:535] client connection to 127.0.0.1:43527 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43527): Connection reset by peer (error 104)
2026-08-06T09:20:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2214 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:20:05 dist-test-slave-mvvj krb5kdc[32108](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:20:05 dist-test-slave-mvvj krb5kdc[32108](info): set up 2 sockets
Aug 06 09:20:05 dist-test-slave-mvvj krb5kdc[32108](info): commencing operation
krb5kdc: starting...
W20260806 09:20:06.198906 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.000s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:20:06 dist-test-slave-mvvj krb5kdc[32108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:20:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:20:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 09:20:06.492621 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34579
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34579
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:20:06.857570 32121 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:06.858081 32121 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:06.858276 32121 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:06.866865 32121 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:06.867003 32121 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:06.867121 32121 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:06.867237 32121 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:06.867324 32121 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:06.878034 32121 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34579
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34579
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:06.879508 32121 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:06.880987 32121 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:06.893994 32127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:06.894021 32129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:06.894044 32126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:06.895246 32121 server_base.cc:1034] running on GCE node
I20260806 09:20:06.896173 32121 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:06.897735 32121 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:06.898989 32121 hybrid_clock.cc:648] HybridClock initialized: now 1786008006898900 us; error 72 us; skew 500 ppm
I20260806 09:20:06.899443 32121 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:20:06 dist-test-slave-mvvj krb5kdc[32108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008006, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:20:06.907570 32121 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 09:20:06.909415 32121 webserver.cc:460] Webserver started at http://127.0.0.1:43089/ using document root <none> and password file <none>
I20260806 09:20:06.910182 32121 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:06.910306 32121 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:06.910596 32121 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:06.914294 32121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "7c540d5ecb9c4635b058832b936ecab7"
format_stamp: "Formatted at 2026-08-06 09:20:06 on dist-test-slave-mvvj"
server_key: "608a859bfbf6bf5c7c7a545d2663f519"
server_key_iv: "756785413e4b850ec5b32e5bd14a82bc"
server_key_version: "encryptionkey@0"
I20260806 09:20:06.915194 32121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "7c540d5ecb9c4635b058832b936ecab7"
format_stamp: "Formatted at 2026-08-06 09:20:06 on dist-test-slave-mvvj"
server_key: "608a859bfbf6bf5c7c7a545d2663f519"
server_key_iv: "756785413e4b850ec5b32e5bd14a82bc"
server_key_version: "encryptionkey@0"
I20260806 09:20:06.921590 32121 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260806 09:20:06.925664 32136 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:06.927250 32121 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 09:20:06.927472 32121 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "7c540d5ecb9c4635b058832b936ecab7"
format_stamp: "Formatted at 2026-08-06 09:20:06 on dist-test-slave-mvvj"
server_key: "608a859bfbf6bf5c7c7a545d2663f519"
server_key_iv: "756785413e4b850ec5b32e5bd14a82bc"
server_key_version: "encryptionkey@0"
I20260806 09:20:06.927703 32121 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:06.943054 32121 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:06.947579 32121 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:06.947937 32121 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:06.968389 32121 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34579
I20260806 09:20:06.968428 32187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34579 every 8 connection(s)
I20260806 09:20:06.969902 32121 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:20:06.972721 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 32121
I20260806 09:20:06.972914 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:20:06.973533 11261 external_mini_cluster.cc:1428] Setting key 4aa0afb1d1dc957656507e770c49df33
I20260806 09:20:06.974884 32188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:20:06.988792 32188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c540d5ecb9c4635b058832b936ecab7: Bootstrap starting.
I20260806 09:20:06.988945 32192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:06.975610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51805 (local address 127.0.0.1:34579)
0806 09:20:06.976581 (+ 971us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:06.976593 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:06.976637 (+ 44us) server_negotiation.cc:407] Connection header received
0806 09:20:06.978379 (+ 1742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:06.978422 (+ 43us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:06.978873 (+ 451us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:06.979560 (+ 687us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:06.980304 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:06.981939 (+ 1635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:06.983507 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:06.984375 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:06.984610 (+ 235us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:06.986201 (+ 1591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:06.986210 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:06.986228 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:06.986901 (+ 673us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:06.986994 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:06.987034 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:06.987240 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:06.987558 (+ 318us) server_negotiation.cc:299] Negotiation successful
0806 09:20:06.987757 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":738,"thread_start_us":462,"threads_started":1}
I20260806 09:20:06.992398 32188 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c540d5ecb9c4635b058832b936ecab7: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:06.993337 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:20:06.993722 32188 log.cc:824] T 00000000000000000000000000000000 P 7c540d5ecb9c4635b058832b936ecab7: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:06.997088 32188 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c540d5ecb9c4635b058832b936ecab7: No bootstrap required, opened a new log
I20260806 09:20:07.006246 32192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:06.998495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58347 (local address 127.0.0.1:34579)
0806 09:20:06.998701 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:06.998708 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:06.999171 (+ 463us) server_negotiation.cc:407] Connection header received
0806 09:20:06.999351 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:06.999357 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:06.999446 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:06.999571 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:07.000240 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:07.001511 (+ 1271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:07.003108 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:07.003858 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:07.003999 (+ 141us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:07.005329 (+ 1330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:07.005336 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:07.005341 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:07.005365 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:07.005424 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:07.005445 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:07.005587 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:07.005786 (+ 199us) server_negotiation.cc:299] Negotiation successful
0806 09:20:07.005853 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 09:20:07.007442 32188 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c540d5ecb9c4635b058832b936ecab7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c540d5ecb9c4635b058832b936ecab7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34579 } }
I20260806 09:20:07.007973 32188 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7c540d5ecb9c4635b058832b936ecab7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:20:07.008097 32188 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c540d5ecb9c4635b058832b936ecab7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c540d5ecb9c4635b058832b936ecab7, State: Initialized, Role: FOLLOWER
I20260806 09:20:07.008772 32188 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c540d5ecb9c4635b058832b936ecab7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c540d5ecb9c4635b058832b936ecab7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34579 } }
I20260806 09:20:07.008997 32188 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c540d5ecb9c4635b058832b936ecab7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:20:07.009123 32188 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c540d5ecb9c4635b058832b936ecab7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:20:07.009294 32188 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c540d5ecb9c4635b058832b936ecab7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:07.012094 32188 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c540d5ecb9c4635b058832b936ecab7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c540d5ecb9c4635b058832b936ecab7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34579 } }
I20260806 09:20:07.012645 32188 leader_election.cc:302] T 00000000000000000000000000000000 P 7c540d5ecb9c4635b058832b936ecab7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c540d5ecb9c4635b058832b936ecab7; no voters:
I20260806 09:20:07.013279 32188 leader_election.cc:288] T 00000000000000000000000000000000 P 7c540d5ecb9c4635b058832b936ecab7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:20:07.013471 32199 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c540d5ecb9c4635b058832b936ecab7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:20:07.014384 32199 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c540d5ecb9c4635b058832b936ecab7 [term 1 LEADER]: Becoming Leader. State: Replica: 7c540d5ecb9c4635b058832b936ecab7, State: Running, Role: LEADER
I20260806 09:20:07.015017 32199 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c540d5ecb9c4635b058832b936ecab7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c540d5ecb9c4635b058832b936ecab7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34579 } }
I20260806 09:20:07.015596 32188 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c540d5ecb9c4635b058832b936ecab7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:20:07.018538 32200 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c540d5ecb9c4635b058832b936ecab7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7c540d5ecb9c4635b058832b936ecab7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c540d5ecb9c4635b058832b936ecab7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34579 } } }
I20260806 09:20:07.019181 32201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c540d5ecb9c4635b058832b936ecab7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c540d5ecb9c4635b058832b936ecab7. Latest consensus state: current_term: 1 leader_uuid: "7c540d5ecb9c4635b058832b936ecab7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c540d5ecb9c4635b058832b936ecab7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34579 } } }
I20260806 09:20:07.019541 32201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c540d5ecb9c4635b058832b936ecab7 [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:07.020087 32200 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c540d5ecb9c4635b058832b936ecab7 [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:07.025137 32204 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:20:07.031122 32204 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:20:07.042289 32204 catalog_manager.cc:1347] Generated new cluster ID: c64adb0e9c384911ac33cc5815738e1b
I20260806 09:20:07.042424 32204 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:20:07.053864 32204 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:20:07.055333 32204 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:20:07.065709 32204 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7c540d5ecb9c4635b058832b936ecab7: Generated new TSK 0
I20260806 09:20:07.066766 32204 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:20:07.083231 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 32121
W20260806 09:20:07.084872 32183 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:51805
W20260806 09:20:07.085749 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 32121: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 09:20:07.085956 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 32121
W20260806 09:20:07.104216 32106 connection.cc:535] client connection to 127.0.0.1:34579 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34579): Connection reset by peer (error 104)
2026-08-06T09:20:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2058 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:20:07 dist-test-slave-mvvj krb5kdc[32220](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:20:07 dist-test-slave-mvvj krb5kdc[32220](info): set up 2 sockets
Aug 06 09:20:07 dist-test-slave-mvvj krb5kdc[32220](info): commencing operation
krb5kdc: starting...
W20260806 09:20:08.242708 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.002s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:20:08 dist-test-slave-mvvj krb5kdc[32220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:20:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:20:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 09:20:08.533051 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38077
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39059
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38077
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:20:08.894794 32233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:08.895164 32233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:08.895383 32233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:08.903688 32233 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:08.903851 32233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:08.903903 32233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:08.904003 32233 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:08.904098 32233 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:08.914822 32233 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39059
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38077
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38077
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:08.916328 32233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:08.917784 32233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:08.932230 32239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:08.932440 32241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:08.932423 32238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:08.938702 32233 server_base.cc:1034] running on GCE node
I20260806 09:20:08.939754 32233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:08.941612 32233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:08.942903 32233 hybrid_clock.cc:648] HybridClock initialized: now 1786008008942848 us; error 64 us; skew 500 ppm
I20260806 09:20:08.943333 32233 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:20:08 dist-test-slave-mvvj krb5kdc[32220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008008, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:20:08.946919 32233 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 09:20:08.948642 32233 webserver.cc:460] Webserver started at http://127.0.0.1:36121/ using document root <none> and password file <none>
I20260806 09:20:08.949414 32233 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:08.949580 32233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:08.949908 32233 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:08.953342 32233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "63d72a9b695444b5b0644dd14e6aa281"
format_stamp: "Formatted at 2026-08-06 09:20:08 on dist-test-slave-mvvj"
server_key: "510af6eb2b40014e9c50dabdadfb7396"
server_key_iv: "695c881722c9116c176cee740c6f3de2"
server_key_version: "encryptionkey@0"
I20260806 09:20:08.954233 32233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "63d72a9b695444b5b0644dd14e6aa281"
format_stamp: "Formatted at 2026-08-06 09:20:08 on dist-test-slave-mvvj"
server_key: "510af6eb2b40014e9c50dabdadfb7396"
server_key_iv: "695c881722c9116c176cee740c6f3de2"
server_key_version: "encryptionkey@0"
I20260806 09:20:08.960413 32233 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 09:20:08.964615 32248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:08.966189 32233 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260806 09:20:08.966434 32233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "63d72a9b695444b5b0644dd14e6aa281"
format_stamp: "Formatted at 2026-08-06 09:20:08 on dist-test-slave-mvvj"
server_key: "510af6eb2b40014e9c50dabdadfb7396"
server_key_iv: "695c881722c9116c176cee740c6f3de2"
server_key_version: "encryptionkey@0"
I20260806 09:20:08.966773 32233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:08.973752 32233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:08.978847 32233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:08.979223 32233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:09.000638 32233 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38077
I20260806 09:20:09.000751 32299 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38077 every 8 connection(s)
I20260806 09:20:09.002179 32233 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:20:09.003738 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 32233
I20260806 09:20:09.004009 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:20:09.004669 11261 external_mini_cluster.cc:1428] Setting key 7b20dcc1016a2b64b67af09787d159bc
I20260806 09:20:09.007555 32300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:20:09.013243 32303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:09.006686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50911 (local address 127.0.0.1:38077)
0806 09:20:09.007553 (+ 867us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:09.007565 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:09.007609 (+ 44us) server_negotiation.cc:407] Connection header received
0806 09:20:09.009383 (+ 1774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:09.009408 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:09.009790 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:09.010156 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:09.011347 (+ 1191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:09.011357 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:09.011370 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:09.011394 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:09.011553 (+ 159us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:09.011578 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:09.011762 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:09.012009 (+ 247us) server_negotiation.cc:299] Negotiation successful
0806 09:20:09.012246 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":621,"thread_start_us":402,"threads_started":1}
I20260806 09:20:09.017460 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:20:09.022786 32300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63d72a9b695444b5b0644dd14e6aa281: Bootstrap starting.
I20260806 09:20:09.026547 32303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:09.023799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37257 (local address 127.0.0.1:38077)
0806 09:20:09.024023 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:09.024031 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:09.024306 (+ 275us) server_negotiation.cc:407] Connection header received
0806 09:20:09.024530 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:09.024534 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:09.024585 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:09.024672 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:09.025758 (+ 1086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:09.025762 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:09.025766 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:09.025781 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:09.025824 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:09.025839 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:09.025943 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:09.026103 (+ 160us) server_negotiation.cc:299] Negotiation successful
0806 09:20:09.026153 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260806 09:20:09.027483 32300 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 63d72a9b695444b5b0644dd14e6aa281: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:09.028791 32300 log.cc:824] T 00000000000000000000000000000000 P 63d72a9b695444b5b0644dd14e6aa281: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:09.031931 32300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63d72a9b695444b5b0644dd14e6aa281: No bootstrap required, opened a new log
I20260806 09:20:09.040349 32300 raft_consensus.cc:348] T 00000000000000000000000000000000 P 63d72a9b695444b5b0644dd14e6aa281 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63d72a9b695444b5b0644dd14e6aa281" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38077 } }
I20260806 09:20:09.040803 32300 raft_consensus.cc:374] T 00000000000000000000000000000000 P 63d72a9b695444b5b0644dd14e6aa281 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:20:09.040933 32300 raft_consensus.cc:729] T 00000000000000000000000000000000 P 63d72a9b695444b5b0644dd14e6aa281 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63d72a9b695444b5b0644dd14e6aa281, State: Initialized, Role: FOLLOWER
I20260806 09:20:09.041548 32300 consensus_queue.cc:260] T 00000000000000000000000000000000 P 63d72a9b695444b5b0644dd14e6aa281 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63d72a9b695444b5b0644dd14e6aa281" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38077 } }
I20260806 09:20:09.041801 32300 raft_consensus.cc:388] T 00000000000000000000000000000000 P 63d72a9b695444b5b0644dd14e6aa281 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:20:09.041976 32300 raft_consensus.cc:482] T 00000000000000000000000000000000 P 63d72a9b695444b5b0644dd14e6aa281 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:20:09.042151 32300 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 63d72a9b695444b5b0644dd14e6aa281 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:09.044759 32300 raft_consensus.cc:504] T 00000000000000000000000000000000 P 63d72a9b695444b5b0644dd14e6aa281 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63d72a9b695444b5b0644dd14e6aa281" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38077 } }
I20260806 09:20:09.045471 32300 leader_election.cc:302] T 00000000000000000000000000000000 P 63d72a9b695444b5b0644dd14e6aa281 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 63d72a9b695444b5b0644dd14e6aa281; no voters:
I20260806 09:20:09.046193 32300 leader_election.cc:288] T 00000000000000000000000000000000 P 63d72a9b695444b5b0644dd14e6aa281 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:20:09.046322 32310 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 63d72a9b695444b5b0644dd14e6aa281 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:20:09.047103 32310 raft_consensus.cc:686] T 00000000000000000000000000000000 P 63d72a9b695444b5b0644dd14e6aa281 [term 1 LEADER]: Becoming Leader. State: Replica: 63d72a9b695444b5b0644dd14e6aa281, State: Running, Role: LEADER
I20260806 09:20:09.047758 32310 consensus_queue.cc:237] T 00000000000000000000000000000000 P 63d72a9b695444b5b0644dd14e6aa281 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63d72a9b695444b5b0644dd14e6aa281" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38077 } }
I20260806 09:20:09.048425 32300 sys_catalog.cc:564] T 00000000000000000000000000000000 P 63d72a9b695444b5b0644dd14e6aa281 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:20:09.051293 32311 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63d72a9b695444b5b0644dd14e6aa281 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "63d72a9b695444b5b0644dd14e6aa281" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63d72a9b695444b5b0644dd14e6aa281" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38077 } } }
I20260806 09:20:09.051136 32312 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63d72a9b695444b5b0644dd14e6aa281 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 63d72a9b695444b5b0644dd14e6aa281. Latest consensus state: current_term: 1 leader_uuid: "63d72a9b695444b5b0644dd14e6aa281" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63d72a9b695444b5b0644dd14e6aa281" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38077 } } }
I20260806 09:20:09.051786 32312 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63d72a9b695444b5b0644dd14e6aa281 [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:09.053627 32311 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63d72a9b695444b5b0644dd14e6aa281 [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:09.054628 32319 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:20:09.060961 32319 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:20:09.071399 32319 catalog_manager.cc:1347] Generated new cluster ID: 130d157b0d0142ce8e312e47c7393684
I20260806 09:20:09.071568 32319 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:20:09.099076 32319 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:20:09.099695 32319 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:20:09.109127 32319 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 63d72a9b695444b5b0644dd14e6aa281: Generated new TSK 0
I20260806 09:20:09.110103 32319 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:20:09.120358 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 32233
W20260806 09:20:09.122275 32295 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:50911
W20260806 09:20:09.123173 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 32233: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 09:20:09.123369 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 32233
2026-08-06T09:20:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2040 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:20:09 dist-test-slave-mvvj krb5kdc[32331](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:20:09 dist-test-slave-mvvj krb5kdc[32331](info): set up 2 sockets
Aug 06 09:20:09 dist-test-slave-mvvj krb5kdc[32331](info): commencing operation
krb5kdc: starting...
W20260806 09:20:10.266898 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.011s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:20:10 dist-test-slave-mvvj krb5kdc[32331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:20:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:20:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 09:20:10.571697 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41193
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41193
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:20:10.935495 32344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:10.935894 32344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:10.936086 32344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:10.944063 32344 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:10.944209 32344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:10.944314 32344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:10.944450 32344 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:10.944557 32344 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:10.955148 32344 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41193
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41193
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:10.956674 32344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:10.958086 32344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:10.971299 32349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:10.971266 32350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:10.971728 32352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:10.972179 32344 server_base.cc:1034] running on GCE node
I20260806 09:20:10.972992 32344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:10.974516 32344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:10.975752 32344 hybrid_clock.cc:648] HybridClock initialized: now 1786008010975711 us; error 30 us; skew 500 ppm
I20260806 09:20:10.976173 32344 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:20:10 dist-test-slave-mvvj krb5kdc[32331](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008010, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:20:10.979598 32344 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 09:20:10.981374 32344 webserver.cc:460] Webserver started at http://127.0.0.1:46379/ using document root <none> and password file <none>
I20260806 09:20:10.982122 32344 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:10.982239 32344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:10.982514 32344 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:10.985800 32344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "8fbdd86e685f43648fc1690e3254a6bc"
format_stamp: "Formatted at 2026-08-06 09:20:10 on dist-test-slave-mvvj"
server_key: "baa64fba380654fd42a002c620b92780"
server_key_iv: "dc11fce0ae565053ab908466a0ad3645"
server_key_version: "encryptionkey@0"
I20260806 09:20:10.986620 32344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "8fbdd86e685f43648fc1690e3254a6bc"
format_stamp: "Formatted at 2026-08-06 09:20:10 on dist-test-slave-mvvj"
server_key: "baa64fba380654fd42a002c620b92780"
server_key_iv: "dc11fce0ae565053ab908466a0ad3645"
server_key_version: "encryptionkey@0"
I20260806 09:20:10.992483 32344 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260806 09:20:10.996384 32360 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:10.997939 32344 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260806 09:20:10.998255 32344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "8fbdd86e685f43648fc1690e3254a6bc"
format_stamp: "Formatted at 2026-08-06 09:20:10 on dist-test-slave-mvvj"
server_key: "baa64fba380654fd42a002c620b92780"
server_key_iv: "dc11fce0ae565053ab908466a0ad3645"
server_key_version: "encryptionkey@0"
I20260806 09:20:10.998533 32344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:11.031750 32344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:11.036933 32344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:11.037302 32344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:11.059072 32344 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41193
I20260806 09:20:11.059109 32411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41193 every 8 connection(s)
I20260806 09:20:11.060712 32344 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:20:11.061967 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 32344
I20260806 09:20:11.062216 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:20:11.062763 11261 external_mini_cluster.cc:1428] Setting key 908c6590122c7ed7688a28ec0a930daa
I20260806 09:20:11.065588 32412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 09:20:11 dist-test-slave-mvvj krb5kdc[32331](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008010, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 09:20:11.080189 32412 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fbdd86e685f43648fc1690e3254a6bc: Bootstrap starting.
I20260806 09:20:11.084856 32412 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8fbdd86e685f43648fc1690e3254a6bc: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:11.086212 32412 log.cc:824] T 00000000000000000000000000000000 P 8fbdd86e685f43648fc1690e3254a6bc: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:11.090119 32412 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8fbdd86e685f43648fc1690e3254a6bc: No bootstrap required, opened a new log
I20260806 09:20:11.090385 32415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:11.064801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55157 (local address 127.0.0.1:41193)
0806 09:20:11.065741 (+ 940us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:11.065760 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:11.065820 (+ 60us) server_negotiation.cc:407] Connection header received
0806 09:20:11.067642 (+ 1822us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:11.067666 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:11.068206 (+ 540us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:11.068603 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:11.070564 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:11.072306 (+ 1742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:11.074198 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:11.075039 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:11.075211 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:11.080742 (+ 5531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:11.080755 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:11.080784 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:11.080840 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:11.085197 (+ 4357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:11.086198 (+ 1001us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:11.086209 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:11.086219 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:11.086445 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:11.087034 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:11.087039 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:11.087042 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:11.087645 (+ 603us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:11.088034 (+ 389us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:11.088484 (+ 450us) server_negotiation.cc:299] Negotiation successful
0806 09:20:11.088966 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":667,"thread_start_us":395,"threads_started":1}
I20260806 09:20:11.094964 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:20:11.099463 32412 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8fbdd86e685f43648fc1690e3254a6bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fbdd86e685f43648fc1690e3254a6bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41193 } }
I20260806 09:20:11.100160 32412 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8fbdd86e685f43648fc1690e3254a6bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:20:11.100270 32412 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8fbdd86e685f43648fc1690e3254a6bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fbdd86e685f43648fc1690e3254a6bc, State: Initialized, Role: FOLLOWER
I20260806 09:20:11.100993 32412 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8fbdd86e685f43648fc1690e3254a6bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fbdd86e685f43648fc1690e3254a6bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41193 } }
I20260806 09:20:11.101258 32412 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8fbdd86e685f43648fc1690e3254a6bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:20:11.101413 32412 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8fbdd86e685f43648fc1690e3254a6bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:20:11.101601 32412 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8fbdd86e685f43648fc1690e3254a6bc [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:11.104389 32412 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8fbdd86e685f43648fc1690e3254a6bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fbdd86e685f43648fc1690e3254a6bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41193 } }
I20260806 09:20:11.104970 32412 leader_election.cc:302] T 00000000000000000000000000000000 P 8fbdd86e685f43648fc1690e3254a6bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8fbdd86e685f43648fc1690e3254a6bc; no voters:
I20260806 09:20:11.105751 32412 leader_election.cc:288] T 00000000000000000000000000000000 P 8fbdd86e685f43648fc1690e3254a6bc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:20:11.105871 32422 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8fbdd86e685f43648fc1690e3254a6bc [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:20:11.108613 32412 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8fbdd86e685f43648fc1690e3254a6bc [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:20:11.112716 32422 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8fbdd86e685f43648fc1690e3254a6bc [term 1 LEADER]: Becoming Leader. State: Replica: 8fbdd86e685f43648fc1690e3254a6bc, State: Running, Role: LEADER
I20260806 09:20:11.113638 32422 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8fbdd86e685f43648fc1690e3254a6bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fbdd86e685f43648fc1690e3254a6bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41193 } }
I20260806 09:20:11.117810 32424 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fbdd86e685f43648fc1690e3254a6bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8fbdd86e685f43648fc1690e3254a6bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fbdd86e685f43648fc1690e3254a6bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41193 } } }
I20260806 09:20:11.118283 32424 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fbdd86e685f43648fc1690e3254a6bc [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:11.119323 32423 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8fbdd86e685f43648fc1690e3254a6bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8fbdd86e685f43648fc1690e3254a6bc. Latest consensus state: current_term: 1 leader_uuid: "8fbdd86e685f43648fc1690e3254a6bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8fbdd86e685f43648fc1690e3254a6bc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41193 } } }
I20260806 09:20:11.119681 32415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:11.099727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56211 (local address 127.0.0.1:41193)
0806 09:20:11.100013 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:11.100021 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:11.100415 (+ 394us) server_negotiation.cc:407] Connection header received
0806 09:20:11.100639 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:11.100648 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:11.100719 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:11.100831 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:11.102564 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:11.103483 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:11.105003 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:11.105537 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:11.105700 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:11.108947 (+ 3247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:11.108952 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:11.108955 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:11.108991 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:11.114819 (+ 5828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:11.116206 (+ 1387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:11.116216 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:11.116222 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:11.116485 (+ 263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:11.117143 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:11.117151 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:11.117157 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:11.117694 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:11.118088 (+ 394us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:11.118618 (+ 530us) server_negotiation.cc:299] Negotiation successful
0806 09:20:11.119013 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260806 09:20:11.120539 32432 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:20:11.119800 32423 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8fbdd86e685f43648fc1690e3254a6bc [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:11.127743 32432 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:20:11.139935 32432 catalog_manager.cc:1347] Generated new cluster ID: a681e9cb844c4312ae00519c2ab9ab43
I20260806 09:20:11.140098 32432 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:20:11.158612 32432 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:20:11.160231 32432 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:20:11.175211 32432 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8fbdd86e685f43648fc1690e3254a6bc: Generated new TSK 0
I20260806 09:20:11.176419 32432 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:20:11.194186 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 32344
I20260806 09:20:11.195899 32407 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:20:11.294567 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 32344
2026-08-06T09:20:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2169 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:20:11 dist-test-slave-mvvj krb5kdc[32444](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:20:11 dist-test-slave-mvvj krb5kdc[32444](info): set up 2 sockets
Aug 06 09:20:11 dist-test-slave-mvvj krb5kdc[32444](info): commencing operation
krb5kdc: starting...
W20260806 09:20:12.435314 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.000s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:20:12 dist-test-slave-mvvj krb5kdc[32444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008012, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:20:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:20:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 09:20:12.741210 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43891
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43891
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:20:13.106344 32457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:13.106688 32457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:13.106784 32457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:13.114434 32457 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:13.114569 32457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:13.114619 32457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:13.114682 32457 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:13.114727 32457 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:13.125116 32457 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43891
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43891
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:13.126540 32457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:13.127894 32457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:13.140620 32465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:13.140620 32463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:13.140662 32462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:13.142231 32457 server_base.cc:1034] running on GCE node
I20260806 09:20:13.143213 32457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:13.144923 32457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:13.146155 32457 hybrid_clock.cc:648] HybridClock initialized: now 1786008013146109 us; error 36 us; skew 500 ppm
I20260806 09:20:13.146551 32457 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:20:13 dist-test-slave-mvvj krb5kdc[32444](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008013, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:20:13.158602 32457 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 09:20:13.160593 32457 webserver.cc:460] Webserver started at http://127.0.0.1:44201/ using document root <none> and password file <none>
I20260806 09:20:13.161417 32457 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:13.161540 32457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:13.161813 32457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:13.165081 32457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "30b0c31a2d6548509749ff00b0fc4cba"
format_stamp: "Formatted at 2026-08-06 09:20:13 on dist-test-slave-mvvj"
server_key: "e0ec35a3b92ac84ab2e63c4ab4b7bce2"
server_key_iv: "481e9d46134a45565663d5a261365d72"
server_key_version: "encryptionkey@0"
I20260806 09:20:13.165833 32457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "30b0c31a2d6548509749ff00b0fc4cba"
format_stamp: "Formatted at 2026-08-06 09:20:13 on dist-test-slave-mvvj"
server_key: "e0ec35a3b92ac84ab2e63c4ab4b7bce2"
server_key_iv: "481e9d46134a45565663d5a261365d72"
server_key_version: "encryptionkey@0"
I20260806 09:20:13.171366 32457 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260806 09:20:13.175202 32472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:13.176802 32457 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 09:20:13.177019 32457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "30b0c31a2d6548509749ff00b0fc4cba"
format_stamp: "Formatted at 2026-08-06 09:20:13 on dist-test-slave-mvvj"
server_key: "e0ec35a3b92ac84ab2e63c4ab4b7bce2"
server_key_iv: "481e9d46134a45565663d5a261365d72"
server_key_version: "encryptionkey@0"
I20260806 09:20:13.177253 32457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:13.206574 32457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:13.211580 32457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:13.212001 32457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:13.232538 32457 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43891
I20260806 09:20:13.232542 32523 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43891 every 8 connection(s)
I20260806 09:20:13.234151 32457 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:20:13.238003 32524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:20:13.242894 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 32457
I20260806 09:20:13.243109 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:20:13.243579 11261 external_mini_cluster.cc:1428] Setting key cac61f899300e26098cc16609e9d96c8
I20260806 09:20:13.250032 32524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30b0c31a2d6548509749ff00b0fc4cba: Bootstrap starting.
I20260806 09:20:13.254136 32524 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 30b0c31a2d6548509749ff00b0fc4cba: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:13.255538 32524 log.cc:824] T 00000000000000000000000000000000 P 30b0c31a2d6548509749ff00b0fc4cba: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:13.258671 32527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:13.245794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47361 (local address 127.0.0.1:43891)
0806 09:20:13.246706 (+ 912us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:13.246719 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:13.246774 (+ 55us) server_negotiation.cc:407] Connection header received
0806 09:20:13.248718 (+ 1944us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:13.248746 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:13.249203 (+ 457us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:13.249597 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:13.250346 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:13.251956 (+ 1610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:13.253900 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:13.254730 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:13.254870 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:13.256273 (+ 1403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:13.256284 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:13.256300 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:13.256884 (+ 584us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:13.256990 (+ 106us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:13.257016 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:13.257194 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:13.257426 (+ 232us) server_negotiation.cc:299] Negotiation successful
0806 09:20:13.257711 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":677,"thread_start_us":431,"threads_started":1}
I20260806 09:20:13.258805 32524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30b0c31a2d6548509749ff00b0fc4cba: No bootstrap required, opened a new log
I20260806 09:20:13.262707 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:20:13.267400 32524 raft_consensus.cc:348] T 00000000000000000000000000000000 P 30b0c31a2d6548509749ff00b0fc4cba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30b0c31a2d6548509749ff00b0fc4cba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43891 } }
I20260806 09:20:13.268054 32524 raft_consensus.cc:374] T 00000000000000000000000000000000 P 30b0c31a2d6548509749ff00b0fc4cba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:20:13.268206 32524 raft_consensus.cc:729] T 00000000000000000000000000000000 P 30b0c31a2d6548509749ff00b0fc4cba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b0c31a2d6548509749ff00b0fc4cba, State: Initialized, Role: FOLLOWER
I20260806 09:20:13.268939 32524 consensus_queue.cc:260] T 00000000000000000000000000000000 P 30b0c31a2d6548509749ff00b0fc4cba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30b0c31a2d6548509749ff00b0fc4cba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43891 } }
I20260806 09:20:13.269304 32524 raft_consensus.cc:388] T 00000000000000000000000000000000 P 30b0c31a2d6548509749ff00b0fc4cba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:20:13.269465 32524 raft_consensus.cc:482] T 00000000000000000000000000000000 P 30b0c31a2d6548509749ff00b0fc4cba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:20:13.269672 32524 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 30b0c31a2d6548509749ff00b0fc4cba [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:13.273078 32524 raft_consensus.cc:504] T 00000000000000000000000000000000 P 30b0c31a2d6548509749ff00b0fc4cba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30b0c31a2d6548509749ff00b0fc4cba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43891 } }
I20260806 09:20:13.273836 32524 leader_election.cc:302] T 00000000000000000000000000000000 P 30b0c31a2d6548509749ff00b0fc4cba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 30b0c31a2d6548509749ff00b0fc4cba; no voters:
I20260806 09:20:13.274605 32524 leader_election.cc:288] T 00000000000000000000000000000000 P 30b0c31a2d6548509749ff00b0fc4cba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:20:13.274744 32534 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 30b0c31a2d6548509749ff00b0fc4cba [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:20:13.275178 32527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:13.267481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48687 (local address 127.0.0.1:43891)
0806 09:20:13.267694 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:13.267701 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:13.268168 (+ 467us) server_negotiation.cc:407] Connection header received
0806 09:20:13.268401 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:13.268405 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:13.268480 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:13.268613 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:13.269284 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:13.270209 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:13.272196 (+ 1987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:13.272654 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:13.272755 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:13.274175 (+ 1420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:13.274180 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:13.274183 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:13.274202 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:13.274245 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:13.274261 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:13.274390 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:13.274589 (+ 199us) server_negotiation.cc:299] Negotiation successful
0806 09:20:13.274698 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260806 09:20:13.276414 32534 raft_consensus.cc:686] T 00000000000000000000000000000000 P 30b0c31a2d6548509749ff00b0fc4cba [term 1 LEADER]: Becoming Leader. State: Replica: 30b0c31a2d6548509749ff00b0fc4cba, State: Running, Role: LEADER
I20260806 09:20:13.277222 32524 sys_catalog.cc:564] T 00000000000000000000000000000000 P 30b0c31a2d6548509749ff00b0fc4cba [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:20:13.277179 32534 consensus_queue.cc:237] T 00000000000000000000000000000000 P 30b0c31a2d6548509749ff00b0fc4cba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30b0c31a2d6548509749ff00b0fc4cba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43891 } }
I20260806 09:20:13.280463 32536 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30b0c31a2d6548509749ff00b0fc4cba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 30b0c31a2d6548509749ff00b0fc4cba. Latest consensus state: current_term: 1 leader_uuid: "30b0c31a2d6548509749ff00b0fc4cba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30b0c31a2d6548509749ff00b0fc4cba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43891 } } }
I20260806 09:20:13.280937 32536 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30b0c31a2d6548509749ff00b0fc4cba [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:13.281481 32535 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30b0c31a2d6548509749ff00b0fc4cba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "30b0c31a2d6548509749ff00b0fc4cba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30b0c31a2d6548509749ff00b0fc4cba" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43891 } } }
I20260806 09:20:13.281857 32535 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30b0c31a2d6548509749ff00b0fc4cba [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:13.288496 32543 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:20:13.293926 32543 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:20:13.303416 32543 catalog_manager.cc:1347] Generated new cluster ID: bd84f27179cc4db4bd451178e000c9a3
I20260806 09:20:13.303568 32543 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:20:13.328917 32543 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:20:13.331079 32543 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:20:13.347100 32543 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 30b0c31a2d6548509749ff00b0fc4cba: Generated new TSK 0
I20260806 09:20:13.348160 32543 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:20:13.364277 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 32457
W20260806 09:20:13.365694 32519 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:47361
W20260806 09:20:13.366534 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 32457: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 09:20:13.366698 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 32457
2026-08-06T09:20:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2071 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:20:13 dist-test-slave-mvvj krb5kdc[32555](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:20:13 dist-test-slave-mvvj krb5kdc[32555](info): set up 2 sockets
Aug 06 09:20:13 dist-test-slave-mvvj krb5kdc[32555](info): commencing operation
krb5kdc: starting...
W20260806 09:20:14.514933 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.110s user 0.006s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:20:14 dist-test-slave-mvvj krb5kdc[32555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008014, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:20:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:20:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 09:20:14.812518 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46011
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46011
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:20:15.173985 32568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:15.174319 32568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:15.174494 32568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:15.182330 32568 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:15.182471 32568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:15.182523 32568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:15.182673 32568 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:15.182765 32568 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:15.194047 32568 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46011
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:15.195534 32568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:15.197031 32568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:15.210920 32573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:15.211084 32574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:15.211136 32576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:15.211983 32568 server_base.cc:1034] running on GCE node
I20260806 09:20:15.213165 32568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:15.214926 32568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:15.216264 32568 hybrid_clock.cc:648] HybridClock initialized: now 1786008015216204 us; error 83 us; skew 500 ppm
I20260806 09:20:15.216735 32568 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:20:15 dist-test-slave-mvvj krb5kdc[32555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008015, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:20:15.220860 32568 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 09:20:15.222766 32568 webserver.cc:460] Webserver started at http://127.0.0.1:42497/ using document root <none> and password file <none>
I20260806 09:20:15.223616 32568 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:15.223795 32568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:15.224184 32568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:15.227619 32568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "2b8de6d8968f4b89918237a3e5d0ebbd"
format_stamp: "Formatted at 2026-08-06 09:20:15 on dist-test-slave-mvvj"
server_key: "ef5468f8df1718b560e2f244443c2450"
server_key_iv: "62692894954400a25ecc32d5db3a177e"
server_key_version: "encryptionkey@0"
I20260806 09:20:15.228708 32568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "2b8de6d8968f4b89918237a3e5d0ebbd"
format_stamp: "Formatted at 2026-08-06 09:20:15 on dist-test-slave-mvvj"
server_key: "ef5468f8df1718b560e2f244443c2450"
server_key_iv: "62692894954400a25ecc32d5db3a177e"
server_key_version: "encryptionkey@0"
I20260806 09:20:15.234958 32568 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 09:20:15.239152 32583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:15.240834 32568 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 09:20:15.241061 32568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "2b8de6d8968f4b89918237a3e5d0ebbd"
format_stamp: "Formatted at 2026-08-06 09:20:15 on dist-test-slave-mvvj"
server_key: "ef5468f8df1718b560e2f244443c2450"
server_key_iv: "62692894954400a25ecc32d5db3a177e"
server_key_version: "encryptionkey@0"
I20260806 09:20:15.241318 32568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:15.248284 32568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:15.253726 32568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:15.254091 32568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:15.274806 32568 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46011
I20260806 09:20:15.274858 32634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46011 every 8 connection(s)
I20260806 09:20:15.276427 32568 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:20:15.281098 32635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:20:15.284257 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 32568
I20260806 09:20:15.284471 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:20:15.284979 11261 external_mini_cluster.cc:1428] Setting key c57e42d2f53d329f4ac8d86e6e160e7a
I20260806 09:20:15.295291 32638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:15.287274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60297 (local address 127.0.0.1:46011)
0806 09:20:15.288251 (+ 977us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:15.288268 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:15.288322 (+ 54us) server_negotiation.cc:407] Connection header received
0806 09:20:15.290807 (+ 2485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:15.290841 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:15.291341 (+ 500us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:15.291896 (+ 555us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:15.293137 (+ 1241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:15.293147 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:15.293166 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:15.293187 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:15.293278 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:15.293306 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:15.293581 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:15.293730 (+ 149us) server_negotiation.cc:299] Negotiation successful
0806 09:20:15.293953 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":716,"thread_start_us":384,"threads_started":1}
I20260806 09:20:15.296245 32635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b8de6d8968f4b89918237a3e5d0ebbd: Bootstrap starting.
I20260806 09:20:15.299654 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:20:15.300015 32635 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b8de6d8968f4b89918237a3e5d0ebbd: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:15.301111 32635 log.cc:824] T 00000000000000000000000000000000 P 2b8de6d8968f4b89918237a3e5d0ebbd: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:15.304665 32635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b8de6d8968f4b89918237a3e5d0ebbd: No bootstrap required, opened a new log
I20260806 09:20:15.307794 32638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:15.304896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37639 (local address 127.0.0.1:46011)
0806 09:20:15.305127 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:15.305138 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:15.305665 (+ 527us) server_negotiation.cc:407] Connection header received
0806 09:20:15.305839 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:15.305843 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:15.305899 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:15.305991 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:15.307033 (+ 1042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:15.307038 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:15.307042 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:15.307065 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:15.307115 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:15.307132 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:15.307239 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:15.307366 (+ 127us) server_negotiation.cc:299] Negotiation successful
0806 09:20:15.307421 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260806 09:20:15.313764 32635 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b8de6d8968f4b89918237a3e5d0ebbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8de6d8968f4b89918237a3e5d0ebbd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46011 } }
I20260806 09:20:15.314218 32635 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2b8de6d8968f4b89918237a3e5d0ebbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:20:15.314292 32635 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b8de6d8968f4b89918237a3e5d0ebbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b8de6d8968f4b89918237a3e5d0ebbd, State: Initialized, Role: FOLLOWER
I20260806 09:20:15.314926 32635 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b8de6d8968f4b89918237a3e5d0ebbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8de6d8968f4b89918237a3e5d0ebbd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46011 } }
I20260806 09:20:15.315224 32635 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2b8de6d8968f4b89918237a3e5d0ebbd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:20:15.315393 32635 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b8de6d8968f4b89918237a3e5d0ebbd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:20:15.315598 32635 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b8de6d8968f4b89918237a3e5d0ebbd [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:15.318264 32635 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b8de6d8968f4b89918237a3e5d0ebbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8de6d8968f4b89918237a3e5d0ebbd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46011 } }
I20260806 09:20:15.318861 32635 leader_election.cc:302] T 00000000000000000000000000000000 P 2b8de6d8968f4b89918237a3e5d0ebbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2b8de6d8968f4b89918237a3e5d0ebbd; no voters:
I20260806 09:20:15.319550 32635 leader_election.cc:288] T 00000000000000000000000000000000 P 2b8de6d8968f4b89918237a3e5d0ebbd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:20:15.319721 32645 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2b8de6d8968f4b89918237a3e5d0ebbd [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:20:15.320516 32645 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2b8de6d8968f4b89918237a3e5d0ebbd [term 1 LEADER]: Becoming Leader. State: Replica: 2b8de6d8968f4b89918237a3e5d0ebbd, State: Running, Role: LEADER
I20260806 09:20:15.321218 32645 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b8de6d8968f4b89918237a3e5d0ebbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8de6d8968f4b89918237a3e5d0ebbd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46011 } }
I20260806 09:20:15.322093 32635 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b8de6d8968f4b89918237a3e5d0ebbd [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:20:15.325505 32647 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b8de6d8968f4b89918237a3e5d0ebbd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b8de6d8968f4b89918237a3e5d0ebbd. Latest consensus state: current_term: 1 leader_uuid: "2b8de6d8968f4b89918237a3e5d0ebbd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8de6d8968f4b89918237a3e5d0ebbd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46011 } } }
I20260806 09:20:15.326332 32647 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b8de6d8968f4b89918237a3e5d0ebbd [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:15.325564 32646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b8de6d8968f4b89918237a3e5d0ebbd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2b8de6d8968f4b89918237a3e5d0ebbd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b8de6d8968f4b89918237a3e5d0ebbd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46011 } } }
I20260806 09:20:15.328094 32646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b8de6d8968f4b89918237a3e5d0ebbd [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:15.330363 32654 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:20:15.336192 32654 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:20:15.347530 32654 catalog_manager.cc:1347] Generated new cluster ID: 73b409af8a9a4d3e88059c10bb48248e
I20260806 09:20:15.347669 32654 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:20:15.372641 32654 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:20:15.373183 32654 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:20:15.388512 32654 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2b8de6d8968f4b89918237a3e5d0ebbd: Generated new TSK 0
I20260806 09:20:15.389518 32654 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:20:15.396987 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 32568
W20260806 09:20:15.398693 32630 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:60297
W20260806 09:20:15.399572 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 32568: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 09:20:15.399739 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 32568
2026-08-06T09:20:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2035 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:20:15 dist-test-slave-mvvj krb5kdc[32666](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:20:15 dist-test-slave-mvvj krb5kdc[32666](info): set up 2 sockets
Aug 06 09:20:15 dist-test-slave-mvvj krb5kdc[32666](info): commencing operation
krb5kdc: starting...
W20260806 09:20:16.551303 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.110s user 0.000s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:20:16 dist-test-slave-mvvj krb5kdc[32666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:20:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:20:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 09:20:16.852620 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35493
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35493
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:20:17.212882 32679 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:17.213207 32679 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:17.213379 32679 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:17.221050 32679 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:17.221199 32679 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:17.221298 32679 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:17.221414 32679 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:17.221478 32679 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:17.232103 32679 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35493
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:17.233520 32679 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:17.234902 32679 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:17.248100 32685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:17.248158 32687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:17.248217 32684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:17.249840 32679 server_base.cc:1034] running on GCE node
I20260806 09:20:17.250783 32679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:17.252646 32679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:17.253933 32679 hybrid_clock.cc:648] HybridClock initialized: now 1786008017253880 us; error 56 us; skew 500 ppm
I20260806 09:20:17.254349 32679 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:20:17 dist-test-slave-mvvj krb5kdc[32666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008017, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:20:17.257892 32679 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 09:20:17.259621 32679 webserver.cc:460] Webserver started at http://127.0.0.1:35113/ using document root <none> and password file <none>
I20260806 09:20:17.260476 32679 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:17.260615 32679 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:17.260897 32679 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:17.264302 32679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "44c55f2b37564ef397b39aab82470a48"
format_stamp: "Formatted at 2026-08-06 09:20:17 on dist-test-slave-mvvj"
server_key: "54593e207e96cfe9467ccd0b7cafb407"
server_key_iv: "75146e426db54bedc92f276aae23b946"
server_key_version: "encryptionkey@0"
I20260806 09:20:17.265208 32679 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "44c55f2b37564ef397b39aab82470a48"
format_stamp: "Formatted at 2026-08-06 09:20:17 on dist-test-slave-mvvj"
server_key: "54593e207e96cfe9467ccd0b7cafb407"
server_key_iv: "75146e426db54bedc92f276aae23b946"
server_key_version: "encryptionkey@0"
I20260806 09:20:17.271098 32679 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260806 09:20:17.275364 32694 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:17.277125 32679 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:20:17.277354 32679 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "44c55f2b37564ef397b39aab82470a48"
format_stamp: "Formatted at 2026-08-06 09:20:17 on dist-test-slave-mvvj"
server_key: "54593e207e96cfe9467ccd0b7cafb407"
server_key_iv: "75146e426db54bedc92f276aae23b946"
server_key_version: "encryptionkey@0"
I20260806 09:20:17.277591 32679 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:17.314248 32679 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:17.319195 32679 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:17.319674 32679 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:17.340739 32679 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35493
I20260806 09:20:17.340786 32745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35493 every 8 connection(s)
I20260806 09:20:17.342278 32679 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:20:17.343295 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 32679
I20260806 09:20:17.343607 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:20:17.344170 11261 external_mini_cluster.cc:1428] Setting key 7e73140a54bce5c36c56e72156859e2d
I20260806 09:20:17.347301 32746 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 09:20:17 dist-test-slave-mvvj krb5kdc[32666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 09:20:17.361977 32746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44c55f2b37564ef397b39aab82470a48: Bootstrap starting.
I20260806 09:20:17.366665 32746 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44c55f2b37564ef397b39aab82470a48: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:17.368204 32746 log.cc:824] T 00000000000000000000000000000000 P 44c55f2b37564ef397b39aab82470a48: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:17.372337 32746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44c55f2b37564ef397b39aab82470a48: No bootstrap required, opened a new log
I20260806 09:20:17.373080 32749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:17.346222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.215:34927 (local address 127.0.0.1:35493)
0806 09:20:17.347091 (+ 869us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:17.347107 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:17.347160 (+ 53us) server_negotiation.cc:407] Connection header received
0806 09:20:17.349623 (+ 2463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:17.349654 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:17.350212 (+ 558us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:17.350718 (+ 506us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:17.352430 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:17.354670 (+ 2240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:17.356338 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:17.357470 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:17.357696 (+ 226us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:17.362790 (+ 5094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:17.362803 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:17.362824 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:17.362880 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:17.367432 (+ 4552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:17.368662 (+ 1230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:17.368672 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:17.368681 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:17.368962 (+ 281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:17.369617 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:17.369621 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:17.369623 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:17.370366 (+ 743us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:17.370721 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:17.371188 (+ 467us) server_negotiation.cc:299] Negotiation successful
0806 09:20:17.371600 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":341,"threads_started":1}
I20260806 09:20:17.377875 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:20:17.382062 32746 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44c55f2b37564ef397b39aab82470a48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44c55f2b37564ef397b39aab82470a48" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35493 } }
I20260806 09:20:17.382629 32746 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44c55f2b37564ef397b39aab82470a48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:20:17.382754 32746 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44c55f2b37564ef397b39aab82470a48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44c55f2b37564ef397b39aab82470a48, State: Initialized, Role: FOLLOWER
I20260806 09:20:17.383505 32746 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44c55f2b37564ef397b39aab82470a48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44c55f2b37564ef397b39aab82470a48" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35493 } }
I20260806 09:20:17.383906 32746 raft_consensus.cc:388] T 00000000000000000000000000000000 P 44c55f2b37564ef397b39aab82470a48 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:20:17.384096 32746 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44c55f2b37564ef397b39aab82470a48 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:20:17.384302 32746 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44c55f2b37564ef397b39aab82470a48 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:17.387295 32746 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44c55f2b37564ef397b39aab82470a48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44c55f2b37564ef397b39aab82470a48" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35493 } }
I20260806 09:20:17.388049 32746 leader_election.cc:302] T 00000000000000000000000000000000 P 44c55f2b37564ef397b39aab82470a48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44c55f2b37564ef397b39aab82470a48; no voters:
I20260806 09:20:17.388787 32746 leader_election.cc:288] T 00000000000000000000000000000000 P 44c55f2b37564ef397b39aab82470a48 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:20:17.388953 32756 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44c55f2b37564ef397b39aab82470a48 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:20:17.391144 32756 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44c55f2b37564ef397b39aab82470a48 [term 1 LEADER]: Becoming Leader. State: Replica: 44c55f2b37564ef397b39aab82470a48, State: Running, Role: LEADER
I20260806 09:20:17.391691 32746 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44c55f2b37564ef397b39aab82470a48 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:20:17.391774 32756 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44c55f2b37564ef397b39aab82470a48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44c55f2b37564ef397b39aab82470a48" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35493 } }
I20260806 09:20:17.395080 32758 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44c55f2b37564ef397b39aab82470a48 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44c55f2b37564ef397b39aab82470a48. Latest consensus state: current_term: 1 leader_uuid: "44c55f2b37564ef397b39aab82470a48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44c55f2b37564ef397b39aab82470a48" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35493 } } }
I20260806 09:20:17.395666 32758 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44c55f2b37564ef397b39aab82470a48 [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:17.394913 32757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44c55f2b37564ef397b39aab82470a48 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44c55f2b37564ef397b39aab82470a48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44c55f2b37564ef397b39aab82470a48" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35493 } } }
I20260806 09:20:17.395987 32757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44c55f2b37564ef397b39aab82470a48 [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:17.397262 32761 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:20:17.405722 32749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:17.382630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.215:36037 (local address 127.0.0.1:35493)
0806 09:20:17.382859 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:17.382866 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:17.383443 (+ 577us) server_negotiation.cc:407] Connection header received
0806 09:20:17.383608 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:17.383615 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:17.383706 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:17.383873 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:17.385507 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:17.386695 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:17.388350 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:17.389264 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:17.390174 (+ 910us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:17.393865 (+ 3691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:17.393872 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:17.393877 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:17.393940 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:17.399236 (+ 5296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:17.400861 (+ 1625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:17.400871 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:17.400877 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:17.401173 (+ 296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:17.402026 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:17.402034 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:17.402040 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:17.402585 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:17.403002 (+ 417us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:17.404776 (+ 1774us) server_negotiation.cc:299] Negotiation successful
0806 09:20:17.405109 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 09:20:17.415702 32761 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:20:17.426967 32761 catalog_manager.cc:1347] Generated new cluster ID: f338540fa3e4495da9adfc57bd70e25f
I20260806 09:20:17.427126 32761 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:20:17.445950 32761 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:20:17.447518 32761 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:20:17.461656 32761 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44c55f2b37564ef397b39aab82470a48: Generated new TSK 0
I20260806 09:20:17.462993 32761 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:20:17.482793 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 32679
I20260806 09:20:17.485010 32741 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:20:17.583534 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 32679
W20260806 09:20:17.602227 32664 connection.cc:535] client connection to 127.0.0.1:35493 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35493): Connection reset by peer (error 104)
2026-08-06T09:20:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2181 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:20:17 dist-test-slave-mvvj krb5kdc[310](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:20:17 dist-test-slave-mvvj krb5kdc[310](info): set up 2 sockets
Aug 06 09:20:17 dist-test-slave-mvvj krb5kdc[310](info): commencing operation
krb5kdc: starting...
W20260806 09:20:18.747331 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.000s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:20:18 dist-test-slave-mvvj krb5kdc[310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:20:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:20:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 09:20:19.076889 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40685
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42345
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40685
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:20:19.572849 323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:19.573395 323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:19.573640 323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:19.581287 323 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:19.581421 323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:19.581522 323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:19.581619 323 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:19.581732 323 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:19.592357 323 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42345
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40685
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40685
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:19.593859 323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:19.595321 323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:19.608783 328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:19.608814 331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:19.609443 329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:19.609752 323 server_base.cc:1034] running on GCE node
I20260806 09:20:19.610845 323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:19.612708 323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:19.613930 323 hybrid_clock.cc:648] HybridClock initialized: now 1786008019613874 us; error 47 us; skew 500 ppm
I20260806 09:20:19.614368 323 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:20:19 dist-test-slave-mvvj krb5kdc[310](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008019, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:20:19.623334 323 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 09:20:19.625487 323 webserver.cc:460] Webserver started at http://127.0.0.1:42991/ using document root <none> and password file <none>
I20260806 09:20:19.626307 323 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:19.626446 323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:19.626750 323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:19.630744 323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "ae04d3d5bd0f43849b6e3f718c7e98e0"
format_stamp: "Formatted at 2026-08-06 09:20:19 on dist-test-slave-mvvj"
server_key: "929f9168dd0d928a264b27d474c33c66"
server_key_iv: "711bcd1cb08faaeee3be62425d9d0cd3"
server_key_version: "encryptionkey@0"
I20260806 09:20:19.631732 323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "ae04d3d5bd0f43849b6e3f718c7e98e0"
format_stamp: "Formatted at 2026-08-06 09:20:19 on dist-test-slave-mvvj"
server_key: "929f9168dd0d928a264b27d474c33c66"
server_key_iv: "711bcd1cb08faaeee3be62425d9d0cd3"
server_key_version: "encryptionkey@0"
I20260806 09:20:19.638537 323 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 09:20:19.642940 339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:19.644658 323 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260806 09:20:19.644886 323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "ae04d3d5bd0f43849b6e3f718c7e98e0"
format_stamp: "Formatted at 2026-08-06 09:20:19 on dist-test-slave-mvvj"
server_key: "929f9168dd0d928a264b27d474c33c66"
server_key_iv: "711bcd1cb08faaeee3be62425d9d0cd3"
server_key_version: "encryptionkey@0"
I20260806 09:20:19.645131 323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:19.664491 323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:19.669334 323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:19.669683 323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:19.692448 323 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40685
I20260806 09:20:19.692482 390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40685 every 8 connection(s)
I20260806 09:20:19.693976 323 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:20:19.698376 391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:20:19.704329 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 323
I20260806 09:20:19.704541 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:20:19.705209 11261 external_mini_cluster.cc:1428] Setting key b8b5bb42f727b8a00c610dfe5ee9164c
I20260806 09:20:19.711819 391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae04d3d5bd0f43849b6e3f718c7e98e0: Bootstrap starting.
I20260806 09:20:19.715718 391 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ae04d3d5bd0f43849b6e3f718c7e98e0: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:19.717031 391 log.cc:824] T 00000000000000000000000000000000 P ae04d3d5bd0f43849b6e3f718c7e98e0: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:19.721872 391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae04d3d5bd0f43849b6e3f718c7e98e0: No bootstrap required, opened a new log
I20260806 09:20:19.722198 394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:19.707553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.215:41181 (local address 127.0.0.1:40685)
0806 09:20:19.708538 (+ 985us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:19.708552 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:19.708600 (+ 48us) server_negotiation.cc:407] Connection header received
0806 09:20:19.710652 (+ 2052us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:19.710680 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:19.711193 (+ 513us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:19.711661 (+ 468us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:19.712501 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:19.714118 (+ 1617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:19.715792 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:19.716703 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:19.716945 (+ 242us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:19.718712 (+ 1767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:19.718721 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:19.718750 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:19.719574 (+ 824us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:19.719710 (+ 136us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:19.719751 (+ 41us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:19.719985 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:19.720379 (+ 394us) server_negotiation.cc:299] Negotiation successful
0806 09:20:19.720591 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":738,"thread_start_us":474,"threads_started":1}
I20260806 09:20:19.727123 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:20:19.734542 391 raft_consensus.cc:348] T 00000000000000000000000000000000 P ae04d3d5bd0f43849b6e3f718c7e98e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae04d3d5bd0f43849b6e3f718c7e98e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40685 } }
I20260806 09:20:19.735178 391 raft_consensus.cc:374] T 00000000000000000000000000000000 P ae04d3d5bd0f43849b6e3f718c7e98e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:20:19.735357 391 raft_consensus.cc:729] T 00000000000000000000000000000000 P ae04d3d5bd0f43849b6e3f718c7e98e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae04d3d5bd0f43849b6e3f718c7e98e0, State: Initialized, Role: FOLLOWER
I20260806 09:20:19.736198 391 consensus_queue.cc:260] T 00000000000000000000000000000000 P ae04d3d5bd0f43849b6e3f718c7e98e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae04d3d5bd0f43849b6e3f718c7e98e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40685 } }
I20260806 09:20:19.736728 391 raft_consensus.cc:388] T 00000000000000000000000000000000 P ae04d3d5bd0f43849b6e3f718c7e98e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:20:19.736922 391 raft_consensus.cc:482] T 00000000000000000000000000000000 P ae04d3d5bd0f43849b6e3f718c7e98e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:20:19.737149 391 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ae04d3d5bd0f43849b6e3f718c7e98e0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:19.740721 391 raft_consensus.cc:504] T 00000000000000000000000000000000 P ae04d3d5bd0f43849b6e3f718c7e98e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae04d3d5bd0f43849b6e3f718c7e98e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40685 } }
I20260806 09:20:19.741466 391 leader_election.cc:302] T 00000000000000000000000000000000 P ae04d3d5bd0f43849b6e3f718c7e98e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ae04d3d5bd0f43849b6e3f718c7e98e0; no voters:
I20260806 09:20:19.742233 391 leader_election.cc:288] T 00000000000000000000000000000000 P ae04d3d5bd0f43849b6e3f718c7e98e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:20:19.742403 401 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ae04d3d5bd0f43849b6e3f718c7e98e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:20:19.743218 401 raft_consensus.cc:686] T 00000000000000000000000000000000 P ae04d3d5bd0f43849b6e3f718c7e98e0 [term 1 LEADER]: Becoming Leader. State: Replica: ae04d3d5bd0f43849b6e3f718c7e98e0, State: Running, Role: LEADER
I20260806 09:20:19.744091 401 consensus_queue.cc:237] T 00000000000000000000000000000000 P ae04d3d5bd0f43849b6e3f718c7e98e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae04d3d5bd0f43849b6e3f718c7e98e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40685 } }
I20260806 09:20:19.744753 394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:19.733999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.215:50613 (local address 127.0.0.1:40685)
0806 09:20:19.734285 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:19.734293 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:19.734680 (+ 387us) server_negotiation.cc:407] Connection header received
0806 09:20:19.734930 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:19.734935 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:19.735017 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:19.735183 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:19.736190 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:19.737755 (+ 1565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:19.740072 (+ 2317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:19.740667 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:19.740848 (+ 181us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:19.742595 (+ 1747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:19.742604 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:19.742611 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:19.742645 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:19.742732 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:19.742766 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:19.742932 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:19.743911 (+ 979us) server_negotiation.cc:299] Negotiation successful
0806 09:20:19.744004 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260806 09:20:19.746636 391 sys_catalog.cc:564] T 00000000000000000000000000000000 P ae04d3d5bd0f43849b6e3f718c7e98e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:20:19.747819 402 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae04d3d5bd0f43849b6e3f718c7e98e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ae04d3d5bd0f43849b6e3f718c7e98e0. Latest consensus state: current_term: 1 leader_uuid: "ae04d3d5bd0f43849b6e3f718c7e98e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae04d3d5bd0f43849b6e3f718c7e98e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40685 } } }
I20260806 09:20:19.748443 402 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae04d3d5bd0f43849b6e3f718c7e98e0 [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:19.748222 403 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae04d3d5bd0f43849b6e3f718c7e98e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ae04d3d5bd0f43849b6e3f718c7e98e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae04d3d5bd0f43849b6e3f718c7e98e0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40685 } } }
I20260806 09:20:19.748768 403 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae04d3d5bd0f43849b6e3f718c7e98e0 [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:19.751672 406 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:20:19.761925 406 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:20:19.772764 406 catalog_manager.cc:1347] Generated new cluster ID: a2ab95257f964953845f34cdb7a4ce40
I20260806 09:20:19.772912 406 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:20:19.794787 406 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:20:19.796974 406 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:20:19.807565 406 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ae04d3d5bd0f43849b6e3f718c7e98e0: Generated new TSK 0
I20260806 09:20:19.808990 406 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:20:19.824893 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 323
W20260806 09:20:19.826236 386 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.215:41181
W20260806 09:20:19.827194 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 323: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 09:20:19.827382 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 323
W20260806 09:20:19.846287 308 connection.cc:535] client connection to 127.0.0.1:40685 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40685): Connection reset by peer (error 104)
2026-08-06T09:20:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2245 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:20:19 dist-test-slave-mvvj krb5kdc[422](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:20:19 dist-test-slave-mvvj krb5kdc[422](info): set up 2 sockets
Aug 06 09:20:19 dist-test-slave-mvvj krb5kdc[422](info): commencing operation
krb5kdc: starting...
W20260806 09:20:21.006608 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.139s user 0.003s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:20:21 dist-test-slave-mvvj krb5kdc[422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008021, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:20:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:20:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 09:20:21.313411 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42935
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41035
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42935
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:20:21.688784 435 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:21.689215 435 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:21.689396 435 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:21.698534 435 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:21.698742 435 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:21.698879 435 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:21.699005 435 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:21.699100 435 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:21.710292 435 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41035
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42935
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42935
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:21.711885 435 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:21.713475 435 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:21.729305 440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:21.729280 441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:21.729334 443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:21.730885 435 server_base.cc:1034] running on GCE node
I20260806 09:20:21.731966 435 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:21.733742 435 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:21.735014 435 hybrid_clock.cc:648] HybridClock initialized: now 1786008021734952 us; error 42 us; skew 500 ppm
I20260806 09:20:21.735525 435 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:20:21 dist-test-slave-mvvj krb5kdc[422](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008021, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:20:21.739535 435 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 09:20:21.741422 435 webserver.cc:460] Webserver started at http://127.0.0.1:40311/ using document root <none> and password file <none>
I20260806 09:20:21.742165 435 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:21.742275 435 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:21.742651 435 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:21.746512 435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "baf9512328004291a2e61a00ac78f073"
format_stamp: "Formatted at 2026-08-06 09:20:21 on dist-test-slave-mvvj"
server_key: "3be5a76f972ef2b032f32c0194ea71b9"
server_key_iv: "9e1d4759ea64896c0d297f7207479c62"
server_key_version: "encryptionkey@0"
I20260806 09:20:21.747629 435 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "baf9512328004291a2e61a00ac78f073"
format_stamp: "Formatted at 2026-08-06 09:20:21 on dist-test-slave-mvvj"
server_key: "3be5a76f972ef2b032f32c0194ea71b9"
server_key_iv: "9e1d4759ea64896c0d297f7207479c62"
server_key_version: "encryptionkey@0"
I20260806 09:20:21.754563 435 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 09:20:21.758649 450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:21.760224 435 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260806 09:20:21.760432 435 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "baf9512328004291a2e61a00ac78f073"
format_stamp: "Formatted at 2026-08-06 09:20:21 on dist-test-slave-mvvj"
server_key: "3be5a76f972ef2b032f32c0194ea71b9"
server_key_iv: "9e1d4759ea64896c0d297f7207479c62"
server_key_version: "encryptionkey@0"
I20260806 09:20:21.760679 435 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:21.767059 435 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:21.772039 435 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:21.772372 435 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:21.793576 435 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42935
I20260806 09:20:21.793680 501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42935 every 8 connection(s)
I20260806 09:20:21.795197 435 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:20:21.799360 502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:20:21.805022 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 435
I20260806 09:20:21.805264 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:20:21.805835 11261 external_mini_cluster.cc:1428] Setting key 11cf8d45bd04d89a18d9062bbec05b93
I20260806 09:20:21.811689 502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P baf9512328004291a2e61a00ac78f073: Bootstrap starting.
I20260806 09:20:21.815191 505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:21.807956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.215:47705 (local address 127.0.0.1:42935)
0806 09:20:21.809020 (+ 1064us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:21.809033 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:21.809088 (+ 55us) server_negotiation.cc:407] Connection header received
0806 09:20:21.811095 (+ 2007us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:21.811123 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:21.811547 (+ 424us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:21.812091 (+ 544us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:21.813316 (+ 1225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:21.813323 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:21.813337 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:21.813356 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:21.813422 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:21.813449 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:21.813726 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:21.813897 (+ 171us) server_negotiation.cc:299] Negotiation successful
0806 09:20:21.814121 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":784,"thread_start_us":502,"threads_started":1}
I20260806 09:20:21.815574 502 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P baf9512328004291a2e61a00ac78f073: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:21.816802 502 log.cc:824] T 00000000000000000000000000000000 P baf9512328004291a2e61a00ac78f073: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:21.819576 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:20:21.820351 502 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P baf9512328004291a2e61a00ac78f073: No bootstrap required, opened a new log
I20260806 09:20:21.827486 505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:21.824443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.215:38611 (local address 127.0.0.1:42935)
0806 09:20:21.824691 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:21.824702 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:21.825255 (+ 553us) server_negotiation.cc:407] Connection header received
0806 09:20:21.825443 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:21.825446 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:21.825500 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:21.825647 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:21.826668 (+ 1021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:21.826673 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:21.826676 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:21.826694 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:21.826738 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:21.826757 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:21.826889 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:21.827036 (+ 147us) server_negotiation.cc:299] Negotiation successful
0806 09:20:21.827094 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 09:20:21.830515 502 raft_consensus.cc:348] T 00000000000000000000000000000000 P baf9512328004291a2e61a00ac78f073 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baf9512328004291a2e61a00ac78f073" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42935 } }
I20260806 09:20:21.831123 502 raft_consensus.cc:374] T 00000000000000000000000000000000 P baf9512328004291a2e61a00ac78f073 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:20:21.831466 502 raft_consensus.cc:729] T 00000000000000000000000000000000 P baf9512328004291a2e61a00ac78f073 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baf9512328004291a2e61a00ac78f073, State: Initialized, Role: FOLLOWER
I20260806 09:20:21.832291 502 consensus_queue.cc:260] T 00000000000000000000000000000000 P baf9512328004291a2e61a00ac78f073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baf9512328004291a2e61a00ac78f073" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42935 } }
I20260806 09:20:21.832585 502 raft_consensus.cc:388] T 00000000000000000000000000000000 P baf9512328004291a2e61a00ac78f073 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:20:21.832744 502 raft_consensus.cc:482] T 00000000000000000000000000000000 P baf9512328004291a2e61a00ac78f073 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:20:21.832942 502 raft_consensus.cc:3037] T 00000000000000000000000000000000 P baf9512328004291a2e61a00ac78f073 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:21.835425 502 raft_consensus.cc:504] T 00000000000000000000000000000000 P baf9512328004291a2e61a00ac78f073 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baf9512328004291a2e61a00ac78f073" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42935 } }
I20260806 09:20:21.836104 502 leader_election.cc:302] T 00000000000000000000000000000000 P baf9512328004291a2e61a00ac78f073 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: baf9512328004291a2e61a00ac78f073; no voters:
I20260806 09:20:21.836814 502 leader_election.cc:288] T 00000000000000000000000000000000 P baf9512328004291a2e61a00ac78f073 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:20:21.837003 512 raft_consensus.cc:2781] T 00000000000000000000000000000000 P baf9512328004291a2e61a00ac78f073 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:20:21.838678 512 raft_consensus.cc:686] T 00000000000000000000000000000000 P baf9512328004291a2e61a00ac78f073 [term 1 LEADER]: Becoming Leader. State: Replica: baf9512328004291a2e61a00ac78f073, State: Running, Role: LEADER
I20260806 09:20:21.839397 502 sys_catalog.cc:564] T 00000000000000000000000000000000 P baf9512328004291a2e61a00ac78f073 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:20:21.839458 512 consensus_queue.cc:237] T 00000000000000000000000000000000 P baf9512328004291a2e61a00ac78f073 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baf9512328004291a2e61a00ac78f073" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42935 } }
I20260806 09:20:21.842792 514 sys_catalog.cc:455] T 00000000000000000000000000000000 P baf9512328004291a2e61a00ac78f073 [sys.catalog]: SysCatalogTable state changed. Reason: New leader baf9512328004291a2e61a00ac78f073. Latest consensus state: current_term: 1 leader_uuid: "baf9512328004291a2e61a00ac78f073" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baf9512328004291a2e61a00ac78f073" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42935 } } }
I20260806 09:20:21.843391 514 sys_catalog.cc:458] T 00000000000000000000000000000000 P baf9512328004291a2e61a00ac78f073 [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:21.842811 513 sys_catalog.cc:455] T 00000000000000000000000000000000 P baf9512328004291a2e61a00ac78f073 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "baf9512328004291a2e61a00ac78f073" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baf9512328004291a2e61a00ac78f073" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42935 } } }
I20260806 09:20:21.844107 513 sys_catalog.cc:458] T 00000000000000000000000000000000 P baf9512328004291a2e61a00ac78f073 [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:21.844467 521 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:20:21.852053 521 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:20:21.862156 521 catalog_manager.cc:1347] Generated new cluster ID: 066b0bfef7e843a3b01534329a937f61
I20260806 09:20:21.862317 521 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:20:21.876932 521 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:20:21.877471 521 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:20:21.904458 521 catalog_manager.cc:5868] T 00000000000000000000000000000000 P baf9512328004291a2e61a00ac78f073: Generated new TSK 0
I20260806 09:20:21.905474 521 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:20:21.912263 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 435
W20260806 09:20:21.913627 497 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.215:47705
W20260806 09:20:21.914606 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 435: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 09:20:21.914789 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 435
2026-08-06T09:20:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2085 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:20:22 dist-test-slave-mvvj krb5kdc[533](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:20:22 dist-test-slave-mvvj krb5kdc[533](info): set up 2 sockets
Aug 06 09:20:22 dist-test-slave-mvvj krb5kdc[533](info): commencing operation
krb5kdc: starting...
W20260806 09:20:23.120452 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.166s user 0.005s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:20:23 dist-test-slave-mvvj krb5kdc[533](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:20:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:20:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 09:20:23.428363 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38957
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38957
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:20:23.804968 547 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:23.805302 547 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:23.805478 547 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:23.813464 547 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:23.813607 547 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:23.813696 547 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:23.813807 547 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:23.813884 547 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:23.824846 547 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38957
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38957
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:23.826321 547 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:23.827909 547 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:23.841908 553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:23.841987 555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:23.841957 552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:23.842386 547 server_base.cc:1034] running on GCE node
I20260806 09:20:23.843729 547 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:23.845594 547 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:23.846869 547 hybrid_clock.cc:648] HybridClock initialized: now 1786008023846811 us; error 55 us; skew 500 ppm
I20260806 09:20:23.847322 547 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:20:23 dist-test-slave-mvvj krb5kdc[533](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008023, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:20:23.850989 547 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 09:20:23.852921 547 webserver.cc:460] Webserver started at http://127.0.0.1:37051/ using document root <none> and password file <none>
I20260806 09:20:23.853665 547 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:23.853818 547 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:23.854175 547 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:23.857558 547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "699e5100f33744a583b721a29993566f"
format_stamp: "Formatted at 2026-08-06 09:20:23 on dist-test-slave-mvvj"
server_key: "98d5e1d8eeba27187366cb1b36836eb7"
server_key_iv: "2f5d83cfe28a75fddee7aea953748ab8"
server_key_version: "encryptionkey@0"
I20260806 09:20:23.858505 547 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "699e5100f33744a583b721a29993566f"
format_stamp: "Formatted at 2026-08-06 09:20:23 on dist-test-slave-mvvj"
server_key: "98d5e1d8eeba27187366cb1b36836eb7"
server_key_iv: "2f5d83cfe28a75fddee7aea953748ab8"
server_key_version: "encryptionkey@0"
I20260806 09:20:23.864861 547 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260806 09:20:23.869243 562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:23.871307 547 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260806 09:20:23.871572 547 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "699e5100f33744a583b721a29993566f"
format_stamp: "Formatted at 2026-08-06 09:20:23 on dist-test-slave-mvvj"
server_key: "98d5e1d8eeba27187366cb1b36836eb7"
server_key_iv: "2f5d83cfe28a75fddee7aea953748ab8"
server_key_version: "encryptionkey@0"
I20260806 09:20:23.871898 547 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:23.899410 547 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:23.904610 547 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:23.904950 547 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:23.926277 547 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38957
I20260806 09:20:23.926370 613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38957 every 8 connection(s)
I20260806 09:20:23.927804 547 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:20:23.929837 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 547
I20260806 09:20:23.930073 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:20:23.930548 11261 external_mini_cluster.cc:1428] Setting key b2ffcbf2c4900d32594ce1311ca9449d
I20260806 09:20:23.932423 614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 09:20:23 dist-test-slave-mvvj krb5kdc[533](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008023, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 09:20:23.947777 614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 699e5100f33744a583b721a29993566f: Bootstrap starting.
I20260806 09:20:23.952895 614 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 699e5100f33744a583b721a29993566f: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:23.954264 614 log.cc:824] T 00000000000000000000000000000000 P 699e5100f33744a583b721a29993566f: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:23.958244 614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 699e5100f33744a583b721a29993566f: No bootstrap required, opened a new log
I20260806 09:20:23.958338 617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:23.932590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.215:46275 (local address 127.0.0.1:38957)
0806 09:20:23.933425 (+ 835us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:23.933437 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:23.933487 (+ 50us) server_negotiation.cc:407] Connection header received
0806 09:20:23.935177 (+ 1690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:23.935199 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:23.935633 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:23.936072 (+ 439us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:23.938120 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:23.939644 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:23.941548 (+ 1904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:23.942347 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:23.942519 (+ 172us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:23.948223 (+ 5704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:23.948238 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:23.948263 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:23.948326 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:23.952849 (+ 4523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:23.953972 (+ 1123us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:23.953985 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:23.954010 (+ 25us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:23.954287 (+ 277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:23.955101 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:23.955106 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:23.955109 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:23.955707 (+ 598us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:23.956100 (+ 393us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:23.956577 (+ 477us) server_negotiation.cc:299] Negotiation successful
0806 09:20:23.956935 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":378,"threads_started":1}
I20260806 09:20:23.963059 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:20:23.967262 614 raft_consensus.cc:348] T 00000000000000000000000000000000 P 699e5100f33744a583b721a29993566f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699e5100f33744a583b721a29993566f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38957 } }
I20260806 09:20:23.967744 614 raft_consensus.cc:374] T 00000000000000000000000000000000 P 699e5100f33744a583b721a29993566f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:20:23.967890 614 raft_consensus.cc:729] T 00000000000000000000000000000000 P 699e5100f33744a583b721a29993566f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 699e5100f33744a583b721a29993566f, State: Initialized, Role: FOLLOWER
I20260806 09:20:23.968691 614 consensus_queue.cc:260] T 00000000000000000000000000000000 P 699e5100f33744a583b721a29993566f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699e5100f33744a583b721a29993566f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38957 } }
I20260806 09:20:23.969029 614 raft_consensus.cc:388] T 00000000000000000000000000000000 P 699e5100f33744a583b721a29993566f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:20:23.969223 614 raft_consensus.cc:482] T 00000000000000000000000000000000 P 699e5100f33744a583b721a29993566f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:20:23.969431 614 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 699e5100f33744a583b721a29993566f [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:23.972014 614 raft_consensus.cc:504] T 00000000000000000000000000000000 P 699e5100f33744a583b721a29993566f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699e5100f33744a583b721a29993566f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38957 } }
I20260806 09:20:23.972609 614 leader_election.cc:302] T 00000000000000000000000000000000 P 699e5100f33744a583b721a29993566f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 699e5100f33744a583b721a29993566f; no voters:
I20260806 09:20:23.973292 614 leader_election.cc:288] T 00000000000000000000000000000000 P 699e5100f33744a583b721a29993566f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:20:23.973462 624 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 699e5100f33744a583b721a29993566f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:20:23.974926 624 raft_consensus.cc:686] T 00000000000000000000000000000000 P 699e5100f33744a583b721a29993566f [term 1 LEADER]: Becoming Leader. State: Replica: 699e5100f33744a583b721a29993566f, State: Running, Role: LEADER
I20260806 09:20:23.975633 624 consensus_queue.cc:237] T 00000000000000000000000000000000 P 699e5100f33744a583b721a29993566f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699e5100f33744a583b721a29993566f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38957 } }
I20260806 09:20:23.975924 614 sys_catalog.cc:564] T 00000000000000000000000000000000 P 699e5100f33744a583b721a29993566f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:20:23.978780 625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 699e5100f33744a583b721a29993566f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "699e5100f33744a583b721a29993566f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699e5100f33744a583b721a29993566f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38957 } } }
I20260806 09:20:23.979801 625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 699e5100f33744a583b721a29993566f [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:23.979550 626 sys_catalog.cc:455] T 00000000000000000000000000000000 P 699e5100f33744a583b721a29993566f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 699e5100f33744a583b721a29993566f. Latest consensus state: current_term: 1 leader_uuid: "699e5100f33744a583b721a29993566f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699e5100f33744a583b721a29993566f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38957 } } }
I20260806 09:20:23.979977 626 sys_catalog.cc:458] T 00000000000000000000000000000000 P 699e5100f33744a583b721a29993566f [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:23.983880 631 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:20:23.989318 617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:23.968089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.215:34453 (local address 127.0.0.1:38957)
0806 09:20:23.968359 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:23.968369 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:23.968918 (+ 549us) server_negotiation.cc:407] Connection header received
0806 09:20:23.969188 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:23.969194 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:23.969284 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:23.969408 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:23.971095 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:23.971992 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:23.973664 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:23.974397 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:23.974533 (+ 136us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:23.978648 (+ 4115us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:23.978658 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:23.978666 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:23.978733 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:23.983219 (+ 4486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:23.984501 (+ 1282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:23.984511 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:23.984517 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:23.984863 (+ 346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:23.985527 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:23.985535 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:23.985541 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:23.986118 (+ 577us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:23.988175 (+ 2057us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:23.988446 (+ 271us) server_negotiation.cc:299] Negotiation successful
0806 09:20:23.988729 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260806 09:20:23.989749 631 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:20:24.006263 631 catalog_manager.cc:1347] Generated new cluster ID: b06e18f39de449a4856aad0560ef66de
I20260806 09:20:24.006412 631 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:20:24.025221 631 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:20:24.027304 631 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:20:24.042686 631 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 699e5100f33744a583b721a29993566f: Generated new TSK 0
I20260806 09:20:24.043777 631 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:20:24.052582 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 547
I20260806 09:20:24.054798 609 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:20:24.152261 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 547
W20260806 09:20:24.171851 531 connection.cc:535] client connection to 127.0.0.1:38957 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38957): Connection reset by peer (error 104)
2026-08-06T09:20:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2239 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:20:24 dist-test-slave-mvvj krb5kdc[646](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:20:24 dist-test-slave-mvvj krb5kdc[646](info): set up 2 sockets
Aug 06 09:20:24 dist-test-slave-mvvj krb5kdc[646](info): commencing operation
krb5kdc: starting...
W20260806 09:20:25.311110 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.119s user 0.001s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:20:25 dist-test-slave-mvvj krb5kdc[646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008025, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:20:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:20:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 09:20:25.629839 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45279
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45279
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:20:25.987695 659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:25.988051 659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:25.988226 659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:25.996546 659 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:25.996702 659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:25.996805 659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:25.996898 659 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:25.996986 659 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:26.007534 659 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45279
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:26.009142 659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:26.010576 659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:26.024125 664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:26.024178 665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:26.024205 667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:26.025149 659 server_base.cc:1034] running on GCE node
I20260806 09:20:26.026001 659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:26.027524 659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:26.028743 659 hybrid_clock.cc:648] HybridClock initialized: now 1786008026028682 us; error 51 us; skew 500 ppm
I20260806 09:20:26.029138 659 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:20:26 dist-test-slave-mvvj krb5kdc[646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008026, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:20:26.032723 659 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 09:20:26.034399 659 webserver.cc:460] Webserver started at http://127.0.0.1:46407/ using document root <none> and password file <none>
I20260806 09:20:26.035176 659 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:26.035341 659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:26.035717 659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:26.039247 659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "f686202b227c483cb4c922ca0944d471"
format_stamp: "Formatted at 2026-08-06 09:20:26 on dist-test-slave-mvvj"
server_key: "ed7cd51593709d86b7d81bbc86feeaee"
server_key_iv: "c1c8e139954c8277cad6d12d3e82b976"
server_key_version: "encryptionkey@0"
I20260806 09:20:26.040256 659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "f686202b227c483cb4c922ca0944d471"
format_stamp: "Formatted at 2026-08-06 09:20:26 on dist-test-slave-mvvj"
server_key: "ed7cd51593709d86b7d81bbc86feeaee"
server_key_iv: "c1c8e139954c8277cad6d12d3e82b976"
server_key_version: "encryptionkey@0"
I20260806 09:20:26.046150 659 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260806 09:20:26.050387 674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:26.052253 659 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:20:26.052476 659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "f686202b227c483cb4c922ca0944d471"
format_stamp: "Formatted at 2026-08-06 09:20:26 on dist-test-slave-mvvj"
server_key: "ed7cd51593709d86b7d81bbc86feeaee"
server_key_iv: "c1c8e139954c8277cad6d12d3e82b976"
server_key_version: "encryptionkey@0"
I20260806 09:20:26.052717 659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:26.068005 659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:26.073005 659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:26.073346 659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:26.094587 659 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45279
I20260806 09:20:26.094632 725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45279 every 8 connection(s)
I20260806 09:20:26.096163 659 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:20:26.100050 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 659
I20260806 09:20:26.100250 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:20:26.100668 726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:20:26.100821 11261 external_mini_cluster.cc:1428] Setting key c756ff3fb95ab7ac9df23196acd4c0c4
I20260806 09:20:26.115947 726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f686202b227c483cb4c922ca0944d471: Bootstrap starting.
I20260806 09:20:26.116344 729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:26.102766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.215:35713 (local address 127.0.0.1:45279)
0806 09:20:26.103710 (+ 944us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:26.103721 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:26.103764 (+ 43us) server_negotiation.cc:407] Connection header received
0806 09:20:26.106020 (+ 2256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:26.106049 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:26.106519 (+ 470us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:26.107042 (+ 523us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:26.107692 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:26.109184 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:26.110695 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:26.111490 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:26.111714 (+ 224us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:26.113234 (+ 1520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:26.113246 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:26.113261 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:26.113873 (+ 612us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:26.113964 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:26.113990 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:26.114171 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:26.114480 (+ 309us) server_negotiation.cc:299] Negotiation successful
0806 09:20:26.114707 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":714,"thread_start_us":376,"threads_started":1}
I20260806 09:20:26.120183 726 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f686202b227c483cb4c922ca0944d471: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:26.121327 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:20:26.121634 726 log.cc:824] T 00000000000000000000000000000000 P f686202b227c483cb4c922ca0944d471: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:26.125293 726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f686202b227c483cb4c922ca0944d471: No bootstrap required, opened a new log
I20260806 09:20:26.134708 729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:26.127109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.215:55385 (local address 127.0.0.1:45279)
0806 09:20:26.127334 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:26.127343 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:26.127983 (+ 640us) server_negotiation.cc:407] Connection header received
0806 09:20:26.128188 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:26.128194 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:26.128296 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:26.128424 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:26.128999 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:26.130211 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:26.131640 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:26.132393 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:26.132538 (+ 145us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:26.133788 (+ 1250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:26.133795 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:26.133800 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:26.133826 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:26.133891 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:26.133916 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:26.134042 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:26.134270 (+ 228us) server_negotiation.cc:299] Negotiation successful
0806 09:20:26.134336 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 09:20:26.135737 726 raft_consensus.cc:348] T 00000000000000000000000000000000 P f686202b227c483cb4c922ca0944d471 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f686202b227c483cb4c922ca0944d471" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45279 } }
I20260806 09:20:26.136333 726 raft_consensus.cc:374] T 00000000000000000000000000000000 P f686202b227c483cb4c922ca0944d471 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:20:26.136451 726 raft_consensus.cc:729] T 00000000000000000000000000000000 P f686202b227c483cb4c922ca0944d471 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f686202b227c483cb4c922ca0944d471, State: Initialized, Role: FOLLOWER
I20260806 09:20:26.137148 726 consensus_queue.cc:260] T 00000000000000000000000000000000 P f686202b227c483cb4c922ca0944d471 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f686202b227c483cb4c922ca0944d471" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45279 } }
I20260806 09:20:26.137429 726 raft_consensus.cc:388] T 00000000000000000000000000000000 P f686202b227c483cb4c922ca0944d471 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:20:26.137593 726 raft_consensus.cc:482] T 00000000000000000000000000000000 P f686202b227c483cb4c922ca0944d471 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:20:26.137787 726 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f686202b227c483cb4c922ca0944d471 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:26.140388 726 raft_consensus.cc:504] T 00000000000000000000000000000000 P f686202b227c483cb4c922ca0944d471 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f686202b227c483cb4c922ca0944d471" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45279 } }
I20260806 09:20:26.140972 726 leader_election.cc:302] T 00000000000000000000000000000000 P f686202b227c483cb4c922ca0944d471 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f686202b227c483cb4c922ca0944d471; no voters:
I20260806 09:20:26.141644 726 leader_election.cc:288] T 00000000000000000000000000000000 P f686202b227c483cb4c922ca0944d471 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:20:26.141945 736 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f686202b227c483cb4c922ca0944d471 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:20:26.143193 736 raft_consensus.cc:686] T 00000000000000000000000000000000 P f686202b227c483cb4c922ca0944d471 [term 1 LEADER]: Becoming Leader. State: Replica: f686202b227c483cb4c922ca0944d471, State: Running, Role: LEADER
I20260806 09:20:26.143811 736 consensus_queue.cc:237] T 00000000000000000000000000000000 P f686202b227c483cb4c922ca0944d471 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f686202b227c483cb4c922ca0944d471" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45279 } }
I20260806 09:20:26.144217 726 sys_catalog.cc:564] T 00000000000000000000000000000000 P f686202b227c483cb4c922ca0944d471 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:20:26.147960 737 sys_catalog.cc:455] T 00000000000000000000000000000000 P f686202b227c483cb4c922ca0944d471 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f686202b227c483cb4c922ca0944d471" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f686202b227c483cb4c922ca0944d471" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45279 } } }
I20260806 09:20:26.147600 738 sys_catalog.cc:455] T 00000000000000000000000000000000 P f686202b227c483cb4c922ca0944d471 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f686202b227c483cb4c922ca0944d471. Latest consensus state: current_term: 1 leader_uuid: "f686202b227c483cb4c922ca0944d471" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f686202b227c483cb4c922ca0944d471" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45279 } } }
I20260806 09:20:26.148854 737 sys_catalog.cc:458] T 00000000000000000000000000000000 P f686202b227c483cb4c922ca0944d471 [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:26.148869 738 sys_catalog.cc:458] T 00000000000000000000000000000000 P f686202b227c483cb4c922ca0944d471 [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:26.155906 745 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:20:26.161886 745 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:20:26.173326 745 catalog_manager.cc:1347] Generated new cluster ID: 4329d96a655648bba76ef53802f0c7bb
I20260806 09:20:26.173493 745 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:20:26.182798 745 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:20:26.184842 745 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:20:26.203181 745 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f686202b227c483cb4c922ca0944d471: Generated new TSK 0
I20260806 09:20:26.204593 745 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:20:26.220515 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 659
W20260806 09:20:26.222285 721 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.215:35713
W20260806 09:20:26.223296 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 659: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 09:20:26.223505 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 659
W20260806 09:20:26.242576 644 connection.cc:535] client connection to 127.0.0.1:45279 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45279): Connection reset by peer (error 104)
2026-08-06T09:20:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2070 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:20:26 dist-test-slave-mvvj krb5kdc[757](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:20:26 dist-test-slave-mvvj krb5kdc[757](info): set up 2 sockets
Aug 06 09:20:26 dist-test-slave-mvvj krb5kdc[757](info): commencing operation
krb5kdc: starting...
W20260806 09:20:27.403031 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.002s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:20:27 dist-test-slave-mvvj krb5kdc[757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008027, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:20:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:20:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 09:20:27.717669 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38987
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39643
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38987
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:20:28.084093 770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:28.084493 770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:28.084666 770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:28.092724 770 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:28.092918 770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:28.093029 770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:28.093143 770 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:28.093228 770 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:28.103999 770 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39643
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38987
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:28.105489 770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:28.106889 770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:28.120990 776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:28.120915 778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:28.120962 775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:28.121927 770 server_base.cc:1034] running on GCE node
I20260806 09:20:28.122841 770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:28.124577 770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:28.125864 770 hybrid_clock.cc:648] HybridClock initialized: now 1786008028125819 us; error 40 us; skew 500 ppm
I20260806 09:20:28.126283 770 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:20:28 dist-test-slave-mvvj krb5kdc[757](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008028, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:20:28.130069 770 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 09:20:28.132114 770 webserver.cc:460] Webserver started at http://127.0.0.1:45971/ using document root <none> and password file <none>
I20260806 09:20:28.132891 770 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:28.133080 770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:28.133440 770 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:28.136824 770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "c47c83f29873470baf60e77a43d137ac"
format_stamp: "Formatted at 2026-08-06 09:20:28 on dist-test-slave-mvvj"
server_key: "e1ab2b89b6cd18f0724adae5e4e85af1"
server_key_iv: "b5772332912186a0bc9897d7fe3e9c73"
server_key_version: "encryptionkey@0"
I20260806 09:20:28.137698 770 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "c47c83f29873470baf60e77a43d137ac"
format_stamp: "Formatted at 2026-08-06 09:20:28 on dist-test-slave-mvvj"
server_key: "e1ab2b89b6cd18f0724adae5e4e85af1"
server_key_iv: "b5772332912186a0bc9897d7fe3e9c73"
server_key_version: "encryptionkey@0"
I20260806 09:20:28.143551 770 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260806 09:20:28.147574 785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:28.149283 770 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 09:20:28.149518 770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "c47c83f29873470baf60e77a43d137ac"
format_stamp: "Formatted at 2026-08-06 09:20:28 on dist-test-slave-mvvj"
server_key: "e1ab2b89b6cd18f0724adae5e4e85af1"
server_key_iv: "b5772332912186a0bc9897d7fe3e9c73"
server_key_version: "encryptionkey@0"
I20260806 09:20:28.149783 770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:28.156803 770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:28.162230 770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:28.162626 770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:28.185336 770 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38987
I20260806 09:20:28.185370 836 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38987 every 8 connection(s)
I20260806 09:20:28.187029 770 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:20:28.188422 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 770
I20260806 09:20:28.188678 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:20:28.189249 11261 external_mini_cluster.cc:1428] Setting key cb8101a39ce732da5860f0cfcec270db
I20260806 09:20:28.192755 837 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:20:28.198454 840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:28.191479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.215:44133 (local address 127.0.0.1:38987)
0806 09:20:28.192456 (+ 977us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:28.192468 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:28.192515 (+ 47us) server_negotiation.cc:407] Connection header received
0806 09:20:28.194500 (+ 1985us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:28.194524 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:28.194882 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:28.195248 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:28.196540 (+ 1292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:28.196547 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:28.196562 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:28.196591 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:28.196686 (+ 95us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:28.196723 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:28.196943 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:28.197077 (+ 134us) server_negotiation.cc:299] Negotiation successful
0806 09:20:28.197354 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":717,"thread_start_us":484,"threads_started":1}
I20260806 09:20:28.202881 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:20:28.205953 837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c47c83f29873470baf60e77a43d137ac: Bootstrap starting.
I20260806 09:20:28.210625 837 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c47c83f29873470baf60e77a43d137ac: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:28.211385 840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:28.208101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.215:55005 (local address 127.0.0.1:38987)
0806 09:20:28.208389 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:28.208400 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:28.208941 (+ 541us) server_negotiation.cc:407] Connection header received
0806 09:20:28.209136 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:28.209139 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:28.209194 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:28.209288 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:28.210539 (+ 1251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:28.210543 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:28.210546 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:28.210564 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:28.210614 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:28.210633 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:28.210794 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:28.210942 (+ 148us) server_negotiation.cc:299] Negotiation successful
0806 09:20:28.211001 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 09:20:28.212291 837 log.cc:824] T 00000000000000000000000000000000 P c47c83f29873470baf60e77a43d137ac: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:28.216271 837 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c47c83f29873470baf60e77a43d137ac: No bootstrap required, opened a new log
I20260806 09:20:28.224426 837 raft_consensus.cc:348] T 00000000000000000000000000000000 P c47c83f29873470baf60e77a43d137ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c47c83f29873470baf60e77a43d137ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38987 } }
I20260806 09:20:28.224933 837 raft_consensus.cc:374] T 00000000000000000000000000000000 P c47c83f29873470baf60e77a43d137ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:20:28.225069 837 raft_consensus.cc:729] T 00000000000000000000000000000000 P c47c83f29873470baf60e77a43d137ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47c83f29873470baf60e77a43d137ac, State: Initialized, Role: FOLLOWER
I20260806 09:20:28.225696 837 consensus_queue.cc:260] T 00000000000000000000000000000000 P c47c83f29873470baf60e77a43d137ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c47c83f29873470baf60e77a43d137ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38987 } }
I20260806 09:20:28.225955 837 raft_consensus.cc:388] T 00000000000000000000000000000000 P c47c83f29873470baf60e77a43d137ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:20:28.226118 837 raft_consensus.cc:482] T 00000000000000000000000000000000 P c47c83f29873470baf60e77a43d137ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:20:28.226305 837 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c47c83f29873470baf60e77a43d137ac [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:28.228732 837 raft_consensus.cc:504] T 00000000000000000000000000000000 P c47c83f29873470baf60e77a43d137ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c47c83f29873470baf60e77a43d137ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38987 } }
I20260806 09:20:28.229300 837 leader_election.cc:302] T 00000000000000000000000000000000 P c47c83f29873470baf60e77a43d137ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c47c83f29873470baf60e77a43d137ac; no voters:
I20260806 09:20:28.229964 837 leader_election.cc:288] T 00000000000000000000000000000000 P c47c83f29873470baf60e77a43d137ac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:20:28.230124 847 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c47c83f29873470baf60e77a43d137ac [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:20:28.230841 847 raft_consensus.cc:686] T 00000000000000000000000000000000 P c47c83f29873470baf60e77a43d137ac [term 1 LEADER]: Becoming Leader. State: Replica: c47c83f29873470baf60e77a43d137ac, State: Running, Role: LEADER
I20260806 09:20:28.231406 847 consensus_queue.cc:237] T 00000000000000000000000000000000 P c47c83f29873470baf60e77a43d137ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c47c83f29873470baf60e77a43d137ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38987 } }
I20260806 09:20:28.232267 837 sys_catalog.cc:564] T 00000000000000000000000000000000 P c47c83f29873470baf60e77a43d137ac [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:20:28.235330 848 sys_catalog.cc:455] T 00000000000000000000000000000000 P c47c83f29873470baf60e77a43d137ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c47c83f29873470baf60e77a43d137ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c47c83f29873470baf60e77a43d137ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38987 } } }
I20260806 09:20:28.235117 849 sys_catalog.cc:455] T 00000000000000000000000000000000 P c47c83f29873470baf60e77a43d137ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader c47c83f29873470baf60e77a43d137ac. Latest consensus state: current_term: 1 leader_uuid: "c47c83f29873470baf60e77a43d137ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c47c83f29873470baf60e77a43d137ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38987 } } }
I20260806 09:20:28.235719 848 sys_catalog.cc:458] T 00000000000000000000000000000000 P c47c83f29873470baf60e77a43d137ac [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:28.235795 849 sys_catalog.cc:458] T 00000000000000000000000000000000 P c47c83f29873470baf60e77a43d137ac [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:28.239530 856 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:20:28.245949 856 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:20:28.255096 856 catalog_manager.cc:1347] Generated new cluster ID: b2fedf38152b487596d77fb71129d833
I20260806 09:20:28.255285 856 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:20:28.270800 856 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:20:28.271291 856 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:20:28.282032 856 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c47c83f29873470baf60e77a43d137ac: Generated new TSK 0
I20260806 09:20:28.283011 856 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:20:28.290985 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 770
W20260806 09:20:28.292518 832 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.215:44133
W20260806 09:20:28.293337 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 770: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 09:20:28.293499 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 770
2026-08-06T09:20:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2067 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:20:28 dist-test-slave-mvvj krb5kdc[868](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:20:28 dist-test-slave-mvvj krb5kdc[868](info): set up 2 sockets
Aug 06 09:20:28 dist-test-slave-mvvj krb5kdc[868](info): commencing operation
krb5kdc: starting...
W20260806 09:20:29.466607 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.001s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:20:29 dist-test-slave-mvvj krb5kdc[868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:20:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:20:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:20:29.776232 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:45069
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:42187
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:45069
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:20:30.158432 881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:30.158800 881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:30.158907 881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:30.167582 881 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:30.167728 881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:30.167783 881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:30.167939 881 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:30.167997 881 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:30.179445 881 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:42187
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:45069
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:45069
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:30.180982 881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:30.182415 881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:30.196489 887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:30.196655 886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:30.196661 889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:30.197929 881 server_base.cc:1034] running on GCE node
I20260806 09:20:30.198976 881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:30.200750 881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:30.202051 881 hybrid_clock.cc:648] HybridClock initialized: now 1786008030202010 us; error 59 us; skew 500 ppm
I20260806 09:20:30.202543 881 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:20:30 dist-test-slave-mvvj krb5kdc[868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008030, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:20:30.206202 881 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:20:30.208210 881 webserver.cc:460] Webserver started at http://127.10.255.126:42319/ using document root <none> and password file <none>
I20260806 09:20:30.208993 881 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:30.209161 881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:30.209533 881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:30.212975 881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "23dcd8e3b48a4654b82e433b8336fb26"
format_stamp: "Formatted at 2026-08-06 09:20:30 on dist-test-slave-mvvj"
server_key: "4ee195ff696c26cacdcfb0d167aaf55d"
server_key_iv: "61f560862d24cd0609abe928ce31966c"
server_key_version: "encryptionkey@0"
I20260806 09:20:30.213909 881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "23dcd8e3b48a4654b82e433b8336fb26"
format_stamp: "Formatted at 2026-08-06 09:20:30 on dist-test-slave-mvvj"
server_key: "4ee195ff696c26cacdcfb0d167aaf55d"
server_key_iv: "61f560862d24cd0609abe928ce31966c"
server_key_version: "encryptionkey@0"
I20260806 09:20:30.219813 881 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260806 09:20:30.224200 896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:30.225841 881 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:20:30.226094 881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "23dcd8e3b48a4654b82e433b8336fb26"
format_stamp: "Formatted at 2026-08-06 09:20:30 on dist-test-slave-mvvj"
server_key: "4ee195ff696c26cacdcfb0d167aaf55d"
server_key_iv: "61f560862d24cd0609abe928ce31966c"
server_key_version: "encryptionkey@0"
I20260806 09:20:30.226343 881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:30.251088 881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:30.256008 881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:30.256361 881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:30.277875 881 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:45069
I20260806 09:20:30.277881 947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:45069 every 8 connection(s)
I20260806 09:20:30.279599 881 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:20:30.283905 948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:20:30.289151 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 881
I20260806 09:20:30.289361 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:20:30.289930 11261 external_mini_cluster.cc:1428] Setting key 64cbbfd543460ce0e7e59afb4d80df77
I20260806 09:20:30.296761 948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23dcd8e3b48a4654b82e433b8336fb26: Bootstrap starting.
I20260806 09:20:30.300420 948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23dcd8e3b48a4654b82e433b8336fb26: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:30.301640 948 log.cc:824] T 00000000000000000000000000000000 P 23dcd8e3b48a4654b82e433b8336fb26: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:30.305948 948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23dcd8e3b48a4654b82e433b8336fb26: No bootstrap required, opened a new log
Aug 06 09:20:30 dist-test-slave-mvvj krb5kdc[868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008029, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:20:30.314961 948 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23dcd8e3b48a4654b82e433b8336fb26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23dcd8e3b48a4654b82e433b8336fb26" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 45069 } }
I20260806 09:20:30.315682 948 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23dcd8e3b48a4654b82e433b8336fb26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:20:30.316037 948 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23dcd8e3b48a4654b82e433b8336fb26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23dcd8e3b48a4654b82e433b8336fb26, State: Initialized, Role: FOLLOWER
I20260806 09:20:30.316860 948 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23dcd8e3b48a4654b82e433b8336fb26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23dcd8e3b48a4654b82e433b8336fb26" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 45069 } }
I20260806 09:20:30.317183 948 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23dcd8e3b48a4654b82e433b8336fb26 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:20:30.317365 948 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23dcd8e3b48a4654b82e433b8336fb26 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:20:30.317581 948 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23dcd8e3b48a4654b82e433b8336fb26 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:30.318444 951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:30.292010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49859 (local address 127.10.255.126:45069)
0806 09:20:30.293037 (+ 1027us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:30.293052 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:30.293106 (+ 54us) server_negotiation.cc:407] Connection header received
0806 09:20:30.295253 (+ 2147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:30.295282 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:30.295768 (+ 486us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:30.296322 (+ 554us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:30.298012 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:30.299430 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:30.300993 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:30.301775 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:30.302012 (+ 237us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:30.308302 (+ 6290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:30.308313 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:30.308336 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:30.308393 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:30.312502 (+ 4109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:30.313669 (+ 1167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:30.313679 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:30.313687 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:30.313916 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:30.314525 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:30.314530 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:30.314532 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:30.315199 (+ 667us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:30.315635 (+ 436us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:30.316276 (+ 641us) server_negotiation.cc:299] Negotiation successful
0806 09:20:30.316905 (+ 629us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":761,"thread_start_us":506,"threads_started":1}
I20260806 09:20:30.320848 948 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23dcd8e3b48a4654b82e433b8336fb26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23dcd8e3b48a4654b82e433b8336fb26" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 45069 } }
I20260806 09:20:30.321465 948 leader_election.cc:302] T 00000000000000000000000000000000 P 23dcd8e3b48a4654b82e433b8336fb26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23dcd8e3b48a4654b82e433b8336fb26; no voters:
I20260806 09:20:30.322222 948 leader_election.cc:288] T 00000000000000000000000000000000 P 23dcd8e3b48a4654b82e433b8336fb26 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:20:30.322383 953 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23dcd8e3b48a4654b82e433b8336fb26 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:20:30.323787 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:20:30.324915 953 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23dcd8e3b48a4654b82e433b8336fb26 [term 1 LEADER]: Becoming Leader. State: Replica: 23dcd8e3b48a4654b82e433b8336fb26, State: Running, Role: LEADER
I20260806 09:20:30.325623 953 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23dcd8e3b48a4654b82e433b8336fb26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23dcd8e3b48a4654b82e433b8336fb26" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 45069 } }
I20260806 09:20:30.325877 948 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23dcd8e3b48a4654b82e433b8336fb26 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:20:30.329097 955 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23dcd8e3b48a4654b82e433b8336fb26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23dcd8e3b48a4654b82e433b8336fb26. Latest consensus state: current_term: 1 leader_uuid: "23dcd8e3b48a4654b82e433b8336fb26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23dcd8e3b48a4654b82e433b8336fb26" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 45069 } } }
I20260806 09:20:30.329566 955 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23dcd8e3b48a4654b82e433b8336fb26 [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:30.331562 954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23dcd8e3b48a4654b82e433b8336fb26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23dcd8e3b48a4654b82e433b8336fb26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23dcd8e3b48a4654b82e433b8336fb26" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 45069 } } }
I20260806 09:20:30.332253 954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23dcd8e3b48a4654b82e433b8336fb26 [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:30.343604 962 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:20:30.352262 962 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:20:30.366684 951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:30.342408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46729 (local address 127.10.255.126:45069)
0806 09:20:30.342611 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:30.342617 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:30.344034 (+ 1417us) server_negotiation.cc:407] Connection header received
0806 09:20:30.344270 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:30.344277 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:30.344387 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:30.344525 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:30.346210 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:30.347908 (+ 1698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:30.350601 (+ 2693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:30.351351 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:30.351517 (+ 166us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:30.356072 (+ 4555us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:30.356081 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:30.356087 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:30.356143 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:30.360433 (+ 4290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:30.361595 (+ 1162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:30.361601 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:30.361605 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:30.361778 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:30.362417 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:30.362422 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:30.362426 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:30.362965 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:30.363342 (+ 377us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:30.365710 (+ 2368us) server_negotiation.cc:299] Negotiation successful
0806 09:20:30.366041 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 09:20:30.374347 962 catalog_manager.cc:1347] Generated new cluster ID: 7c701ff13be948e3a763f565cf72615a
I20260806 09:20:30.374670 962 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:20:30.389565 962 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:20:30.391211 962 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:20:30.399163 962 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23dcd8e3b48a4654b82e433b8336fb26: Generated new TSK 0
I20260806 09:20:30.400210 962 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:20:30.413285 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 881
I20260806 09:20:30.415068 943 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:20:30.510432 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 881
W20260806 09:20:30.530602 866 connection.cc:535] client connection to 127.10.255.126:45069 recv error: Network error: failed to read from TLS socket (remote: 127.10.255.126:45069): Connection reset by peer (error 104)
2026-08-06T09:20:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2220 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:20:30 dist-test-slave-mvvj krb5kdc[980](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:20:30 dist-test-slave-mvvj krb5kdc[980](info): set up 2 sockets
Aug 06 09:20:30 dist-test-slave-mvvj krb5kdc[980](info): commencing operation
krb5kdc: starting...
W20260806 09:20:31.727316 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.177s user 0.001s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:20:31 dist-test-slave-mvvj krb5kdc[980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008031, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:20:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:20:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:20:32.048292 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:34695
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:33687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:34695
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:20:32.414496 993 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:32.414845 993 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:32.414947 993 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:32.422593 993 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:32.422735 993 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:32.422785 993 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:32.422843 993 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:32.422890 993 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:32.434070 993 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:33687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:34695
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:34695
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:32.435487 993 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:32.437454 993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:32.450824 998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:32.450763 1001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:32.450716 999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:32.452013 993 server_base.cc:1034] running on GCE node
I20260806 09:20:32.452999 993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:32.454878 993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:32.456156 993 hybrid_clock.cc:648] HybridClock initialized: now 1786008032456112 us; error 44 us; skew 500 ppm
I20260806 09:20:32.456707 993 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:20:32 dist-test-slave-mvvj krb5kdc[980](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008032, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:20:32.460753 993 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:20:32.462953 993 webserver.cc:460] Webserver started at http://127.10.255.126:46137/ using document root <none> and password file <none>
I20260806 09:20:32.463766 993 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:32.463996 993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:32.464367 993 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:32.468679 993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "cda2fb3e30bc4df784ec64bd08263512"
format_stamp: "Formatted at 2026-08-06 09:20:32 on dist-test-slave-mvvj"
server_key: "c4bcb04b9fdd373f5913c6fb32ff0986"
server_key_iv: "33fa9bf468c618d109c944247439989c"
server_key_version: "encryptionkey@0"
I20260806 09:20:32.469735 993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "cda2fb3e30bc4df784ec64bd08263512"
format_stamp: "Formatted at 2026-08-06 09:20:32 on dist-test-slave-mvvj"
server_key: "c4bcb04b9fdd373f5913c6fb32ff0986"
server_key_iv: "33fa9bf468c618d109c944247439989c"
server_key_version: "encryptionkey@0"
I20260806 09:20:32.476255 993 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 09:20:32.480886 1008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:32.482791 993 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260806 09:20:32.483043 993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "cda2fb3e30bc4df784ec64bd08263512"
format_stamp: "Formatted at 2026-08-06 09:20:32 on dist-test-slave-mvvj"
server_key: "c4bcb04b9fdd373f5913c6fb32ff0986"
server_key_iv: "33fa9bf468c618d109c944247439989c"
server_key_version: "encryptionkey@0"
I20260806 09:20:32.483307 993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:32.505043 993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:32.510702 993 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:32.511091 993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:32.533789 993 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:34695
I20260806 09:20:32.533833 1059 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:34695 every 8 connection(s)
I20260806 09:20:32.535460 993 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:20:32.539508 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 993
I20260806 09:20:32.539763 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:20:32.540249 1060 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:20:32.540683 11261 external_mini_cluster.cc:1428] Setting key ee969a61b5f71d157339ecd118d523ac
I20260806 09:20:32.556466 1060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cda2fb3e30bc4df784ec64bd08263512: Bootstrap starting.
I20260806 09:20:32.556692 1063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:32.542821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43321 (local address 127.10.255.126:34695)
0806 09:20:32.543794 (+ 973us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:32.543808 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:32.543915 (+ 107us) server_negotiation.cc:407] Connection header received
0806 09:20:32.545723 (+ 1808us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:32.545748 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:32.546244 (+ 496us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:32.546634 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:32.547416 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:32.548909 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:32.550857 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:32.551722 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:32.551994 (+ 272us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:32.553540 (+ 1546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:32.553551 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:32.553571 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:32.554232 (+ 661us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:32.554338 (+ 106us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:32.554366 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:32.554516 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:32.554906 (+ 390us) server_negotiation.cc:299] Negotiation successful
0806 09:20:32.555106 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":719,"thread_start_us":445,"threads_started":1}
I20260806 09:20:32.560117 1060 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cda2fb3e30bc4df784ec64bd08263512: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:32.561568 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:20:32.561548 1060 log.cc:824] T 00000000000000000000000000000000 P cda2fb3e30bc4df784ec64bd08263512: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:32.565233 1060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cda2fb3e30bc4df784ec64bd08263512: No bootstrap required, opened a new log
I20260806 09:20:32.575429 1063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:32.567422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41215 (local address 127.10.255.126:34695)
0806 09:20:32.567865 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:32.567873 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:32.568064 (+ 191us) server_negotiation.cc:407] Connection header received
0806 09:20:32.568269 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:32.568281 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:32.568381 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:32.568533 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:32.569198 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:32.570540 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:32.572081 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:32.572930 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:32.573092 (+ 162us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:32.574464 (+ 1372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:32.574472 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:32.574476 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:32.574509 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:32.574572 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:32.574606 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:32.574740 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:32.574941 (+ 201us) server_negotiation.cc:299] Negotiation successful
0806 09:20:32.575017 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260806 09:20:32.576669 1060 raft_consensus.cc:348] T 00000000000000000000000000000000 P cda2fb3e30bc4df784ec64bd08263512 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cda2fb3e30bc4df784ec64bd08263512" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 34695 } }
I20260806 09:20:32.577266 1060 raft_consensus.cc:374] T 00000000000000000000000000000000 P cda2fb3e30bc4df784ec64bd08263512 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:20:32.577391 1060 raft_consensus.cc:729] T 00000000000000000000000000000000 P cda2fb3e30bc4df784ec64bd08263512 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cda2fb3e30bc4df784ec64bd08263512, State: Initialized, Role: FOLLOWER
I20260806 09:20:32.578156 1060 consensus_queue.cc:260] T 00000000000000000000000000000000 P cda2fb3e30bc4df784ec64bd08263512 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cda2fb3e30bc4df784ec64bd08263512" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 34695 } }
I20260806 09:20:32.578481 1060 raft_consensus.cc:388] T 00000000000000000000000000000000 P cda2fb3e30bc4df784ec64bd08263512 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:20:32.578670 1060 raft_consensus.cc:482] T 00000000000000000000000000000000 P cda2fb3e30bc4df784ec64bd08263512 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:20:32.578886 1060 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cda2fb3e30bc4df784ec64bd08263512 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:32.581741 1060 raft_consensus.cc:504] T 00000000000000000000000000000000 P cda2fb3e30bc4df784ec64bd08263512 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cda2fb3e30bc4df784ec64bd08263512" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 34695 } }
I20260806 09:20:32.582381 1060 leader_election.cc:302] T 00000000000000000000000000000000 P cda2fb3e30bc4df784ec64bd08263512 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cda2fb3e30bc4df784ec64bd08263512; no voters:
I20260806 09:20:32.583073 1060 leader_election.cc:288] T 00000000000000000000000000000000 P cda2fb3e30bc4df784ec64bd08263512 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:20:32.583273 1070 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cda2fb3e30bc4df784ec64bd08263512 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:20:32.584194 1070 raft_consensus.cc:686] T 00000000000000000000000000000000 P cda2fb3e30bc4df784ec64bd08263512 [term 1 LEADER]: Becoming Leader. State: Replica: cda2fb3e30bc4df784ec64bd08263512, State: Running, Role: LEADER
I20260806 09:20:32.584802 1070 consensus_queue.cc:237] T 00000000000000000000000000000000 P cda2fb3e30bc4df784ec64bd08263512 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cda2fb3e30bc4df784ec64bd08263512" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 34695 } }
I20260806 09:20:32.585630 1060 sys_catalog.cc:564] T 00000000000000000000000000000000 P cda2fb3e30bc4df784ec64bd08263512 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:20:32.588049 1071 sys_catalog.cc:455] T 00000000000000000000000000000000 P cda2fb3e30bc4df784ec64bd08263512 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cda2fb3e30bc4df784ec64bd08263512" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cda2fb3e30bc4df784ec64bd08263512" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 34695 } } }
I20260806 09:20:32.588471 1072 sys_catalog.cc:455] T 00000000000000000000000000000000 P cda2fb3e30bc4df784ec64bd08263512 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cda2fb3e30bc4df784ec64bd08263512. Latest consensus state: current_term: 1 leader_uuid: "cda2fb3e30bc4df784ec64bd08263512" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cda2fb3e30bc4df784ec64bd08263512" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 34695 } } }
I20260806 09:20:32.588825 1071 sys_catalog.cc:458] T 00000000000000000000000000000000 P cda2fb3e30bc4df784ec64bd08263512 [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:32.588876 1072 sys_catalog.cc:458] T 00000000000000000000000000000000 P cda2fb3e30bc4df784ec64bd08263512 [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:32.591506 1077 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:20:32.599498 1077 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:20:32.609642 1077 catalog_manager.cc:1347] Generated new cluster ID: c74d60ea96a342419ba3f0efff146392
I20260806 09:20:32.609859 1077 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:20:32.622960 1077 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:20:32.624611 1077 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:20:32.637019 1077 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cda2fb3e30bc4df784ec64bd08263512: Generated new TSK 0
I20260806 09:20:32.638031 1077 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:20:32.646822 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 993
W20260806 09:20:32.648576 1055 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:43321
W20260806 09:20:32.649609 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 993: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 09:20:32.649797 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 993
W20260806 09:20:32.669888 978 connection.cc:535] client connection to 127.10.255.126:34695 recv error: Network error: failed to read from TLS socket (remote: 127.10.255.126:34695): Connection reset by peer (error 104)
2026-08-06T09:20:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2139 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:20:32 dist-test-slave-mvvj krb5kdc[1091](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:20:32 dist-test-slave-mvvj krb5kdc[1091](info): set up 2 sockets
Aug 06 09:20:32 dist-test-slave-mvvj krb5kdc[1091](info): commencing operation
krb5kdc: starting...
W20260806 09:20:33.836712 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:20:34 dist-test-slave-mvvj krb5kdc[1091](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008034, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:20:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:20:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:20:34.148845 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:44537
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:35149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:44537
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:20:34.519501 1104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:34.519948 1104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:34.520133 1104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:34.528155 1104 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:34.528365 1104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:34.528492 1104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:34.528610 1104 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:34.528693 1104 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:34.540244 1104 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:35149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:44537
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:44537
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:34.541772 1104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:34.543241 1104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:34.556289 1110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:34.556339 1112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:34.556231 1109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:34.557679 1104 server_base.cc:1034] running on GCE node
I20260806 09:20:34.558670 1104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:34.560441 1104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:34.561708 1104 hybrid_clock.cc:648] HybridClock initialized: now 1786008034561670 us; error 44 us; skew 500 ppm
I20260806 09:20:34.562158 1104 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:20:34 dist-test-slave-mvvj krb5kdc[1091](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008034, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:20:34.565713 1104 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:20:34.567447 1104 webserver.cc:460] Webserver started at http://127.10.255.126:39809/ using document root <none> and password file <none>
I20260806 09:20:34.568301 1104 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:34.568482 1104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:34.568828 1104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:34.572330 1104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "0a8eb04268bb4216b7ae5a52274f964d"
format_stamp: "Formatted at 2026-08-06 09:20:34 on dist-test-slave-mvvj"
server_key: "8310801a295e672a170c8befff1729bc"
server_key_iv: "e391e40821e7f3be5e0fa30596342b4d"
server_key_version: "encryptionkey@0"
I20260806 09:20:34.573365 1104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "0a8eb04268bb4216b7ae5a52274f964d"
format_stamp: "Formatted at 2026-08-06 09:20:34 on dist-test-slave-mvvj"
server_key: "8310801a295e672a170c8befff1729bc"
server_key_iv: "e391e40821e7f3be5e0fa30596342b4d"
server_key_version: "encryptionkey@0"
I20260806 09:20:34.579255 1104 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260806 09:20:34.583283 1119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:34.584856 1104 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 09:20:34.585071 1104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "0a8eb04268bb4216b7ae5a52274f964d"
format_stamp: "Formatted at 2026-08-06 09:20:34 on dist-test-slave-mvvj"
server_key: "8310801a295e672a170c8befff1729bc"
server_key_iv: "e391e40821e7f3be5e0fa30596342b4d"
server_key_version: "encryptionkey@0"
I20260806 09:20:34.585309 1104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:34.591733 1104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:34.596768 1104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:34.597131 1104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:34.617964 1104 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:44537
I20260806 09:20:34.617998 1170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:44537 every 8 connection(s)
I20260806 09:20:34.619522 1104 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:20:34.621215 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 1104
I20260806 09:20:34.621418 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:20:34.622020 11261 external_mini_cluster.cc:1428] Setting key a93aaa3003744d003d26a1c5d53d0396
I20260806 09:20:34.625104 1171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:20:34.631623 1174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:34.624218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48923 (local address 127.10.255.126:44537)
0806 09:20:34.625382 (+ 1164us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:34.625396 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:34.625449 (+ 53us) server_negotiation.cc:407] Connection header received
0806 09:20:34.627453 (+ 2004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:34.627486 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:34.628000 (+ 514us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:34.628509 (+ 509us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:34.629707 (+ 1198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:34.629714 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:34.629729 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:34.629745 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:34.629830 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:34.629851 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:34.630144 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:34.630314 (+ 170us) server_negotiation.cc:299] Negotiation successful
0806 09:20:34.630549 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":832,"thread_start_us":468,"threads_started":1}
I20260806 09:20:34.636186 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:20:34.639456 1171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a8eb04268bb4216b7ae5a52274f964d: Bootstrap starting.
I20260806 09:20:34.644590 1171 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0a8eb04268bb4216b7ae5a52274f964d: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:34.645295 1174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:34.642776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48317 (local address 127.10.255.126:44537)
0806 09:20:34.642981 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:34.642987 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:34.643009 (+ 22us) server_negotiation.cc:407] Connection header received
0806 09:20:34.643257 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:34.643261 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:34.643320 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:34.643433 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:34.644455 (+ 1022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:34.644461 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:34.644466 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:34.644497 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:34.644543 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:34.644558 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:34.644694 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:34.644878 (+ 184us) server_negotiation.cc:299] Negotiation successful
0806 09:20:34.644953 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 09:20:34.646226 1171 log.cc:824] T 00000000000000000000000000000000 P 0a8eb04268bb4216b7ae5a52274f964d: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:34.649711 1171 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0a8eb04268bb4216b7ae5a52274f964d: No bootstrap required, opened a new log
I20260806 09:20:34.658748 1171 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0a8eb04268bb4216b7ae5a52274f964d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a8eb04268bb4216b7ae5a52274f964d" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 44537 } }
I20260806 09:20:34.659198 1171 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0a8eb04268bb4216b7ae5a52274f964d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:20:34.659335 1171 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0a8eb04268bb4216b7ae5a52274f964d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a8eb04268bb4216b7ae5a52274f964d, State: Initialized, Role: FOLLOWER
I20260806 09:20:34.660059 1171 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0a8eb04268bb4216b7ae5a52274f964d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a8eb04268bb4216b7ae5a52274f964d" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 44537 } }
I20260806 09:20:34.660315 1171 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0a8eb04268bb4216b7ae5a52274f964d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:20:34.660492 1171 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0a8eb04268bb4216b7ae5a52274f964d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:20:34.660683 1171 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0a8eb04268bb4216b7ae5a52274f964d [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:34.663218 1171 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0a8eb04268bb4216b7ae5a52274f964d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a8eb04268bb4216b7ae5a52274f964d" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 44537 } }
I20260806 09:20:34.663961 1171 leader_election.cc:302] T 00000000000000000000000000000000 P 0a8eb04268bb4216b7ae5a52274f964d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0a8eb04268bb4216b7ae5a52274f964d; no voters:
I20260806 09:20:34.664779 1171 leader_election.cc:288] T 00000000000000000000000000000000 P 0a8eb04268bb4216b7ae5a52274f964d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:20:34.664880 1181 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0a8eb04268bb4216b7ae5a52274f964d [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:20:34.665655 1181 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0a8eb04268bb4216b7ae5a52274f964d [term 1 LEADER]: Becoming Leader. State: Replica: 0a8eb04268bb4216b7ae5a52274f964d, State: Running, Role: LEADER
I20260806 09:20:34.666354 1181 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0a8eb04268bb4216b7ae5a52274f964d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a8eb04268bb4216b7ae5a52274f964d" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 44537 } }
I20260806 09:20:34.667114 1171 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0a8eb04268bb4216b7ae5a52274f964d [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:20:34.670194 1182 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a8eb04268bb4216b7ae5a52274f964d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0a8eb04268bb4216b7ae5a52274f964d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a8eb04268bb4216b7ae5a52274f964d" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 44537 } } }
I20260806 09:20:34.670094 1183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0a8eb04268bb4216b7ae5a52274f964d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0a8eb04268bb4216b7ae5a52274f964d. Latest consensus state: current_term: 1 leader_uuid: "0a8eb04268bb4216b7ae5a52274f964d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0a8eb04268bb4216b7ae5a52274f964d" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 44537 } } }
I20260806 09:20:34.670686 1182 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a8eb04268bb4216b7ae5a52274f964d [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:34.670698 1183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0a8eb04268bb4216b7ae5a52274f964d [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:34.672999 1189 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:20:34.680414 1189 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:20:34.692498 1189 catalog_manager.cc:1347] Generated new cluster ID: ca04e538f6bc4b0a8d393bf58ff724d5
I20260806 09:20:34.692651 1189 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:20:34.709542 1189 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:20:34.710095 1189 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:20:34.725325 1189 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0a8eb04268bb4216b7ae5a52274f964d: Generated new TSK 0
I20260806 09:20:34.726615 1189 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:20:34.739784 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 1104
W20260806 09:20:34.741220 1166 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:48923
W20260806 09:20:34.742039 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 1104: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 09:20:34.742233 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 1104
2026-08-06T09:20:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2092 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:20:34 dist-test-slave-mvvj krb5kdc[1203](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:20:34 dist-test-slave-mvvj krb5kdc[1203](info): set up 2 sockets
Aug 06 09:20:34 dist-test-slave-mvvj krb5kdc[1203](info): commencing operation
krb5kdc: starting...
W20260806 09:20:35.943256 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.161s user 0.000s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:20:36 dist-test-slave-mvvj krb5kdc[1203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008036, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:20:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:20:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:20:36.264735 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:46159
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:42475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:46159
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:20:36.635619 1216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:36.636097 1216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:36.636268 1216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:36.644222 1216 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:36.644402 1216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:36.644523 1216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:36.644646 1216 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:36.644730 1216 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:36.655566 1216 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:42475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:46159
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:46159
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:36.657099 1216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:36.658547 1216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:36.672479 1221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:36.672514 1222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:36.672132 1224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:36.676847 1216 server_base.cc:1034] running on GCE node
I20260806 09:20:36.677927 1216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:36.680130 1216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:36.681582 1216 hybrid_clock.cc:648] HybridClock initialized: now 1786008036681529 us; error 54 us; skew 500 ppm
I20260806 09:20:36.682049 1216 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:20:36 dist-test-slave-mvvj krb5kdc[1203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008036, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:20:36.689616 1216 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:20:36.691562 1216 webserver.cc:460] Webserver started at http://127.10.255.126:39043/ using document root <none> and password file <none>
I20260806 09:20:36.692507 1216 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:36.692688 1216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:36.693065 1216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:36.696765 1216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "ca5dccc856a642cb9b5f2bff3ab7032e"
format_stamp: "Formatted at 2026-08-06 09:20:36 on dist-test-slave-mvvj"
server_key: "ad4e81fd8e055e8c14070d9bc6495ad8"
server_key_iv: "6779b7481d3bf510287887b1cca171e5"
server_key_version: "encryptionkey@0"
I20260806 09:20:36.697727 1216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "ca5dccc856a642cb9b5f2bff3ab7032e"
format_stamp: "Formatted at 2026-08-06 09:20:36 on dist-test-slave-mvvj"
server_key: "ad4e81fd8e055e8c14070d9bc6495ad8"
server_key_iv: "6779b7481d3bf510287887b1cca171e5"
server_key_version: "encryptionkey@0"
I20260806 09:20:36.704387 1216 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260806 09:20:36.709385 1231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:36.711582 1216 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260806 09:20:36.711952 1216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "ca5dccc856a642cb9b5f2bff3ab7032e"
format_stamp: "Formatted at 2026-08-06 09:20:36 on dist-test-slave-mvvj"
server_key: "ad4e81fd8e055e8c14070d9bc6495ad8"
server_key_iv: "6779b7481d3bf510287887b1cca171e5"
server_key_version: "encryptionkey@0"
I20260806 09:20:36.712239 1216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:36.735594 1216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:36.741107 1216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:36.741539 1216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:36.764156 1216 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:46159
I20260806 09:20:36.764190 1282 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:46159 every 8 connection(s)
I20260806 09:20:36.765823 1216 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:20:36.767525 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 1216
I20260806 09:20:36.767716 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:20:36.768318 11261 external_mini_cluster.cc:1428] Setting key 8764abd7a42f74a63e2d27b1ec6370f2
I20260806 09:20:36.771190 1283 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 06 09:20:36 dist-test-slave-mvvj krb5kdc[1203](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008036, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:20:36.783701 1283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca5dccc856a642cb9b5f2bff3ab7032e: Bootstrap starting.
I20260806 09:20:36.787573 1283 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca5dccc856a642cb9b5f2bff3ab7032e: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:36.788882 1283 log.cc:824] T 00000000000000000000000000000000 P ca5dccc856a642cb9b5f2bff3ab7032e: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:36.792914 1283 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca5dccc856a642cb9b5f2bff3ab7032e: No bootstrap required, opened a new log
I20260806 09:20:36.793812 1286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:36.770496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54231 (local address 127.10.255.126:46159)
0806 09:20:36.771439 (+ 943us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:36.771453 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:36.771508 (+ 55us) server_negotiation.cc:407] Connection header received
0806 09:20:36.773277 (+ 1769us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:36.773301 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:36.773782 (+ 481us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:36.774236 (+ 454us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:36.775915 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:36.777322 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:36.778749 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:36.779652 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:36.779917 (+ 265us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:36.784757 (+ 4840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:36.784768 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:36.784784 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:36.784831 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:36.788544 (+ 3713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:36.789500 (+ 956us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:36.789514 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:36.789525 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:36.789951 (+ 426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:36.790441 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:36.790450 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:36.790455 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:36.791124 (+ 669us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:36.791387 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:36.792057 (+ 670us) server_negotiation.cc:299] Negotiation successful
0806 09:20:36.792532 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":634,"thread_start_us":375,"threads_started":1}
I20260806 09:20:36.798920 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:20:36.802404 1283 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca5dccc856a642cb9b5f2bff3ab7032e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca5dccc856a642cb9b5f2bff3ab7032e" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 46159 } }
I20260806 09:20:36.802901 1283 raft_consensus.cc:374] T 00000000000000000000000000000000 P ca5dccc856a642cb9b5f2bff3ab7032e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:20:36.803021 1283 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca5dccc856a642cb9b5f2bff3ab7032e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca5dccc856a642cb9b5f2bff3ab7032e, State: Initialized, Role: FOLLOWER
I20260806 09:20:36.803759 1283 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca5dccc856a642cb9b5f2bff3ab7032e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca5dccc856a642cb9b5f2bff3ab7032e" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 46159 } }
I20260806 09:20:36.804148 1283 raft_consensus.cc:388] T 00000000000000000000000000000000 P ca5dccc856a642cb9b5f2bff3ab7032e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:20:36.804347 1283 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca5dccc856a642cb9b5f2bff3ab7032e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:20:36.804584 1283 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca5dccc856a642cb9b5f2bff3ab7032e [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:36.808990 1283 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca5dccc856a642cb9b5f2bff3ab7032e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca5dccc856a642cb9b5f2bff3ab7032e" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 46159 } }
I20260806 09:20:36.809736 1283 leader_election.cc:302] T 00000000000000000000000000000000 P ca5dccc856a642cb9b5f2bff3ab7032e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca5dccc856a642cb9b5f2bff3ab7032e; no voters:
I20260806 09:20:36.810549 1283 leader_election.cc:288] T 00000000000000000000000000000000 P ca5dccc856a642cb9b5f2bff3ab7032e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:20:36.810674 1293 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca5dccc856a642cb9b5f2bff3ab7032e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:20:36.812222 1293 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca5dccc856a642cb9b5f2bff3ab7032e [term 1 LEADER]: Becoming Leader. State: Replica: ca5dccc856a642cb9b5f2bff3ab7032e, State: Running, Role: LEADER
I20260806 09:20:36.813010 1293 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca5dccc856a642cb9b5f2bff3ab7032e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca5dccc856a642cb9b5f2bff3ab7032e" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 46159 } }
I20260806 09:20:36.813222 1283 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca5dccc856a642cb9b5f2bff3ab7032e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:20:36.816792 1294 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca5dccc856a642cb9b5f2bff3ab7032e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ca5dccc856a642cb9b5f2bff3ab7032e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca5dccc856a642cb9b5f2bff3ab7032e" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 46159 } } }
I20260806 09:20:36.817338 1294 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca5dccc856a642cb9b5f2bff3ab7032e [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:36.818156 1295 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca5dccc856a642cb9b5f2bff3ab7032e [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca5dccc856a642cb9b5f2bff3ab7032e. Latest consensus state: current_term: 1 leader_uuid: "ca5dccc856a642cb9b5f2bff3ab7032e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca5dccc856a642cb9b5f2bff3ab7032e" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 46159 } } }
I20260806 09:20:36.819099 1295 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca5dccc856a642cb9b5f2bff3ab7032e [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:36.822353 1299 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:20:36.828976 1286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:36.804427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54861 (local address 127.10.255.126:46159)
0806 09:20:36.804767 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:36.804777 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:36.805298 (+ 521us) server_negotiation.cc:407] Connection header received
0806 09:20:36.805701 (+ 403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:36.805706 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:36.805787 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:36.805898 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:36.808520 (+ 2622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:36.809535 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:36.811696 (+ 2161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:36.812448 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:36.812574 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:36.815944 (+ 3370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:36.815954 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:36.815964 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:36.816019 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:36.822765 (+ 6746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:36.824438 (+ 1673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:36.824446 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:36.824451 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:36.824905 (+ 454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:36.825946 (+ 1041us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:36.825956 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:36.825962 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:36.826691 (+ 729us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:36.827070 (+ 379us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:36.828013 (+ 943us) server_negotiation.cc:299] Negotiation successful
0806 09:20:36.828389 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260806 09:20:36.835505 1299 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:20:36.846565 1299 catalog_manager.cc:1347] Generated new cluster ID: 7e3a36dfd04f4d0da0400141d6d677ea
I20260806 09:20:36.846740 1299 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:20:36.876235 1299 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:20:36.878466 1299 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:20:36.889847 1299 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ca5dccc856a642cb9b5f2bff3ab7032e: Generated new TSK 0
I20260806 09:20:36.891322 1299 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:20:36.902017 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 1216
I20260806 09:20:36.903563 1278 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:20:37.003698 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 1216
2026-08-06T09:20:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2260 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:20:37 dist-test-slave-mvvj krb5kdc[1315](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:20:37 dist-test-slave-mvvj krb5kdc[1315](info): set up 2 sockets
Aug 06 09:20:37 dist-test-slave-mvvj krb5kdc[1315](info): commencing operation
krb5kdc: starting...
W20260806 09:20:38.199402 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.157s user 0.000s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:20:38 dist-test-slave-mvvj krb5kdc[1315](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008038, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:20:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:20:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:20:38.505630 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:33475
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:34033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:33475
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:20:38.894075 1328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:38.894418 1328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:38.894599 1328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:38.902586 1328 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:38.902733 1328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:38.902832 1328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:38.902956 1328 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:38.903023 1328 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:38.914463 1328 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:34033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:33475
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:33475
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:38.916178 1328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:38.917654 1328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:38.931751 1333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:38.931777 1334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:38.931886 1336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:38.933600 1328 server_base.cc:1034] running on GCE node
I20260806 09:20:38.934640 1328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:38.936426 1328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:38.937676 1328 hybrid_clock.cc:648] HybridClock initialized: now 1786008038937596 us; error 66 us; skew 500 ppm
I20260806 09:20:38.938095 1328 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:20:38 dist-test-slave-mvvj krb5kdc[1315](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008038, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:20:38.942144 1328 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:20:38.944245 1328 webserver.cc:460] Webserver started at http://127.10.255.126:41839/ using document root <none> and password file <none>
I20260806 09:20:38.945056 1328 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:38.945184 1328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:38.945700 1328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:38.949677 1328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "e51171f3bb244c45b321ab218417e7ea"
format_stamp: "Formatted at 2026-08-06 09:20:38 on dist-test-slave-mvvj"
server_key: "a5ae3abbc86aa82d16ce043b44dedf8e"
server_key_iv: "cc3d7d0fd46276418afabf730364660e"
server_key_version: "encryptionkey@0"
I20260806 09:20:38.950697 1328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "e51171f3bb244c45b321ab218417e7ea"
format_stamp: "Formatted at 2026-08-06 09:20:38 on dist-test-slave-mvvj"
server_key: "a5ae3abbc86aa82d16ce043b44dedf8e"
server_key_iv: "cc3d7d0fd46276418afabf730364660e"
server_key_version: "encryptionkey@0"
I20260806 09:20:38.957933 1328 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.004s
I20260806 09:20:38.962316 1343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:38.964147 1328 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:20:38.964414 1328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "e51171f3bb244c45b321ab218417e7ea"
format_stamp: "Formatted at 2026-08-06 09:20:38 on dist-test-slave-mvvj"
server_key: "a5ae3abbc86aa82d16ce043b44dedf8e"
server_key_iv: "cc3d7d0fd46276418afabf730364660e"
server_key_version: "encryptionkey@0"
I20260806 09:20:38.964741 1328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:38.983995 1328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:38.989971 1328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:38.990330 1328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:39.014320 1328 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:33475
I20260806 09:20:39.014353 1394 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:33475 every 8 connection(s)
I20260806 09:20:39.016306 1328 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:20:39.018302 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 1328
I20260806 09:20:39.018575 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:20:39.019145 11261 external_mini_cluster.cc:1428] Setting key 8f841091e24082073ce42e116ef4f5a4
I20260806 09:20:39.022061 1395 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:20:39.036388 1398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:39.021322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39361 (local address 127.10.255.126:33475)
0806 09:20:39.022287 (+ 965us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:39.022304 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:39.022358 (+ 54us) server_negotiation.cc:407] Connection header received
0806 09:20:39.024205 (+ 1847us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:39.024233 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:39.024689 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:39.025088 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:39.026008 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:39.028016 (+ 2008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:39.030312 (+ 2296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:39.031227 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:39.031409 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:39.032930 (+ 1521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:39.032939 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:39.032958 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:39.033635 (+ 677us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:39.033728 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:39.033768 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:39.033887 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:39.034191 (+ 304us) server_negotiation.cc:299] Negotiation successful
0806 09:20:39.034571 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":624,"thread_start_us":380,"threads_started":1}
I20260806 09:20:39.037046 1395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e51171f3bb244c45b321ab218417e7ea: Bootstrap starting.
I20260806 09:20:39.041129 1395 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e51171f3bb244c45b321ab218417e7ea: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:39.042095 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:20:39.043915 1395 log.cc:824] T 00000000000000000000000000000000 P e51171f3bb244c45b321ab218417e7ea: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:39.048321 1395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e51171f3bb244c45b321ab218417e7ea: No bootstrap required, opened a new log
I20260806 09:20:39.056775 1398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:39.048784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32821 (local address 127.10.255.126:33475)
0806 09:20:39.049063 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:39.049070 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:39.049556 (+ 486us) server_negotiation.cc:407] Connection header received
0806 09:20:39.049938 (+ 382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:39.049946 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:39.050026 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:39.050123 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:39.050819 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:39.051795 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:39.053816 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:39.054333 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:39.054461 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:39.055825 (+ 1364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:39.055904 (+ 79us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:39.055910 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:39.055945 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:39.055991 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:39.056010 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:39.056098 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:39.056284 (+ 186us) server_negotiation.cc:299] Negotiation successful
0806 09:20:39.056378 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260806 09:20:39.059078 1395 raft_consensus.cc:348] T 00000000000000000000000000000000 P e51171f3bb244c45b321ab218417e7ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e51171f3bb244c45b321ab218417e7ea" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 33475 } }
I20260806 09:20:39.059583 1395 raft_consensus.cc:374] T 00000000000000000000000000000000 P e51171f3bb244c45b321ab218417e7ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:20:39.059707 1395 raft_consensus.cc:729] T 00000000000000000000000000000000 P e51171f3bb244c45b321ab218417e7ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51171f3bb244c45b321ab218417e7ea, State: Initialized, Role: FOLLOWER
I20260806 09:20:39.060405 1395 consensus_queue.cc:260] T 00000000000000000000000000000000 P e51171f3bb244c45b321ab218417e7ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e51171f3bb244c45b321ab218417e7ea" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 33475 } }
I20260806 09:20:39.060686 1395 raft_consensus.cc:388] T 00000000000000000000000000000000 P e51171f3bb244c45b321ab218417e7ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:20:39.060849 1395 raft_consensus.cc:482] T 00000000000000000000000000000000 P e51171f3bb244c45b321ab218417e7ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:20:39.061048 1395 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e51171f3bb244c45b321ab218417e7ea [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:39.063711 1395 raft_consensus.cc:504] T 00000000000000000000000000000000 P e51171f3bb244c45b321ab218417e7ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e51171f3bb244c45b321ab218417e7ea" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 33475 } }
I20260806 09:20:39.064405 1395 leader_election.cc:302] T 00000000000000000000000000000000 P e51171f3bb244c45b321ab218417e7ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e51171f3bb244c45b321ab218417e7ea; no voters:
I20260806 09:20:39.065223 1395 leader_election.cc:288] T 00000000000000000000000000000000 P e51171f3bb244c45b321ab218417e7ea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:20:39.065577 1405 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e51171f3bb244c45b321ab218417e7ea [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:20:39.066807 1405 raft_consensus.cc:686] T 00000000000000000000000000000000 P e51171f3bb244c45b321ab218417e7ea [term 1 LEADER]: Becoming Leader. State: Replica: e51171f3bb244c45b321ab218417e7ea, State: Running, Role: LEADER
I20260806 09:20:39.067625 1405 consensus_queue.cc:237] T 00000000000000000000000000000000 P e51171f3bb244c45b321ab218417e7ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e51171f3bb244c45b321ab218417e7ea" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 33475 } }
I20260806 09:20:39.068230 1395 sys_catalog.cc:564] T 00000000000000000000000000000000 P e51171f3bb244c45b321ab218417e7ea [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:20:39.073272 1406 sys_catalog.cc:455] T 00000000000000000000000000000000 P e51171f3bb244c45b321ab218417e7ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e51171f3bb244c45b321ab218417e7ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e51171f3bb244c45b321ab218417e7ea" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 33475 } } }
I20260806 09:20:39.073825 1406 sys_catalog.cc:458] T 00000000000000000000000000000000 P e51171f3bb244c45b321ab218417e7ea [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:39.073568 1407 sys_catalog.cc:455] T 00000000000000000000000000000000 P e51171f3bb244c45b321ab218417e7ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader e51171f3bb244c45b321ab218417e7ea. Latest consensus state: current_term: 1 leader_uuid: "e51171f3bb244c45b321ab218417e7ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e51171f3bb244c45b321ab218417e7ea" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 33475 } } }
I20260806 09:20:39.074082 1407 sys_catalog.cc:458] T 00000000000000000000000000000000 P e51171f3bb244c45b321ab218417e7ea [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:39.077379 1415 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:20:39.082947 1415 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:20:39.095999 1415 catalog_manager.cc:1347] Generated new cluster ID: ec1bc2a8495e43b788a9c25ced50ca93
I20260806 09:20:39.096191 1415 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:20:39.107277 1415 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:20:39.109035 1415 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:20:39.125134 1415 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e51171f3bb244c45b321ab218417e7ea: Generated new TSK 0
I20260806 09:20:39.126199 1415 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:20:39.137063 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 1328
W20260806 09:20:39.140638 1390 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:39361
W20260806 09:20:39.142127 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 1328: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 09:20:39.142346 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 1328
2026-08-06T09:20:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2138 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:20:39 dist-test-slave-mvvj krb5kdc[1426](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:20:39 dist-test-slave-mvvj krb5kdc[1426](info): set up 2 sockets
Aug 06 09:20:39 dist-test-slave-mvvj krb5kdc[1426](info): commencing operation
krb5kdc: starting...
W20260806 09:20:40.299100 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.000s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:20:40 dist-test-slave-mvvj krb5kdc[1426](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008040, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:20:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:20:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:20:40.600772 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:40081
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:46835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:40081
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:20:40.982999 1439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:40.983361 1439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:40.983536 1439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:40.992774 1439 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:40.992930 1439 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:40.993026 1439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:40.993119 1439 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:40.993218 1439 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:41.004537 1439 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:46835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:40081
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:40081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:41.006146 1439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:41.007663 1439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:41.022383 1444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:41.022449 1445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:41.022421 1447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:41.023689 1439 server_base.cc:1034] running on GCE node
I20260806 09:20:41.024658 1439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:41.026270 1439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:41.027571 1439 hybrid_clock.cc:648] HybridClock initialized: now 1786008041027524 us; error 34 us; skew 500 ppm
I20260806 09:20:41.028200 1439 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:20:41 dist-test-slave-mvvj krb5kdc[1426](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008041, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:20:41.032182 1439 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:20:41.034126 1439 webserver.cc:460] Webserver started at http://127.10.255.126:33585/ using document root <none> and password file <none>
I20260806 09:20:41.034948 1439 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:41.035122 1439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:41.035491 1439 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:41.039042 1439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "91419368eee2468aba01c1dc1473c49f"
format_stamp: "Formatted at 2026-08-06 09:20:41 on dist-test-slave-mvvj"
server_key: "8c88f75c622c9df83aff7c2d5c6ecbd7"
server_key_iv: "bd58bb51cb2210cd04bf4f21a6558de7"
server_key_version: "encryptionkey@0"
I20260806 09:20:41.040073 1439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "91419368eee2468aba01c1dc1473c49f"
format_stamp: "Formatted at 2026-08-06 09:20:41 on dist-test-slave-mvvj"
server_key: "8c88f75c622c9df83aff7c2d5c6ecbd7"
server_key_iv: "bd58bb51cb2210cd04bf4f21a6558de7"
server_key_version: "encryptionkey@0"
I20260806 09:20:41.046744 1439 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260806 09:20:41.051753 1454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:41.053624 1439 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:20:41.053879 1439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "91419368eee2468aba01c1dc1473c49f"
format_stamp: "Formatted at 2026-08-06 09:20:41 on dist-test-slave-mvvj"
server_key: "8c88f75c622c9df83aff7c2d5c6ecbd7"
server_key_iv: "bd58bb51cb2210cd04bf4f21a6558de7"
server_key_version: "encryptionkey@0"
I20260806 09:20:41.054154 1439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:41.060956 1439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:41.066129 1439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:41.066524 1439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:41.087244 1439 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:40081
I20260806 09:20:41.087278 1505 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:40081 every 8 connection(s)
I20260806 09:20:41.088881 1439 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:20:41.092490 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 1439
I20260806 09:20:41.092677 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:20:41.093122 11261 external_mini_cluster.cc:1428] Setting key a6a2dd764806b7d210d556077644e1fd
I20260806 09:20:41.093636 1506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:20:41.101691 1509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:41.095132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46421 (local address 127.10.255.126:40081)
0806 09:20:41.096045 (+ 913us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:41.096057 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:41.096102 (+ 45us) server_negotiation.cc:407] Connection header received
0806 09:20:41.097670 (+ 1568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:41.097693 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:41.098070 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:41.098535 (+ 465us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:41.099710 (+ 1175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:41.099716 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:41.099730 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:41.099743 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:41.099818 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:41.099906 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:41.100187 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:41.100345 (+ 158us) server_negotiation.cc:299] Negotiation successful
0806 09:20:41.100592 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":370,"threads_started":1}
I20260806 09:20:41.106490 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:20:41.108758 1506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91419368eee2468aba01c1dc1473c49f: Bootstrap starting.
I20260806 09:20:41.112658 1506 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91419368eee2468aba01c1dc1473c49f: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:41.114032 1506 log.cc:824] T 00000000000000000000000000000000 P 91419368eee2468aba01c1dc1473c49f: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:41.114395 1509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:41.111491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35227 (local address 127.10.255.126:40081)
0806 09:20:41.111720 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:41.111727 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:41.112092 (+ 365us) server_negotiation.cc:407] Connection header received
0806 09:20:41.112329 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:41.112333 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:41.112388 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:41.112499 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:41.113578 (+ 1079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:41.113584 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:41.113588 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 09:20:41.113609 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:41.113655 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 09:20:41.113673 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:41.113814 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:41.113912 (+ 98us) server_negotiation.cc:299] Negotiation successful
0806 09:20:41.113989 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 09:20:41.117820 1506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91419368eee2468aba01c1dc1473c49f: No bootstrap required, opened a new log
I20260806 09:20:41.127391 1506 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91419368eee2468aba01c1dc1473c49f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91419368eee2468aba01c1dc1473c49f" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40081 } }
I20260806 09:20:41.128046 1506 raft_consensus.cc:374] T 00000000000000000000000000000000 P 91419368eee2468aba01c1dc1473c49f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 09:20:41.128188 1506 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91419368eee2468aba01c1dc1473c49f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91419368eee2468aba01c1dc1473c49f, State: Initialized, Role: FOLLOWER
I20260806 09:20:41.128782 1506 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91419368eee2468aba01c1dc1473c49f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91419368eee2468aba01c1dc1473c49f" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40081 } }
I20260806 09:20:41.128999 1506 raft_consensus.cc:388] T 00000000000000000000000000000000 P 91419368eee2468aba01c1dc1473c49f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 09:20:41.129117 1506 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91419368eee2468aba01c1dc1473c49f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 09:20:41.129261 1506 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91419368eee2468aba01c1dc1473c49f [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:41.131585 1506 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91419368eee2468aba01c1dc1473c49f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91419368eee2468aba01c1dc1473c49f" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40081 } }
I20260806 09:20:41.132222 1506 leader_election.cc:302] T 00000000000000000000000000000000 P 91419368eee2468aba01c1dc1473c49f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91419368eee2468aba01c1dc1473c49f; no voters:
I20260806 09:20:41.132856 1506 leader_election.cc:288] T 00000000000000000000000000000000 P 91419368eee2468aba01c1dc1473c49f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 09:20:41.133047 1516 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91419368eee2468aba01c1dc1473c49f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:20:41.133821 1516 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91419368eee2468aba01c1dc1473c49f [term 1 LEADER]: Becoming Leader. State: Replica: 91419368eee2468aba01c1dc1473c49f, State: Running, Role: LEADER
I20260806 09:20:41.134454 1516 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91419368eee2468aba01c1dc1473c49f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91419368eee2468aba01c1dc1473c49f" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40081 } }
I20260806 09:20:41.135334 1506 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91419368eee2468aba01c1dc1473c49f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:20:41.137472 1517 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91419368eee2468aba01c1dc1473c49f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "91419368eee2468aba01c1dc1473c49f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91419368eee2468aba01c1dc1473c49f" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40081 } } }
I20260806 09:20:41.138005 1517 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91419368eee2468aba01c1dc1473c49f [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:41.139918 1524 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:20:41.139945 1518 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91419368eee2468aba01c1dc1473c49f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91419368eee2468aba01c1dc1473c49f. Latest consensus state: current_term: 1 leader_uuid: "91419368eee2468aba01c1dc1473c49f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91419368eee2468aba01c1dc1473c49f" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 40081 } } }
I20260806 09:20:41.140307 1518 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91419368eee2468aba01c1dc1473c49f [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:41.145177 1524 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:20:41.154604 1524 catalog_manager.cc:1347] Generated new cluster ID: 5d3fc41df7864f9181667c5bf72140df
I20260806 09:20:41.154752 1524 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:20:41.179342 1524 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:20:41.179991 1524 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:20:41.192004 1524 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 91419368eee2468aba01c1dc1473c49f: Generated new TSK 0
I20260806 09:20:41.193118 1524 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 09:20:41.210417 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 1439
W20260806 09:20:41.211789 1501 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:46421
W20260806 09:20:41.212781 11261 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 1439: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260806 09:20:41.212952 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 1439
2026-08-06T09:20:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2070 ms)
[----------] 18 tests from AuthTokenIssuingTest (38401 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:20:41 dist-test-slave-mvvj krb5kdc[1537](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:20:41 dist-test-slave-mvvj krb5kdc[1537](info): set up 2 sockets
Aug 06 09:20:41 dist-test-slave-mvvj krb5kdc[1537](info): commencing operation
krb5kdc: starting...
W20260806 09:20:42.381072 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.003s sys 0.032s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:20:42 dist-test-slave-mvvj krb5kdc[1537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:20:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:20:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:20:42.697264 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:37029
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:45217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:37029,127.10.255.125:41411,127.10.255.124:41711
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:20:43.066491 1550 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 09:20:43.066905 1550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:43.067050 1550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:43.067198 1550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:43.074981 1550 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:43.075109 1550 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:43.075210 1550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:43.075294 1550 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:43.075407 1550 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:43.086134 1550 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:45217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:37029,127.10.255.125:41411,127.10.255.124:41711
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:37029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:43.087596 1550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:43.089130 1550 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:43.102305 1556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:43.102370 1559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:43.102305 1557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:43.103209 1550 server_base.cc:1034] running on GCE node
I20260806 09:20:43.104250 1550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:43.105850 1550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:43.107097 1550 hybrid_clock.cc:648] HybridClock initialized: now 1786008043107022 us; error 54 us; skew 500 ppm
I20260806 09:20:43.107420 1550 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:20:43 dist-test-slave-mvvj krb5kdc[1537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008043, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:20:43.117686 1550 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:20:43.120069 1550 webserver.cc:460] Webserver started at http://127.10.255.126:44401/ using document root <none> and password file <none>
I20260806 09:20:43.121026 1550 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:43.121178 1550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:43.121609 1550 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:43.125423 1550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "896178dd185047239d0f21ca3a490520"
format_stamp: "Formatted at 2026-08-06 09:20:43 on dist-test-slave-mvvj"
server_key: "8b371318f8ef7c9abfd4f19282c31be9"
server_key_iv: "6ef2fb25ad1a83ba5a8d853bbef8f721"
server_key_version: "encryptionkey@0"
I20260806 09:20:43.126761 1550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "896178dd185047239d0f21ca3a490520"
format_stamp: "Formatted at 2026-08-06 09:20:43 on dist-test-slave-mvvj"
server_key: "8b371318f8ef7c9abfd4f19282c31be9"
server_key_iv: "6ef2fb25ad1a83ba5a8d853bbef8f721"
server_key_version: "encryptionkey@0"
I20260806 09:20:43.133613 1550 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260806 09:20:43.138247 1566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:43.140143 1550 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:20:43.140391 1550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "896178dd185047239d0f21ca3a490520"
format_stamp: "Formatted at 2026-08-06 09:20:43 on dist-test-slave-mvvj"
server_key: "8b371318f8ef7c9abfd4f19282c31be9"
server_key_iv: "6ef2fb25ad1a83ba5a8d853bbef8f721"
server_key_version: "encryptionkey@0"
I20260806 09:20:43.140684 1550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:43.155951 1550 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:43.161170 1550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:43.161500 1550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:43.182421 1550 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:37029
I20260806 09:20:43.182440 1617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:37029 every 8 connection(s)
I20260806 09:20:43.184028 1550 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:20:43.188642 1618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:20:43.188850 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 1550
I20260806 09:20:43.189090 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:20:43.190002 11261 external_mini_cluster.cc:1428] Setting key a11d3932d2c556b095fedbb8a8e931c3
I20260806 09:20:43.200917 1618 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37029 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 09:20:43 dist-test-slave-mvvj krb5kdc[1537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008043, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.255.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.125@KRBTEST.COM" created.
I20260806 09:20:43.228967 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.205638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37029 (local address 127.0.0.1:40616)
0806 09:20:43.207010 (+ 1372us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:43.207052 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:43.209218 (+ 2166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:43.210291 (+ 1073us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:43.210300 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:43.211145 (+ 845us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:20:43.211531 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:43.211557 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:43.213436 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:43.213443 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:43.214684 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:43.214698 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:43.215802 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:43.215810 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:43.216057 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:43.216867 (+ 810us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:20:43.216894 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:20:43.219599 (+ 2705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:20:43.223893 (+ 4294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:43.223908 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:43.223922 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:43.224400 (+ 478us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:43.224892 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:43.224900 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:43.224906 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:43.225087 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:43.226037 (+ 950us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:20:43.226045 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:20:43.226305 (+ 260us) client_negotiation.cc:769] Sending connection context
0806 09:20:43.226594 (+ 289us) client_negotiation.cc:240] Negotiation successful
0806 09:20:43.227399 (+ 805us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1122,"mutex_wait_us":216,"thread_start_us":881,"threads_started":1}
I20260806 09:20:43.229012 1621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.205633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40616 (local address 127.10.255.126:37029)
0806 09:20:43.206636 (+ 1003us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:43.206659 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:43.207207 (+ 548us) server_negotiation.cc:407] Connection header received
0806 09:20:43.209697 (+ 2490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:43.209704 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:43.210011 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:43.210253 (+ 242us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:43.211804 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:43.213243 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:43.214852 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:43.215498 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:43.215752 (+ 254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:43.219951 (+ 4199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:43.219962 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:43.219978 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:43.220027 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:43.223690 (+ 3663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:43.224571 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:43.224581 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:43.224587 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:43.224762 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:43.225219 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:43.225232 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:43.225235 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:43.225861 (+ 626us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:43.226118 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:43.226753 (+ 635us) server_negotiation.cc:299] Negotiation successful
0806 09:20:43.227250 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":69,"server-negotiator.queue_time_us":691,"thread_start_us":420,"threads_started":1}
I20260806 09:20:43.233124 1618 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } has no permanent_uuid. Determining permanent_uuid...
I20260806 09:20:43.234798 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.234187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:41411 (local address 127.0.0.1:52726)
0806 09:20:43.234453 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:43.234612 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
W20260806 09:20:43.235189 1569 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.255.125:41411: connect: Connection refused (error 111)
I20260806 09:20:43.237197 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.236672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:41411 (local address 127.0.0.1:52732)
0806 09:20:43.236883 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:43.236983 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260806 09:20:43.237557 1618 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.125:41411: Network error: Client connection negotiation failed: client connection to 127.10.255.125:41411: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.125.keytab.
Entry for principal kudu/127.10.255.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.125.keytab.
I20260806 09:20:43.261049 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.125:41411
--webserver_interface=127.10.255.125
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.125.keytab
--principal=kudu/127.10.255.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:45217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:37029,127.10.255.125:41411,127.10.255.124:41711
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:20:43.287034 1618 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } attempt: 1
I20260806 09:20:43.288691 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.287960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:41411 (local address 127.0.0.1:52744)
0806 09:20:43.288268 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:43.288451 (+ 183us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260806 09:20:43.290025 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.289513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:41411 (local address 127.0.0.1:52750)
0806 09:20:43.289743 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:43.289845 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260806 09:20:43.290315 1618 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.125:41411: Network error: Client connection negotiation failed: client connection to 127.10.255.125:41411: connect: Connection refused (error 111)
I20260806 09:20:43.358610 1618 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } attempt: 2
I20260806 09:20:43.360142 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.359358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:41411 (local address 127.0.0.1:52766)
0806 09:20:43.359689 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:43.359824 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260806 09:20:43.361766 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.361227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:41411 (local address 127.0.0.1:52770)
0806 09:20:43.361440 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:43.361554 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260806 09:20:43.362080 1618 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.125:41411: Network error: Client connection negotiation failed: client connection to 127.10.255.125:41411: connect: Connection refused (error 111)
I20260806 09:20:43.453418 1618 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } attempt: 3
I20260806 09:20:43.454816 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.454261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:41411 (local address 127.0.0.1:52772)
0806 09:20:43.454513 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:43.454639 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260806 09:20:43.456563 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.456071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:41411 (local address 127.0.0.1:52778)
0806 09:20:43.456267 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:43.456372 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260806 09:20:43.456885 1618 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.125:41411: Network error: Client connection negotiation failed: client connection to 127.10.255.125:41411: connect: Connection refused (error 111)
I20260806 09:20:43.600159 1618 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } attempt: 4
I20260806 09:20:43.601686 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.600961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:41411 (local address 127.0.0.1:52790)
0806 09:20:43.601350 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:43.601480 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198}
I20260806 09:20:43.603042 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.602587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:41411 (local address 127.0.0.1:52802)
0806 09:20:43.602761 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:43.602867 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:41411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260806 09:20:43.603327 1618 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.125:41411: Network error: Client connection negotiation failed: client connection to 127.10.255.125:41411: connect: Connection refused (error 111)
W20260806 09:20:43.657668 1625 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 09:20:43.658062 1625 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:43.658236 1625 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:43.658398 1625 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:43.667405 1625 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:43.667565 1625 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:43.667675 1625 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:43.667801 1625 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:43.667944 1625 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:43.679502 1625 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:45217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:37029,127.10.255.125:41411,127.10.255.124:41711
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.125.keytab
--principal=kudu/127.10.255.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.125:41411
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.255.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:43.680984 1625 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:43.682402 1625 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:43.695914 1631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:43.696027 1633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:43.696027 1630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:43.697220 1625 server_base.cc:1034] running on GCE node
I20260806 09:20:43.698244 1625 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:43.700131 1625 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:43.701386 1625 hybrid_clock.cc:648] HybridClock initialized: now 1786008043701315 us; error 46 us; skew 500 ppm
I20260806 09:20:43.701782 1625 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:20:43 dist-test-slave-mvvj krb5kdc[1537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008043, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:20:43.705544 1625 init.cc:377] Logged in from keytab as kudu/127.10.255.125@KRBTEST.COM (short username kudu)
I20260806 09:20:43.707356 1625 webserver.cc:460] Webserver started at http://127.10.255.125:38409/ using document root <none> and password file <none>
I20260806 09:20:43.708242 1625 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:43.708388 1625 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:43.708766 1625 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:43.712148 1625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-1/data/instance:
uuid: "600dabdcdf1748cb8a9f5c6471a119d0"
format_stamp: "Formatted at 2026-08-06 09:20:43 on dist-test-slave-mvvj"
server_key: "098f7849143e0590e59ec6ac820bebe1"
server_key_iv: "2723d9fb6bf9c45963d9c2a847db174a"
server_key_version: "encryptionkey@0"
I20260806 09:20:43.713168 1625 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-1/wal/instance:
uuid: "600dabdcdf1748cb8a9f5c6471a119d0"
format_stamp: "Formatted at 2026-08-06 09:20:43 on dist-test-slave-mvvj"
server_key: "098f7849143e0590e59ec6ac820bebe1"
server_key_iv: "2723d9fb6bf9c45963d9c2a847db174a"
server_key_version: "encryptionkey@0"
I20260806 09:20:43.719625 1625 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260806 09:20:43.724649 1640 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:43.726593 1625 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:20:43.726867 1625 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-1/wal
uuid: "600dabdcdf1748cb8a9f5c6471a119d0"
format_stamp: "Formatted at 2026-08-06 09:20:43 on dist-test-slave-mvvj"
server_key: "098f7849143e0590e59ec6ac820bebe1"
server_key_iv: "2723d9fb6bf9c45963d9c2a847db174a"
server_key_version: "encryptionkey@0"
I20260806 09:20:43.727140 1625 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:43.755496 1625 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:43.760888 1625 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:43.761229 1625 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:43.784765 1625 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.125:41411
I20260806 09:20:43.784778 1691 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.125:41411 every 8 connection(s)
I20260806 09:20:43.786465 1625 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-1/data/info.pb
I20260806 09:20:43.790730 1692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:20:43.793700 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 1625
I20260806 09:20:43.793910 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-1/wal/instance
I20260806 09:20:43.794463 11261 external_mini_cluster.cc:1428] Setting key 23a552633e142fbacfb4ec86a821c1cb
I20260806 09:20:43.801304 1692 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37029 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 09:20:43 dist-test-slave-mvvj krb5kdc[1537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008043, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.125@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.255.124@KRBTEST.COM; defaulting to no policy
I20260806 09:20:43.829859 1694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.805409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40622 (local address 127.10.255.126:37029)
0806 09:20:43.806030 (+ 621us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:43.806039 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:43.807184 (+ 1145us) server_negotiation.cc:407] Connection header received
0806 09:20:43.810242 (+ 3058us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:43.810248 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:43.810332 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:43.810450 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:43.813034 (+ 2584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:43.813803 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:43.816508 (+ 2705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:43.816951 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:43.817079 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:43.821846 (+ 4767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:43.821852 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:43.821856 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:43.821907 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:43.826023 (+ 4116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:43.827048 (+ 1025us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:43.827058 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:43.827064 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:43.827247 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:43.827897 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:43.827904 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:43.827908 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:43.828288 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:43.828417 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:43.829313 (+ 896us) server_negotiation.cc:299] Negotiation successful
0806 09:20:43.829575 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":451,"thread_start_us":282,"threads_started":1}
I20260806 09:20:43.830834 1695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.806080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37029 (local address 127.0.0.1:40622)
0806 09:20:43.806979 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:43.807031 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:43.809832 (+ 2801us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:43.810800 (+ 968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:43.810818 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:43.811721 (+ 903us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:20:43.812718 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:43.812751 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:43.814004 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:43.814013 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:43.816296 (+ 2283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:43.816317 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:43.817237 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:43.817247 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:43.817631 (+ 384us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:43.818472 (+ 841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:20:43.818516 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:20:43.821494 (+ 2978us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:20:43.826257 (+ 4763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:43.826266 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:43.826283 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:43.826856 (+ 573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:43.827399 (+ 543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:43.827404 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:43.827406 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:43.827689 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:43.828447 (+ 758us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:20:43.828454 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:20:43.828894 (+ 440us) client_negotiation.cc:769] Sending connection context
0806 09:20:43.829153 (+ 259us) client_negotiation.cc:240] Negotiation successful
0806 09:20:43.829613 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":609,"thread_start_us":397,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.124@KRBTEST.COM" created.
I20260806 09:20:43.833176 1692 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 09:20:43 dist-test-slave-mvvj krb5kdc[1537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008043, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.125@KRBTEST.COM for kudu/127.10.255.125@KRBTEST.COM
I20260806 09:20:43.851356 1695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.834186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:41411 (local address 127.0.0.1:52812)
0806 09:20:43.834429 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:43.834451 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:43.834580 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:43.835339 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:43.835350 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:43.835951 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:20:43.836182 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:43.836197 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:43.837853 (+ 1656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:43.837861 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:43.839419 (+ 1558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:43.839438 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:43.840534 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:43.840540 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:43.840827 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:43.841551 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:20:43.841581 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:20:43.844407 (+ 2826us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:20:43.848652 (+ 4245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:43.848657 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:43.848661 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:43.849055 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:43.849457 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:43.849463 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:43.849466 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:43.849625 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:43.850276 (+ 651us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:20:43.850282 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:20:43.850438 (+ 156us) client_negotiation.cc:769] Sending connection context
0806 09:20:43.850598 (+ 160us) client_negotiation.cc:240] Negotiation successful
0806 09:20:43.850921 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69,"mutex_wait_us":35}
I20260806 09:20:43.851480 1697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.834202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52812 (local address 127.10.255.125:41411)
0806 09:20:43.834872 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:43.834879 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:43.834907 (+ 28us) server_negotiation.cc:407] Connection header received
0806 09:20:43.834972 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:43.834978 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:43.835171 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:43.835292 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:43.836392 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:43.837690 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:43.839596 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:43.840357 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:43.840530 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:43.844728 (+ 4198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:43.844749 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:43.844771 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:43.844811 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:43.848455 (+ 3644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:43.849208 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:43.849215 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:43.849218 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:43.849344 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:43.849730 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:43.849737 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:43.849741 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:43.850146 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:43.850386 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:43.850754 (+ 368us) server_negotiation.cc:299] Negotiation successful
0806 09:20:43.851051 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":514,"thread_start_us":356,"threads_started":1}
I20260806 09:20:43.854606 1692 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } has no permanent_uuid. Determining permanent_uuid...
I20260806 09:20:43.856191 1695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.855429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:41711 (local address 127.0.0.1:59430)
0806 09:20:43.855751 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:43.855927 (+ 176us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167}
W20260806 09:20:43.856455 1643 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
I20260806 09:20:43.859052 1695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.858628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:41711 (local address 127.0.0.1:59434)
0806 09:20:43.858834 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:43.858924 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260806 09:20:43.859306 1692 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:41711: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.124.keytab.
Entry for principal kudu/127.10.255.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.124.keytab.
I20260806 09:20:43.872623 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.124:41711
--webserver_interface=127.10.255.124
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.124.keytab
--principal=kudu/127.10.255.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:45217
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:37029,127.10.255.125:41411,127.10.255.124:41711
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:20:43.902765 1618 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } attempt: 5
I20260806 09:20:43.908630 1692 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } attempt: 1
I20260806 09:20:43.909967 1695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.909418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:41711 (local address 127.0.0.1:59450)
0806 09:20:43.909652 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:43.909772 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260806 09:20:43.911156 1695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.910713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:41711 (local address 127.0.0.1:59454)
0806 09:20:43.910896 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:43.910999 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260806 09:20:43.911602 1692 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:41711: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
Aug 06 09:20:43 dist-test-slave-mvvj krb5kdc[1537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008043, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for kudu/127.10.255.125@KRBTEST.COM
I20260806 09:20:43.919560 1697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.903957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52824 (local address 127.10.255.125:41411)
0806 09:20:43.904174 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:43.904181 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:43.904206 (+ 25us) server_negotiation.cc:407] Connection header received
0806 09:20:43.904320 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:43.904326 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:43.904430 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:43.904534 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:43.905356 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:43.906701 (+ 1345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:43.908228 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:43.908977 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:43.909112 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:43.913264 (+ 4152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:43.913272 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:43.913276 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:43.913322 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:43.916488 (+ 3166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:43.917349 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:43.917354 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:43.917356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:43.917560 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:43.917980 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:43.917991 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:43.917993 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:43.918350 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:43.918524 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:43.918953 (+ 429us) server_negotiation.cc:299] Negotiation successful
0806 09:20:43.919207 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 09:20:43.919566 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.903662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:41411 (local address 127.0.0.1:52824)
0806 09:20:43.904061 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:43.904081 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:43.904199 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:43.904596 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:43.904599 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:43.905006 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:20:43.905189 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:43.905198 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:43.906885 (+ 1687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:43.906891 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:43.908026 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:43.908044 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:43.909177 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:43.909185 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:43.909532 (+ 347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:43.910424 (+ 892us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:20:43.910443 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:20:43.912929 (+ 2486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:20:43.916751 (+ 3822us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:43.916755 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:43.916758 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:43.917192 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:43.917694 (+ 502us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:43.917699 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:43.917703 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:43.917854 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:43.918486 (+ 632us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:20:43.918491 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:20:43.918669 (+ 178us) client_negotiation.cc:769] Sending connection context
0806 09:20:43.918812 (+ 143us) client_negotiation.cc:240] Negotiation successful
0806 09:20:43.919189 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225}
I20260806 09:20:43.920828 1618 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } has no permanent_uuid. Determining permanent_uuid...
I20260806 09:20:43.922106 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.921609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:41711 (local address 127.0.0.1:59456)
0806 09:20:43.921849 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:43.921933 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126}
I20260806 09:20:43.923285 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.922809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:41711 (local address 127.0.0.1:59472)
0806 09:20:43.923031 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:43.923131 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260806 09:20:43.923600 1618 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:41711: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
I20260806 09:20:43.974895 1618 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } attempt: 1
I20260806 09:20:43.976270 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.975767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:41711 (local address 127.0.0.1:59476)
0806 09:20:43.975993 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:43.976096 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260806 09:20:43.977571 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.977163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:41711 (local address 127.0.0.1:59478)
0806 09:20:43.977362 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:43.977440 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260806 09:20:43.977872 1618 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:41711: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
I20260806 09:20:43.979887 1692 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } attempt: 2
I20260806 09:20:43.981120 1695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.980595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:41711 (local address 127.0.0.1:59492)
0806 09:20:43.980806 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:43.980925 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260806 09:20:43.982272 1695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:43.981870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:41711 (local address 127.0.0.1:59496)
0806 09:20:43.982033 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:43.982123 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260806 09:20:43.982504 1692 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:41711: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
I20260806 09:20:44.046111 1618 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } attempt: 2
I20260806 09:20:44.047413 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.046816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:41711 (local address 127.0.0.1:59504)
0806 09:20:44.047082 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:44.047198 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260806 09:20:44.048600 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.048201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:41711 (local address 127.0.0.1:59518)
0806 09:20:44.048369 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:44.048461 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260806 09:20:44.048888 1618 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:41711: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
I20260806 09:20:44.073762 1692 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } attempt: 3
I20260806 09:20:44.075263 1695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.074599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:41711 (local address 127.0.0.1:59526)
0806 09:20:44.074866 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:44.075016 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260806 09:20:44.076689 1695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.076126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:41711 (local address 127.0.0.1:59538)
0806 09:20:44.076408 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:44.076518 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146}
W20260806 09:20:44.076985 1692 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:41711: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
I20260806 09:20:44.155164 1618 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } attempt: 3
I20260806 09:20:44.156553 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.156033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:41711 (local address 127.0.0.1:59552)
0806 09:20:44.156270 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:44.156364 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260806 09:20:44.157719 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.157357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:41711 (local address 127.0.0.1:59568)
0806 09:20:44.157516 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:44.157603 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260806 09:20:44.158005 1618 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:41711: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
I20260806 09:20:44.220216 1692 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } attempt: 4
I20260806 09:20:44.221657 1695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.220983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:41711 (local address 127.0.0.1:59570)
0806 09:20:44.221272 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:44.221411 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260806 09:20:44.223112 1695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.222605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:41711 (local address 127.0.0.1:59572)
0806 09:20:44.222812 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:44.222937 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260806 09:20:44.223714 1692 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:41711: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
W20260806 09:20:44.255976 1700 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 09:20:44.256410 1700 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:44.256541 1700 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:44.256700 1700 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:44.266516 1700 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:44.266674 1700 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:44.266776 1700 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:44.266870 1700 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:44.266961 1700 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:44.278115 1700 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:45217
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:37029,127.10.255.125:41411,127.10.255.124:41711
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.124.keytab
--principal=kudu/127.10.255.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.124:41711
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.255.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:44.279656 1700 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:44.281216 1700 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:44.294145 1705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:44.294195 1708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:44.294224 1706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:44.295835 1700 server_base.cc:1034] running on GCE node
I20260806 09:20:44.296907 1700 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:44.298836 1700 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:44.300122 1700 hybrid_clock.cc:648] HybridClock initialized: now 1786008044300003 us; error 85 us; skew 500 ppm
I20260806 09:20:44.300549 1700 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:20:44 dist-test-slave-mvvj krb5kdc[1537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008044, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:20:44.304500 1700 init.cc:377] Logged in from keytab as kudu/127.10.255.124@KRBTEST.COM (short username kudu)
I20260806 09:20:44.306521 1700 webserver.cc:460] Webserver started at http://127.10.255.124:42431/ using document root <none> and password file <none>
I20260806 09:20:44.307405 1700 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:44.307559 1700 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:44.308024 1700 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:44.311482 1700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-2/data/instance:
uuid: "64f64d3081f04ff1b09a47dad0287d74"
format_stamp: "Formatted at 2026-08-06 09:20:44 on dist-test-slave-mvvj"
server_key: "b5f5be57cf65c9a51e44ccca42cd426e"
server_key_iv: "8dd588c7f90ee55fdf725476a5005db3"
server_key_version: "encryptionkey@0"
I20260806 09:20:44.312515 1700 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-2/wal/instance:
uuid: "64f64d3081f04ff1b09a47dad0287d74"
format_stamp: "Formatted at 2026-08-06 09:20:44 on dist-test-slave-mvvj"
server_key: "b5f5be57cf65c9a51e44ccca42cd426e"
server_key_iv: "8dd588c7f90ee55fdf725476a5005db3"
server_key_version: "encryptionkey@0"
I20260806 09:20:44.319903 1700 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s
I20260806 09:20:44.324831 1715 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:44.326653 1700 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260806 09:20:44.326910 1700 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-2/wal
uuid: "64f64d3081f04ff1b09a47dad0287d74"
format_stamp: "Formatted at 2026-08-06 09:20:44 on dist-test-slave-mvvj"
server_key: "b5f5be57cf65c9a51e44ccca42cd426e"
server_key_iv: "8dd588c7f90ee55fdf725476a5005db3"
server_key_version: "encryptionkey@0"
I20260806 09:20:44.327198 1700 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:44.335232 1618 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } attempt: 4
I20260806 09:20:44.336495 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.336052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:41711 (local address 127.0.0.1:59574)
0806 09:20:44.336244 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:44.336344 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260806 09:20:44.337756 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.337325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:41711 (local address 127.0.0.1:59588)
0806 09:20:44.337496 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:44.337608 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260806 09:20:44.337997 1618 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:41711: Network error: Client connection negotiation failed: client connection to 127.10.255.124:41711: connect: Connection refused (error 111)
I20260806 09:20:44.356138 1700 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:44.360749 1700 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:44.361058 1700 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:44.381841 1700 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.124:41711
I20260806 09:20:44.381891 1766 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.124:41711 every 8 connection(s)
I20260806 09:20:44.383396 1700 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-2/data/info.pb
I20260806 09:20:44.383765 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 1700
I20260806 09:20:44.383993 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786007647474472-11261-0/minicluster-data/master-2/wal/instance
I20260806 09:20:44.384704 11261 external_mini_cluster.cc:1428] Setting key 9fdf947de54fe38f346ee6e068e76844
I20260806 09:20:44.388525 1767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:20:44.396149 1767 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37029 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 09:20:44 dist-test-slave-mvvj krb5kdc[1537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.124@KRBTEST.COM
Aug 06 09:20:44 dist-test-slave-mvvj krb5kdc[1537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008044, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.124@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:20:44.411224 1770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.387088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59600 (local address 127.10.255.124:41711)
0806 09:20:44.388214 (+ 1126us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:44.388228 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:44.388274 (+ 46us) server_negotiation.cc:407] Connection header received
0806 09:20:44.390114 (+ 1840us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:44.390137 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:44.390556 (+ 419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:44.391021 (+ 465us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:44.392846 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.394438 (+ 1592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.395997 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.396881 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.397131 (+ 250us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:44.402472 (+ 5341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:44.402480 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:44.402491 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:44.402534 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:44.405796 (+ 3262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:44.406848 (+ 1052us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:44.406856 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:44.406864 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:44.407087 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:44.407575 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:44.407579 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:44.407581 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:44.408263 (+ 682us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:44.408626 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:44.409110 (+ 484us) server_negotiation.cc:299] Negotiation successful
0806 09:20:44.409679 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":897,"thread_start_us":557,"threads_started":1}
I20260806 09:20:44.417189 1771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.399120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40632 (local address 127.10.255.126:37029)
0806 09:20:44.399702 (+ 582us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:44.399712 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:44.400352 (+ 640us) server_negotiation.cc:407] Connection header received
0806 09:20:44.400570 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:44.400576 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:44.400669 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:44.400769 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:44.402193 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.403054 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.404858 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.405335 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.405503 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:44.409629 (+ 4126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:44.409636 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:44.409640 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:44.409700 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:44.413263 (+ 3563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:44.414462 (+ 1199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:44.414470 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:44.414474 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:44.414671 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:44.415303 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:44.415307 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:44.415309 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:44.415764 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:44.416009 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:44.416611 (+ 602us) server_negotiation.cc:299] Negotiation successful
0806 09:20:44.416871 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":272,"threads_started":1}
I20260806 09:20:44.417222 1772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.399114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:37029 (local address 127.0.0.1:40632)
0806 09:20:44.400187 (+ 1073us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:44.400234 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:44.400416 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:44.400884 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:44.400894 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:44.401721 (+ 827us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:20:44.402007 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:44.402018 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.403252 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.403257 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:44.404671 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:44.404688 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.405594 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.405602 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:44.405794 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:44.406537 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:20:44.406570 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:20:44.409326 (+ 2756us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:20:44.413424 (+ 4098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:44.413435 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:44.413442 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:44.414237 (+ 795us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:44.414904 (+ 667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:44.414909 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:44.414913 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:44.415118 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:44.416019 (+ 901us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:20:44.416026 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:20:44.416199 (+ 173us) client_negotiation.cc:769] Sending connection context
0806 09:20:44.416360 (+ 161us) client_negotiation.cc:240] Negotiation successful
0806 09:20:44.416751 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":791,"thread_start_us":564,"threads_started":1}
I20260806 09:20:44.418759 1767 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 09:20:44 dist-test-slave-mvvj krb5kdc[1537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
Aug 06 09:20:44 dist-test-slave-mvvj krb5kdc[1537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008044, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.124@KRBTEST.COM for kudu/127.10.255.125@KRBTEST.COM
I20260806 09:20:44.434012 1773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.415242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40634 (local address 127.10.255.126:37029)
0806 09:20:44.416157 (+ 915us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:44.416161 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:44.416205 (+ 44us) server_negotiation.cc:407] Connection header received
0806 09:20:44.416248 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:44.416252 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:44.416309 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:44.416441 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:44.418235 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.419280 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.421054 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.421623 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.421729 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:44.426782 (+ 5053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:44.426789 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:44.426792 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:44.426830 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:44.430334 (+ 3504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:44.431379 (+ 1045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:44.431383 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:44.431386 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:44.431535 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:44.432088 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:44.432092 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:44.432095 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:44.432552 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:44.432844 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:44.433286 (+ 442us) server_negotiation.cc:299] Negotiation successful
0806 09:20:44.433570 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":685,"thread_start_us":378,"threads_started":1}
I20260806 09:20:44.434365 1772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.419671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:41411 (local address 127.0.0.1:52838)
0806 09:20:44.420009 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:44.420027 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:44.420122 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:44.420438 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:44.420442 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:44.420822 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:20:44.421054 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:44.421068 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.422293 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.422323 (+ 30us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:44.423473 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:44.423489 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.424746 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.424751 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:44.424915 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:44.425514 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:20:44.425533 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:20:44.427838 (+ 2305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:20:44.431591 (+ 3753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:44.431597 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:44.431601 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:44.432162 (+ 561us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:44.432637 (+ 475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:44.432642 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:44.432646 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:44.432803 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:44.433365 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:20:44.433371 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:20:44.433546 (+ 175us) client_negotiation.cc:769] Sending connection context
0806 09:20:44.433682 (+ 136us) client_negotiation.cc:240] Negotiation successful
0806 09:20:44.434006 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224}
I20260806 09:20:44.434887 1697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.419671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52838 (local address 127.10.255.125:41411)
0806 09:20:44.419906 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:44.419966 (+ 60us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:44.420094 (+ 128us) server_negotiation.cc:407] Connection header received
0806 09:20:44.420215 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:44.420221 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:44.420300 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:44.420397 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:44.421238 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.422114 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.423648 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.424567 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.424728 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:44.428090 (+ 3362us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:44.428095 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:44.428098 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:44.428133 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:44.431448 (+ 3315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:44.432287 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:44.432294 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:44.432298 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:44.432522 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:44.432941 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:44.432951 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:44.432953 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:44.433243 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:44.433403 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:44.433806 (+ 403us) server_negotiation.cc:299] Negotiation successful
0806 09:20:44.434026 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260806 09:20:44.436141 1767 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 09:20:44 dist-test-slave-mvvj krb5kdc[1537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008044, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.124@KRBTEST.COM for kudu/127.10.255.124@KRBTEST.COM
Aug 06 09:20:44 dist-test-slave-mvvj krb5kdc[1537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.125@KRBTEST.COM
I20260806 09:20:44.450888 1772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.436887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:41711 (local address 127.0.0.1:59602)
0806 09:20:44.437054 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:44.437073 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:44.437182 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:44.437469 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:44.437473 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:44.437873 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:20:44.438040 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:44.438053 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.439082 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.439087 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:44.440054 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:44.440066 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.440812 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.440818 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:44.441039 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:44.441728 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:20:44.441745 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:20:44.444197 (+ 2452us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:20:44.448099 (+ 3902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:44.448105 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:44.448109 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:44.448704 (+ 595us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:44.449130 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:44.449135 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:44.449140 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:44.449321 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:44.449850 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:20:44.449858 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:20:44.450056 (+ 198us) client_negotiation.cc:769] Sending connection context
0806 09:20:44.450238 (+ 182us) client_negotiation.cc:240] Negotiation successful
0806 09:20:44.450591 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260806 09:20:44.451303 1770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.436963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59602 (local address 127.10.255.124:41711)
0806 09:20:44.437104 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:44.437112 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:44.437129 (+ 17us) server_negotiation.cc:407] Connection header received
0806 09:20:44.437288 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:44.437293 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:44.437357 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:44.437450 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:44.438193 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.438893 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.440197 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.440637 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.440734 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:44.444442 (+ 3708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:44.444449 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:44.444454 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:44.444668 (+ 214us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:44.447910 (+ 3242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:44.448851 (+ 941us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:44.448856 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:44.448858 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:44.448994 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:44.449435 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:44.449439 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:44.449441 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:44.449748 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:44.449863 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:44.450369 (+ 506us) server_negotiation.cc:299] Negotiation successful
0806 09:20:44.450855 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":106,"server-negotiator.queue_time_us":52}
I20260806 09:20:44.453675 1697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.435939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52852 (local address 127.10.255.125:41411)
0806 09:20:44.436091 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:44.436098 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:44.436148 (+ 50us) server_negotiation.cc:407] Connection header received
0806 09:20:44.436376 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:44.436382 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:44.436460 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:44.436567 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:44.438071 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.438868 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.440243 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.440663 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.440812 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:44.446264 (+ 5452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:44.446271 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:44.446274 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:44.446312 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:44.449619 (+ 3307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:44.450644 (+ 1025us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:44.450651 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:44.450655 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:44.450876 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:44.451718 (+ 842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:44.451724 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:44.451727 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:44.452122 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:44.452451 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:44.452861 (+ 410us) server_negotiation.cc:299] Negotiation successful
0806 09:20:44.453165 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 09:20:44.457571 1767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64f64d3081f04ff1b09a47dad0287d74: Bootstrap starting.
I20260806 09:20:44.460909 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:20:44.461539 1767 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64f64d3081f04ff1b09a47dad0287d74: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:44.462740 1767 log.cc:824] T 00000000000000000000000000000000 P 64f64d3081f04ff1b09a47dad0287d74: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:44.466127 1767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64f64d3081f04ff1b09a47dad0287d74: No bootstrap required, opened a new log
I20260806 09:20:44.464133 1593 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "896178dd185047239d0f21ca3a490520"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40634
I20260806 09:20:44.473948 1767 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64f64d3081f04ff1b09a47dad0287d74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896178dd185047239d0f21ca3a490520" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37029 } } peers { permanent_uuid: "600dabdcdf1748cb8a9f5c6471a119d0" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } } peers { permanent_uuid: "64f64d3081f04ff1b09a47dad0287d74" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } }
I20260806 09:20:44.474340 1767 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64f64d3081f04ff1b09a47dad0287d74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64f64d3081f04ff1b09a47dad0287d74, State: Initialized, Role: FOLLOWER
I20260806 09:20:44.474855 1767 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64f64d3081f04ff1b09a47dad0287d74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896178dd185047239d0f21ca3a490520" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37029 } } peers { permanent_uuid: "600dabdcdf1748cb8a9f5c6471a119d0" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } } peers { permanent_uuid: "64f64d3081f04ff1b09a47dad0287d74" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } }
I20260806 09:20:44.476002 1775 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64f64d3081f04ff1b09a47dad0287d74 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896178dd185047239d0f21ca3a490520" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37029 } } peers { permanent_uuid: "600dabdcdf1748cb8a9f5c6471a119d0" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } } peers { permanent_uuid: "64f64d3081f04ff1b09a47dad0287d74" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } } }
I20260806 09:20:44.476471 1775 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64f64d3081f04ff1b09a47dad0287d74 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:20:44.477057 1767 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64f64d3081f04ff1b09a47dad0287d74 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 09:20:44.487941 1786 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 64f64d3081f04ff1b09a47dad0287d74: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 09:20:44.488101 1786 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 09:20:44.485220 1700 master_runner.cc:186] Error getting master registration for 127.10.255.126:37029: OK, instance_id { permanent_uuid: "896178dd185047239d0f21ca3a490520" instance_seqno: 1786008043176391 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 09:20:44.497677 1700 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 09:20:44.523017 1692 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } attempt: 5
Aug 06 09:20:44 dist-test-slave-mvvj krb5kdc[1537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008043, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.125@KRBTEST.COM for kudu/127.10.255.124@KRBTEST.COM
I20260806 09:20:44.542232 1695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.523933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:41711 (local address 127.0.0.1:59606)
0806 09:20:44.524134 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:44.524155 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:44.524283 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:44.524894 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:44.524901 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:44.525513 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:20:44.525773 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:44.525789 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.527502 (+ 1713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.527510 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:44.529307 (+ 1797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:44.529335 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.530671 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.530680 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:44.530988 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:44.531820 (+ 832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:20:44.531889 (+ 69us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:20:44.535304 (+ 3415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:20:44.539355 (+ 4051us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:44.539362 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:44.539366 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:44.539797 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:44.540273 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:44.540278 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:44.540282 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:44.540480 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:44.541096 (+ 616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:20:44.541101 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:20:44.541288 (+ 187us) client_negotiation.cc:769] Sending connection context
0806 09:20:44.541442 (+ 154us) client_negotiation.cc:240] Negotiation successful
0806 09:20:44.541809 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260806 09:20:44.542240 1770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.524008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59606 (local address 127.10.255.124:41711)
0806 09:20:44.524561 (+ 553us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:44.524565 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:44.524582 (+ 17us) server_negotiation.cc:407] Connection header received
0806 09:20:44.524640 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:44.524644 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:44.524707 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:44.524822 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:44.525974 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.527275 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.529522 (+ 2247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.530385 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.530550 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:44.535580 (+ 5030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:44.535589 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:44.535594 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:44.535644 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:44.539133 (+ 3489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:44.539976 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:44.539982 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:44.539986 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:44.540137 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:44.540609 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:44.540614 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:44.540618 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:44.540967 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:44.541168 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:44.541594 (+ 426us) server_negotiation.cc:299] Negotiation successful
0806 09:20:44.541827 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354}
I20260806 09:20:44.549733 1692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 600dabdcdf1748cb8a9f5c6471a119d0: Bootstrap starting.
I20260806 09:20:44.555161 1692 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 600dabdcdf1748cb8a9f5c6471a119d0: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:44.556803 1692 log.cc:824] T 00000000000000000000000000000000 P 600dabdcdf1748cb8a9f5c6471a119d0: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:44.560895 1692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 600dabdcdf1748cb8a9f5c6471a119d0: No bootstrap required, opened a new log
I20260806 09:20:44.574265 1692 raft_consensus.cc:348] T 00000000000000000000000000000000 P 600dabdcdf1748cb8a9f5c6471a119d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896178dd185047239d0f21ca3a490520" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37029 } } peers { permanent_uuid: "600dabdcdf1748cb8a9f5c6471a119d0" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } } peers { permanent_uuid: "64f64d3081f04ff1b09a47dad0287d74" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } }
I20260806 09:20:44.574808 1692 raft_consensus.cc:729] T 00000000000000000000000000000000 P 600dabdcdf1748cb8a9f5c6471a119d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 600dabdcdf1748cb8a9f5c6471a119d0, State: Initialized, Role: FOLLOWER
I20260806 09:20:44.575500 1692 consensus_queue.cc:260] T 00000000000000000000000000000000 P 600dabdcdf1748cb8a9f5c6471a119d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896178dd185047239d0f21ca3a490520" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37029 } } peers { permanent_uuid: "600dabdcdf1748cb8a9f5c6471a119d0" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } } peers { permanent_uuid: "64f64d3081f04ff1b09a47dad0287d74" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } }
I20260806 09:20:44.576947 1789 sys_catalog.cc:455] T 00000000000000000000000000000000 P 600dabdcdf1748cb8a9f5c6471a119d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896178dd185047239d0f21ca3a490520" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37029 } } peers { permanent_uuid: "600dabdcdf1748cb8a9f5c6471a119d0" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } } peers { permanent_uuid: "64f64d3081f04ff1b09a47dad0287d74" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } } }
I20260806 09:20:44.577433 1789 sys_catalog.cc:458] T 00000000000000000000000000000000 P 600dabdcdf1748cb8a9f5c6471a119d0 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:20:44.578704 1692 sys_catalog.cc:564] T 00000000000000000000000000000000 P 600dabdcdf1748cb8a9f5c6471a119d0 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 09:20:44.590910 1800 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 600dabdcdf1748cb8a9f5c6471a119d0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 09:20:44.591203 1800 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 09:20:44.587582 1625 master_runner.cc:186] Error getting master registration for 127.10.255.126:37029: OK, instance_id { permanent_uuid: "896178dd185047239d0f21ca3a490520" instance_seqno: 1786008043176391 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 09:20:44.601150 1625 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260806 09:20:44.613559 1721 tablet.cc:2369] T 00000000000000000000000000000000 P 64f64d3081f04ff1b09a47dad0287d74: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:20:44.615197 1618 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } attempt: 5
Aug 06 09:20:44 dist-test-slave-mvvj krb5kdc[1537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008043, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for kudu/127.10.255.124@KRBTEST.COM
I20260806 09:20:44.633690 1770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.616135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59614 (local address 127.10.255.124:41711)
0806 09:20:44.616347 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:44.616354 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:44.616477 (+ 123us) server_negotiation.cc:407] Connection header received
0806 09:20:44.616723 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:44.616729 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:44.616810 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:44.616925 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:44.618023 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.618829 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.620780 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.621292 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.621459 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:44.625549 (+ 4090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:44.625555 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:44.625559 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:44.625603 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:44.630043 (+ 4440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:44.630975 (+ 932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:44.630982 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:44.630985 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:44.631179 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:44.631800 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:44.631806 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:44.631810 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:44.632242 (+ 432us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:44.632641 (+ 399us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:44.633028 (+ 387us) server_negotiation.cc:299] Negotiation successful
0806 09:20:44.633299 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 09:20:44.633685 1622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.616067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:41711 (local address 127.0.0.1:59614)
0806 09:20:44.616360 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:44.616383 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:44.616538 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:44.616991 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:44.616997 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:44.617589 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:20:44.617820 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:44.617835 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.619000 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.619008 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:44.620614 (+ 1606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:44.620632 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.621472 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.621478 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:44.621686 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:44.622431 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:20:44.622453 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:20:44.625216 (+ 2763us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:20:44.630263 (+ 5047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:44.630270 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:44.630274 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:44.630806 (+ 532us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:44.631309 (+ 503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:44.631314 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:44.631318 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:44.631645 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:44.632417 (+ 772us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:20:44.632422 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:20:44.632638 (+ 216us) client_negotiation.cc:769] Sending connection context
0806 09:20:44.632879 (+ 241us) client_negotiation.cc:240] Negotiation successful
0806 09:20:44.633231 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180}
I20260806 09:20:44.641111 1618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520: Bootstrap starting.
I20260806 09:20:44.646004 1618 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:44.647643 1618 log.cc:824] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:44.655485 1618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520: No bootstrap required, opened a new log
I20260806 09:20:44.664266 1618 raft_consensus.cc:348] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896178dd185047239d0f21ca3a490520" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37029 } } peers { permanent_uuid: "600dabdcdf1748cb8a9f5c6471a119d0" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } } peers { permanent_uuid: "64f64d3081f04ff1b09a47dad0287d74" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } }
I20260806 09:20:44.664940 1618 raft_consensus.cc:729] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 896178dd185047239d0f21ca3a490520, State: Initialized, Role: FOLLOWER
I20260806 09:20:44.665697 1618 consensus_queue.cc:260] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896178dd185047239d0f21ca3a490520" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37029 } } peers { permanent_uuid: "600dabdcdf1748cb8a9f5c6471a119d0" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } } peers { permanent_uuid: "64f64d3081f04ff1b09a47dad0287d74" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } }
I20260806 09:20:44.667146 1803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896178dd185047239d0f21ca3a490520" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37029 } } peers { permanent_uuid: "600dabdcdf1748cb8a9f5c6471a119d0" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } } peers { permanent_uuid: "64f64d3081f04ff1b09a47dad0287d74" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } } }
I20260806 09:20:44.668020 1803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:20:44.668833 1618 sys_catalog.cc:564] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:20:44.668834 1593 raft_consensus.cc:482] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 09:20:44.669154 1593 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:44.673931 1593 raft_consensus.cc:504] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896178dd185047239d0f21ca3a490520" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37029 } } peers { permanent_uuid: "600dabdcdf1748cb8a9f5c6471a119d0" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } } peers { permanent_uuid: "64f64d3081f04ff1b09a47dad0287d74" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } }
I20260806 09:20:44.677611 1667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "896178dd185047239d0f21ca3a490520" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "600dabdcdf1748cb8a9f5c6471a119d0"
I20260806 09:20:44.678647 1667 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 600dabdcdf1748cb8a9f5c6471a119d0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:44.684909 1667 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 600dabdcdf1748cb8a9f5c6471a119d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896178dd185047239d0f21ca3a490520 in term 1.
I20260806 09:20:44.686546 1569 leader_election.cc:302] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 600dabdcdf1748cb8a9f5c6471a119d0, 896178dd185047239d0f21ca3a490520; no voters:
I20260806 09:20:44.686681 1742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "896178dd185047239d0f21ca3a490520" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "64f64d3081f04ff1b09a47dad0287d74"
I20260806 09:20:44.687182 1593 leader_election.cc:288] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520 [CANDIDATE]: Term 1 election: Requested vote from peers 600dabdcdf1748cb8a9f5c6471a119d0 (127.10.255.125:41411), 64f64d3081f04ff1b09a47dad0287d74 (127.10.255.124:41711)
I20260806 09:20:44.687258 1742 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64f64d3081f04ff1b09a47dad0287d74 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:44.692693 1742 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 64f64d3081f04ff1b09a47dad0287d74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 896178dd185047239d0f21ca3a490520 in term 1.
I20260806 09:20:44.694734 1803 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:20:44.703922 1803 raft_consensus.cc:686] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520 [term 1 LEADER]: Becoming Leader. State: Replica: 896178dd185047239d0f21ca3a490520, State: Running, Role: LEADER
I20260806 09:20:44.705350 1803 consensus_queue.cc:237] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896178dd185047239d0f21ca3a490520" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37029 } } peers { permanent_uuid: "600dabdcdf1748cb8a9f5c6471a119d0" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } } peers { permanent_uuid: "64f64d3081f04ff1b09a47dad0287d74" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } }
I20260806 09:20:44.723142 1807 sys_catalog.cc:455] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 896178dd185047239d0f21ca3a490520. Latest consensus state: current_term: 1 leader_uuid: "896178dd185047239d0f21ca3a490520" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896178dd185047239d0f21ca3a490520" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37029 } } peers { permanent_uuid: "600dabdcdf1748cb8a9f5c6471a119d0" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } } peers { permanent_uuid: "64f64d3081f04ff1b09a47dad0287d74" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } } }
I20260806 09:20:44.723806 1807 sys_catalog.cc:458] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520 [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:44.726508 1816 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 09:20:44.746264 1697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.712760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52866 (local address 127.10.255.125:41411)
0806 09:20:44.712986 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:44.712991 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:44.715464 (+ 2473us) server_negotiation.cc:407] Connection header received
0806 09:20:44.716220 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:44.716229 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:44.716334 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:44.716462 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:44.727734 (+ 11272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.728855 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.731299 (+ 2444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.732197 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.732346 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:44.736960 (+ 4614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:44.736970 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:44.736976 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:44.737037 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:44.741411 (+ 4374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:44.742684 (+ 1273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:44.742691 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:44.742695 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:44.742889 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:44.743431 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:44.743437 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:44.743440 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:44.744004 (+ 564us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:44.744347 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:44.745394 (+ 1047us) server_negotiation.cc:299] Negotiation successful
0806 09:20:44.745786 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 09:20:44.755460 1770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.716994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59624 (local address 127.10.255.124:41711)
0806 09:20:44.717187 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:44.717193 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:44.722820 (+ 5627us) server_negotiation.cc:407] Connection header received
0806 09:20:44.723137 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:44.723144 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:44.723267 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:44.723355 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:44.726198 (+ 2843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.727506 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.731716 (+ 4210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.732590 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.732738 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:44.746649 (+ 13911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:44.746659 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:44.746665 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:44.746722 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:44.751355 (+ 4633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:44.752422 (+ 1067us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:44.752429 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:44.752434 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:44.752620 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:44.753154 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:44.753161 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:44.753165 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:44.753752 (+ 587us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:44.754027 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:44.754669 (+ 642us) server_negotiation.cc:299] Negotiation successful
0806 09:20:44.754977 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260806 09:20:44.756541 1816 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:20:44.760280 1773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:44.713973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40636 (local address 127.10.255.126:37029)
0806 09:20:44.714283 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:44.714290 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:44.718047 (+ 3757us) server_negotiation.cc:407] Connection header received
0806 09:20:44.721446 (+ 3399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:44.721452 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:44.721548 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:44.721656 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:44.732505 (+ 10849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.733605 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.745659 (+ 12054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:44.746424 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:44.746555 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:44.751741 (+ 5186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:44.751753 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:44.751760 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:44.751826 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:44.756215 (+ 4389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:44.757413 (+ 1198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:44.757419 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:44.757423 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:44.757601 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:44.758110 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:44.758114 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:44.758117 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:44.758567 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:44.758832 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:44.759508 (+ 676us) server_negotiation.cc:299] Negotiation successful
0806 09:20:44.759765 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260806 09:20:44.764650 1646 tablet.cc:2369] T 00000000000000000000000000000000 P 600dabdcdf1748cb8a9f5c6471a119d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:20:44.790557 1742 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 64f64d3081f04ff1b09a47dad0287d74 [term 1 FOLLOWER]: Refusing update from remote peer 896178dd185047239d0f21ca3a490520: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:20:44.792153 1807 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64f64d3081f04ff1b09a47dad0287d74" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:20:44.800956 1667 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 600dabdcdf1748cb8a9f5c6471a119d0 [term 1 FOLLOWER]: Refusing update from remote peer 896178dd185047239d0f21ca3a490520: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:20:44.802264 1807 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520 [LEADER]: Connected to new peer: Peer: permanent_uuid: "600dabdcdf1748cb8a9f5c6471a119d0" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:20:44.829618 1775 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64f64d3081f04ff1b09a47dad0287d74 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 896178dd185047239d0f21ca3a490520. Latest consensus state: current_term: 1 leader_uuid: "896178dd185047239d0f21ca3a490520" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896178dd185047239d0f21ca3a490520" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37029 } } peers { permanent_uuid: "600dabdcdf1748cb8a9f5c6471a119d0" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } } peers { permanent_uuid: "64f64d3081f04ff1b09a47dad0287d74" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } } }
I20260806 09:20:44.830010 1775 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64f64d3081f04ff1b09a47dad0287d74 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:20:44.833403 1789 sys_catalog.cc:455] T 00000000000000000000000000000000 P 600dabdcdf1748cb8a9f5c6471a119d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 896178dd185047239d0f21ca3a490520. Latest consensus state: current_term: 1 leader_uuid: "896178dd185047239d0f21ca3a490520" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896178dd185047239d0f21ca3a490520" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37029 } } peers { permanent_uuid: "600dabdcdf1748cb8a9f5c6471a119d0" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } } peers { permanent_uuid: "64f64d3081f04ff1b09a47dad0287d74" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } } }
I20260806 09:20:44.833839 1789 sys_catalog.cc:458] T 00000000000000000000000000000000 P 600dabdcdf1748cb8a9f5c6471a119d0 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:20:44.836548 1826 mvcc.cc:205] Tried to move back new op lower bound from 7315488951446736896 to 7315488951152386048. Current Snapshot: MvccSnapshot[applied={T|T < 7315488951446736896}]
I20260806 09:20:44.838769 1827 mvcc.cc:205] Tried to move back new op lower bound from 7315488951446736896 to 7315488951152386048. Current Snapshot: MvccSnapshot[applied={T|T < 7315488951446736896}]
I20260806 09:20:44.845567 1775 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64f64d3081f04ff1b09a47dad0287d74 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "896178dd185047239d0f21ca3a490520" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896178dd185047239d0f21ca3a490520" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37029 } } peers { permanent_uuid: "600dabdcdf1748cb8a9f5c6471a119d0" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } } peers { permanent_uuid: "64f64d3081f04ff1b09a47dad0287d74" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } } }
I20260806 09:20:44.845948 1775 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64f64d3081f04ff1b09a47dad0287d74 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:20:44.856230 1803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "896178dd185047239d0f21ca3a490520" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896178dd185047239d0f21ca3a490520" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37029 } } peers { permanent_uuid: "600dabdcdf1748cb8a9f5c6471a119d0" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } } peers { permanent_uuid: "64f64d3081f04ff1b09a47dad0287d74" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } } }
I20260806 09:20:44.856632 1803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520 [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:44.857057 1803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "896178dd185047239d0f21ca3a490520" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896178dd185047239d0f21ca3a490520" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37029 } } peers { permanent_uuid: "600dabdcdf1748cb8a9f5c6471a119d0" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } } peers { permanent_uuid: "64f64d3081f04ff1b09a47dad0287d74" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } } }
I20260806 09:20:44.857347 1803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520 [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:44.866020 1789 sys_catalog.cc:455] T 00000000000000000000000000000000 P 600dabdcdf1748cb8a9f5c6471a119d0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "896178dd185047239d0f21ca3a490520" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "896178dd185047239d0f21ca3a490520" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 37029 } } peers { permanent_uuid: "600dabdcdf1748cb8a9f5c6471a119d0" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 41411 } } peers { permanent_uuid: "64f64d3081f04ff1b09a47dad0287d74" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 41711 } } }
I20260806 09:20:44.866384 1789 sys_catalog.cc:458] T 00000000000000000000000000000000 P 600dabdcdf1748cb8a9f5c6471a119d0 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:20:44.872263 1816 catalog_manager.cc:1347] Generated new cluster ID: 0314071563c74a38b47e06570dc119e1
I20260806 09:20:44.872412 1816 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:20:44.896595 1816 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:20:44.898864 1816 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:20:44.925980 1816 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 896178dd185047239d0f21ca3a490520: Generated new TSK 0
I20260806 09:20:44.927407 1816 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 09:20:45.063796 1697 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:20:45.049897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52874 (local address 127.10.255.125:41411)
0806 09:20:45.050145 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:45.050154 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:45.059423 (+ 9269us) server_negotiation.cc:407] Connection header received
0806 09:20:45.061982 (+ 2559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:45.061991 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:45.062122 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:45.062205 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:45.063506 (+ 1301us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52874: BlockingRecv error: recv got EOF from 127.0.0.1:52874 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
W20260806 09:20:45.068073 1770 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:20:45.060931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59630 (local address 127.10.255.124:41711)
0806 09:20:45.061222 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:45.061232 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:45.065623 (+ 4391us) server_negotiation.cc:407] Connection header received
0806 09:20:45.066441 (+ 818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:45.066447 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:45.066543 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:45.066632 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:45.067733 (+ 1101us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59630: BlockingRecv error: recv got EOF from 127.0.0.1:59630 (error 108)
Metrics: {"server-negotiator.queue_time_us":111}
W20260806 09:20:45.069304 1773 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:20:45.053959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40652 (local address 127.10.255.126:37029)
0806 09:20:45.054173 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:45.054180 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:45.059976 (+ 5796us) server_negotiation.cc:407] Connection header received
0806 09:20:45.060228 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:45.060235 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:45.060345 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:45.060472 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:45.069028 (+ 8556us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40652: BlockingRecv error: recv got EOF from 127.0.0.1:40652 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260806 09:20:45.130816 1697 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:20:45.111271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52886 (local address 127.10.255.125:41411)
0806 09:20:45.111474 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:45.111481 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:45.128648 (+ 17167us) server_negotiation.cc:407] Connection header received
0806 09:20:45.129025 (+ 377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:45.129032 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:45.129184 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:45.129262 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:45.130479 (+ 1217us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52886: BlockingRecv error: recv got EOF from 127.0.0.1:52886 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260806 09:20:45.162441 1697 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:20:45.159525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52890 (local address 127.10.255.125:41411)
0806 09:20:45.159759 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:45.159766 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:45.160794 (+ 1028us) server_negotiation.cc:407] Connection header received
0806 09:20:45.161013 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:45.161019 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:45.161112 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:45.161230 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:45.162199 (+ 969us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52890: BlockingRecv error: recv got EOF from 127.0.0.1:52890 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
W20260806 09:20:45.174291 1697 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:20:45.170115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52906 (local address 127.10.255.125:41411)
0806 09:20:45.170299 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:45.170308 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:45.172477 (+ 2169us) server_negotiation.cc:407] Connection header received
0806 09:20:45.172747 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:45.172756 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:45.172893 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:45.173014 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:45.174007 (+ 993us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52906: BlockingRecv error: recv got EOF from 127.0.0.1:52906 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260806 09:20:45.202888 1697 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:20:45.184905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52910 (local address 127.10.255.125:41411)
0806 09:20:45.185142 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:45.185148 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:45.200605 (+ 15457us) server_negotiation.cc:407] Connection header received
0806 09:20:45.200875 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:45.200881 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:45.201018 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:45.201156 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:45.202603 (+ 1447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52910: BlockingRecv error: recv got EOF from 127.0.0.1:52910 (error 108)
Metrics: {"server-negotiator.queue_time_us":118}
W20260806 09:20:45.218567 1697 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:20:45.215893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52920 (local address 127.10.255.125:41411)
0806 09:20:45.216100 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:45.216108 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:45.216792 (+ 684us) server_negotiation.cc:407] Connection header received
0806 09:20:45.217000 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:45.217007 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:45.217125 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:45.217252 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:45.218264 (+ 1012us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52920: BlockingRecv error: recv got EOF from 127.0.0.1:52920 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260806 09:20:45.244527 1697 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:20:45.242160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52936 (local address 127.10.255.125:41411)
0806 09:20:45.242346 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:45.242353 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:45.242915 (+ 562us) server_negotiation.cc:407] Connection header received
0806 09:20:45.243105 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:45.243112 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:45.243228 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:45.243359 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:45.244267 (+ 908us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52936: BlockingRecv error: recv got EOF from 127.0.0.1:52936 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260806 09:20:45.284088 1697 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:20:45.281485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52938 (local address 127.10.255.125:41411)
0806 09:20:45.281688 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:45.281695 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:45.282336 (+ 641us) server_negotiation.cc:407] Connection header received
0806 09:20:45.282531 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:45.282539 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:45.282676 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:45.282797 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:45.283755 (+ 958us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52938: BlockingRecv error: recv got EOF from 127.0.0.1:52938 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260806 09:20:45.361553 1697 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:20:45.359283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52948 (local address 127.10.255.125:41411)
0806 09:20:45.359496 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:45.359503 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:45.359859 (+ 356us) server_negotiation.cc:407] Connection header received
0806 09:20:45.360088 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:45.360095 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:45.360193 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:45.360320 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:45.361318 (+ 998us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52948: BlockingRecv error: recv got EOF from 127.0.0.1:52948 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 09:20:45.490432 1786 catalog_manager.cc:1259] Loaded cluster ID: 0314071563c74a38b47e06570dc119e1
I20260806 09:20:45.490574 1786 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 64f64d3081f04ff1b09a47dad0287d74: loading cluster ID for follower catalog manager: success
I20260806 09:20:45.494027 1786 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 64f64d3081f04ff1b09a47dad0287d74: acquiring CA information for follower catalog manager: success
I20260806 09:20:45.496379 1786 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 64f64d3081f04ff1b09a47dad0287d74: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260806 09:20:45.496843 1697 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:20:45.494587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52954 (local address 127.10.255.125:41411)
0806 09:20:45.494840 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:45.494849 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:45.495159 (+ 310us) server_negotiation.cc:407] Connection header received
0806 09:20:45.495396 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:45.495407 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:45.495492 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:45.495611 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:45.496560 (+ 949us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52954: BlockingRecv error: recv got EOF from 127.0.0.1:52954 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
I20260806 09:20:45.593669 1800 catalog_manager.cc:1259] Loaded cluster ID: 0314071563c74a38b47e06570dc119e1
I20260806 09:20:45.593791 1800 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 600dabdcdf1748cb8a9f5c6471a119d0: loading cluster ID for follower catalog manager: success
I20260806 09:20:45.596784 1800 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 600dabdcdf1748cb8a9f5c6471a119d0: acquiring CA information for follower catalog manager: success
I20260806 09:20:45.599020 1800 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 600dabdcdf1748cb8a9f5c6471a119d0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 09:20:45.762835 1697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:45.756764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52956 (local address 127.10.255.125:41411)
0806 09:20:45.756999 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:45.757007 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:45.757429 (+ 422us) server_negotiation.cc:407] Connection header received
0806 09:20:45.757674 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:45.757679 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:45.757839 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:45.757969 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:20:45.758453 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:45.759173 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:45.760577 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:45.760979 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:45.761118 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:45.761631 (+ 513us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:20:45.762192 (+ 561us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:20:45.762371 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:45.762434 (+ 63us) server_negotiation.cc:299] Negotiation successful
0806 09:20:45.762537 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 09:20:45.776161 1899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:45.769905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59642 (local address 127.10.255.124:41711)
0806 09:20:45.770545 (+ 640us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:45.770550 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:45.770571 (+ 21us) server_negotiation.cc:407] Connection header received
0806 09:20:45.770732 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:45.770736 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:45.770899 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:45.771072 (+ 173us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:20:45.771530 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:45.772329 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:45.773736 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:45.774204 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:45.774308 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:45.774877 (+ 569us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:20:45.775440 (+ 563us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:20:45.775557 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:45.775727 (+ 170us) server_negotiation.cc:299] Negotiation successful
0806 09:20:45.775799 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":413,"threads_started":1}
I20260806 09:20:45.794849 1697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:45.783797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52960 (local address 127.10.255.125:41411)
0806 09:20:45.784133 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:45.784165 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:45.785315 (+ 1150us) server_negotiation.cc:407] Connection header received
0806 09:20:45.785561 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:45.785567 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:45.785671 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:45.785783 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:20:45.786632 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:45.787969 (+ 1337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:45.790364 (+ 2395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:45.791154 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:45.791287 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:45.792173 (+ 886us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:20:45.792356 (+ 183us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:20:45.792478 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:45.792758 (+ 280us) server_negotiation.cc:299] Negotiation successful
0806 09:20:45.793239 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154}
I20260806 09:20:45.795979 1905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:45.783888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40664 (local address 127.10.255.126:37029)
0806 09:20:45.784661 (+ 773us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:45.784672 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:45.786541 (+ 1869us) server_negotiation.cc:407] Connection header received
0806 09:20:45.786881 (+ 340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:45.786888 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:45.787161 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:45.787324 (+ 163us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:20:45.788222 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:45.789515 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:45.793078 (+ 3563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:45.793865 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:45.794033 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:45.794589 (+ 556us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:20:45.795095 (+ 506us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:20:45.795218 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:45.795481 (+ 263us) server_negotiation.cc:299] Negotiation successful
0806 09:20:45.795589 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":1648,"threads_started":1}
I20260806 09:20:45.799162 1899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:45.792026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59656 (local address 127.10.255.124:41711)
0806 09:20:45.792236 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:45.792245 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:45.792710 (+ 465us) server_negotiation.cc:407] Connection header received
0806 09:20:45.792885 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:45.792891 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:45.792991 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:45.793086 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:20:45.793640 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:45.794715 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:45.796844 (+ 2129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:45.797522 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:45.797649 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:45.798285 (+ 636us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:20:45.798441 (+ 156us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:20:45.798542 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:45.798771 (+ 229us) server_negotiation.cc:299] Negotiation successful
0806 09:20:45.798859 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 09:20:45.802291 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 1550
I20260806 09:20:45.804055 1613 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:20:45.920324 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 1550
W20260806 09:20:45.943181 1643 connection.cc:535] server connection from 127.0.0.1:52824 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 09:20:45.943440 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 1625
I20260806 09:20:45.944836 1687 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:20:46.057406 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 1625
I20260806 09:20:46.084201 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 1700
I20260806 09:20:46.085489 1762 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:20:46.196985 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 1700
2026-08-06T09:20:46Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (4988 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 09:20:46 dist-test-slave-mvvj krb5kdc[1913](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 09:20:46 dist-test-slave-mvvj krb5kdc[1913](info): set up 2 sockets
Aug 06 09:20:46 dist-test-slave-mvvj krb5kdc[1913](info): commencing operation
krb5kdc: starting...
W20260806 09:20:47.372902 11261 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.002s sys 0.031s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/krb5kdc/test-user.keytab.
Aug 06 09:20:47 dist-test-slave-mvvj krb5kdc[1913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T09:20:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T09:20:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.255.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
Entry for principal kudu/127.10.255.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab.
I20260806 09:20:47.675786 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:36673
--webserver_interface=127.10.255.126
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:42327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:36673,127.10.255.125:32969,127.10.255.124:33579
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 09:20:48.046917 1926 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 09:20:48.047361 1926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:48.047499 1926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:48.047638 1926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:48.055497 1926 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:48.055644 1926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:48.055752 1926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:48.055861 1926 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:48.055974 1926 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:48.066601 1926 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:42327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:36673,127.10.255.125:32969,127.10.255.124:33579
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.126.keytab
--principal=kudu/127.10.255.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.126:36673
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.255.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:48.068136 1926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:48.069628 1926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:48.083004 1934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:48.083104 1931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:48.083104 1932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:48.084483 1926 server_base.cc:1034] running on GCE node
I20260806 09:20:48.085461 1926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:48.087109 1926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:48.088385 1926 hybrid_clock.cc:648] HybridClock initialized: now 1786008048088314 us; error 36 us; skew 500 ppm
I20260806 09:20:48.088852 1926 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:20:48 dist-test-slave-mvvj krb5kdc[1913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008048, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:20:48.092286 1926 init.cc:377] Logged in from keytab as kudu/127.10.255.126@KRBTEST.COM (short username kudu)
I20260806 09:20:48.093964 1926 webserver.cc:460] Webserver started at http://127.10.255.126:36497/ using document root <none> and password file <none>
I20260806 09:20:48.094753 1926 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:48.094889 1926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:48.095225 1926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:48.098647 1926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-0/data/instance:
uuid: "51ab83f1a7f9422db16a7face880c4e1"
format_stamp: "Formatted at 2026-08-06 09:20:48 on dist-test-slave-mvvj"
server_key: "faaa886be97e33f71dc98a498d197519"
server_key_iv: "ef1d53226e2248b288f809112c28c54b"
server_key_version: "encryptionkey@0"
I20260806 09:20:48.099555 1926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-0/wal/instance:
uuid: "51ab83f1a7f9422db16a7face880c4e1"
format_stamp: "Formatted at 2026-08-06 09:20:48 on dist-test-slave-mvvj"
server_key: "faaa886be97e33f71dc98a498d197519"
server_key_iv: "ef1d53226e2248b288f809112c28c54b"
server_key_version: "encryptionkey@0"
I20260806 09:20:48.105592 1926 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260806 09:20:48.109745 1941 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:48.111370 1926 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260806 09:20:48.111618 1926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-0/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-0/wal
uuid: "51ab83f1a7f9422db16a7face880c4e1"
format_stamp: "Formatted at 2026-08-06 09:20:48 on dist-test-slave-mvvj"
server_key: "faaa886be97e33f71dc98a498d197519"
server_key_iv: "ef1d53226e2248b288f809112c28c54b"
server_key_version: "encryptionkey@0"
I20260806 09:20:48.111907 1926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:48.143605 1926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:48.148795 1926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:48.149214 1926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:48.170181 1926 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.126:36673
I20260806 09:20:48.170224 1992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.126:36673 every 8 connection(s)
I20260806 09:20:48.171662 1926 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-0/data/info.pb
I20260806 09:20:48.176452 1993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:20:48.177582 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 1926
I20260806 09:20:48.177798 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-0/wal/instance
I20260806 09:20:48.178292 11261 external_mini_cluster.cc:1428] Setting key d080a241c35419dd37e3a063a7335f33
I20260806 09:20:48.184306 1993 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36673 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 09:20:48 dist-test-slave-mvvj krb5kdc[1913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008048, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.255.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.125@KRBTEST.COM" created.
I20260806 09:20:48.212481 1997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.188186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46646 (local address 127.10.255.126:36673)
0806 09:20:48.190092 (+ 1906us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:48.190103 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:48.190169 (+ 66us) server_negotiation.cc:407] Connection header received
0806 09:20:48.192040 (+ 1871us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:48.192051 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:48.192412 (+ 361us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:48.192661 (+ 249us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:48.193988 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:48.196001 (+ 2013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:48.197540 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:48.198545 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:48.198760 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:48.202552 (+ 3792us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:48.202570 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:48.202595 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:48.202655 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:48.206881 (+ 4226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:48.207969 (+ 1088us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:48.207983 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:48.207985 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:48.208189 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:48.208736 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:48.208741 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:48.208743 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:48.209403 (+ 660us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:48.209678 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:48.210354 (+ 676us) server_negotiation.cc:299] Negotiation successful
0806 09:20:48.210827 (+ 473us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":1663,"spinlock_wait_cycles":59776,"thread_start_us":1427,"threads_started":1}
I20260806 09:20:48.212504 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.188186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:36673 (local address 127.0.0.1:46646)
0806 09:20:48.189302 (+ 1116us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:48.189381 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:48.191543 (+ 2162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:48.192731 (+ 1188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:48.192737 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:48.193364 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:20:48.193746 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:48.193765 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:48.196176 (+ 2411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:48.196180 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:48.197378 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:48.197393 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:48.198797 (+ 1404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:48.198803 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:48.198935 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:48.199724 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:20:48.199750 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:20:48.202237 (+ 2487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:20:48.207156 (+ 4919us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:48.207171 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:48.207182 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:48.207704 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:48.208357 (+ 653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:48.208362 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:48.208365 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:48.208560 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:48.209623 (+ 1063us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:20:48.209630 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:20:48.209902 (+ 272us) client_negotiation.cc:769] Sending connection context
0806 09:20:48.210233 (+ 331us) client_negotiation.cc:240] Negotiation successful
0806 09:20:48.210988 (+ 755us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":723,"mutex_wait_us":180,"thread_start_us":439,"threads_started":1}
I20260806 09:20:48.216285 1993 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } has no permanent_uuid. Determining permanent_uuid...
I20260806 09:20:48.217681 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.217176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:32969 (local address 127.0.0.1:49386)
0806 09:20:48.217382 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:48.217543 (+ 161us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260806 09:20:48.217983 1943 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.255.125:32969: connect: Connection refused (error 111)
I20260806 09:20:48.220216 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.219591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:32969 (local address 127.0.0.1:49396)
0806 09:20:48.219957 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:48.220050 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
W20260806 09:20:48.220484 1993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.125:32969: Network error: Client connection negotiation failed: client connection to 127.10.255.125:32969: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.125.keytab.
Entry for principal kudu/127.10.255.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.125.keytab.
I20260806 09:20:48.247962 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.125:32969
--webserver_interface=127.10.255.125
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.125.keytab
--principal=kudu/127.10.255.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:42327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:36673,127.10.255.125:32969,127.10.255.124:33579
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:20:48.269891 1993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } attempt: 1
I20260806 09:20:48.271107 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.270634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:32969 (local address 127.0.0.1:49408)
0806 09:20:48.270829 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:48.270968 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260806 09:20:48.272163 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.271780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:32969 (local address 127.0.0.1:49410)
0806 09:20:48.271950 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:48.272032 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260806 09:20:48.272356 1993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.125:32969: Network error: Client connection negotiation failed: client connection to 127.10.255.125:32969: connect: Connection refused (error 111)
I20260806 09:20:48.340672 1993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } attempt: 2
I20260806 09:20:48.341943 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.341410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:32969 (local address 127.0.0.1:49414)
0806 09:20:48.341711 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:48.341800 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120}
I20260806 09:20:48.342978 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.342604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:32969 (local address 127.0.0.1:49424)
0806 09:20:48.342773 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:48.342841 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 09:20:48.343165 1993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.125:32969: Network error: Client connection negotiation failed: client connection to 127.10.255.125:32969: connect: Connection refused (error 111)
I20260806 09:20:48.434509 1993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } attempt: 3
I20260806 09:20:48.435719 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.435261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:32969 (local address 127.0.0.1:49434)
0806 09:20:48.435480 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:48.435578 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260806 09:20:48.436836 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.436469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:32969 (local address 127.0.0.1:49438)
0806 09:20:48.436619 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:48.436695 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260806 09:20:48.437142 1993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.125:32969: Network error: Client connection negotiation failed: client connection to 127.10.255.125:32969: connect: Connection refused (error 111)
I20260806 09:20:48.580467 1993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } attempt: 4
I20260806 09:20:48.581875 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.581239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:32969 (local address 127.0.0.1:49442)
0806 09:20:48.581637 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:48.581732 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":241}
I20260806 09:20:48.582978 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.582595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:32969 (local address 127.0.0.1:49448)
0806 09:20:48.582748 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:48.582836 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.125:32969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260806 09:20:48.583228 1993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.125:32969: Network error: Client connection negotiation failed: client connection to 127.10.255.125:32969: connect: Connection refused (error 111)
W20260806 09:20:48.604593 2000 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 09:20:48.604969 2000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:48.605078 2000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:48.605173 2000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:48.613058 2000 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:48.613169 2000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:48.613262 2000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:48.613349 2000 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:48.613454 2000 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:48.624197 2000 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:42327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:36673,127.10.255.125:32969,127.10.255.124:33579
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.125.keytab
--principal=kudu/127.10.255.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.125:32969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.255.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:48.625684 2000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:48.627141 2000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:48.640070 2005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:48.640070 2006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:48.640030 2008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:48.640918 2000 server_base.cc:1034] running on GCE node
I20260806 09:20:48.641793 2000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:48.643399 2000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:48.644670 2000 hybrid_clock.cc:648] HybridClock initialized: now 1786008048644591 us; error 55 us; skew 500 ppm
I20260806 09:20:48.645081 2000 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:20:48 dist-test-slave-mvvj krb5kdc[1913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008048, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:20:48.648928 2000 init.cc:377] Logged in from keytab as kudu/127.10.255.125@KRBTEST.COM (short username kudu)
I20260806 09:20:48.650612 2000 webserver.cc:460] Webserver started at http://127.10.255.125:43559/ using document root <none> and password file <none>
I20260806 09:20:48.651364 2000 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:48.651504 2000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:48.651925 2000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:48.655249 2000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-1/data/instance:
uuid: "176ea1e557524378991d9f051ab406c5"
format_stamp: "Formatted at 2026-08-06 09:20:48 on dist-test-slave-mvvj"
server_key: "275011d447a7eb4f8299b8098ec0c786"
server_key_iv: "468c31d35321421b30b18882591473d3"
server_key_version: "encryptionkey@0"
I20260806 09:20:48.656235 2000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-1/wal/instance:
uuid: "176ea1e557524378991d9f051ab406c5"
format_stamp: "Formatted at 2026-08-06 09:20:48 on dist-test-slave-mvvj"
server_key: "275011d447a7eb4f8299b8098ec0c786"
server_key_iv: "468c31d35321421b30b18882591473d3"
server_key_version: "encryptionkey@0"
I20260806 09:20:48.662914 2000 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260806 09:20:48.667042 2015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:48.668853 2000 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260806 09:20:48.669054 2000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-1/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-1/wal
uuid: "176ea1e557524378991d9f051ab406c5"
format_stamp: "Formatted at 2026-08-06 09:20:48 on dist-test-slave-mvvj"
server_key: "275011d447a7eb4f8299b8098ec0c786"
server_key_iv: "468c31d35321421b30b18882591473d3"
server_key_version: "encryptionkey@0"
I20260806 09:20:48.669301 2000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:48.697942 2000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:48.703118 2000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:48.703449 2000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:48.726563 2000 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.125:32969
I20260806 09:20:48.726593 2066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.125:32969 every 8 connection(s)
I20260806 09:20:48.728271 2000 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-1/data/info.pb
I20260806 09:20:48.732726 2067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:20:48.738595 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 2000
I20260806 09:20:48.738823 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-1/wal/instance
I20260806 09:20:48.739362 11261 external_mini_cluster.cc:1428] Setting key 0d7a3bfe6d8dc165a8b39223a4eaedac
I20260806 09:20:48.741225 2067 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36673 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 09:20:48 dist-test-slave-mvvj krb5kdc[1913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008048, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.125@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.255.124@KRBTEST.COM; defaulting to no policy
I20260806 09:20:48.768718 2069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.744472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46650 (local address 127.10.255.126:36673)
0806 09:20:48.745139 (+ 667us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:48.745148 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:48.746386 (+ 1238us) server_negotiation.cc:407] Connection header received
0806 09:20:48.748823 (+ 2437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:48.748832 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:48.748953 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:48.749094 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:48.751728 (+ 2634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:48.752719 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:48.755577 (+ 2858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:48.756133 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:48.756245 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:48.761362 (+ 5117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:48.761368 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:48.761372 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:48.761415 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:48.764672 (+ 3257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:48.765729 (+ 1057us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:48.765738 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:48.765742 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:48.765948 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:48.766487 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:48.766493 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:48.766497 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:48.766878 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:48.767053 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:48.767950 (+ 897us) server_negotiation.cc:299] Negotiation successful
0806 09:20:48.768220 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":497,"thread_start_us":308,"threads_started":1}
I20260806 09:20:48.770320 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.745195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:36673 (local address 127.0.0.1:46650)
0806 09:20:48.746139 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:48.746215 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:48.748462 (+ 2247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:48.749464 (+ 1002us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:48.749481 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:48.750458 (+ 977us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:20:48.751401 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:48.751435 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:48.752938 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:48.752947 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:48.755361 (+ 2414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:48.755384 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:48.756407 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:48.756418 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:48.756811 (+ 393us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:48.757711 (+ 900us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:20:48.757752 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:20:48.761041 (+ 3289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:20:48.764859 (+ 3818us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:48.764870 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:48.764890 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:48.765408 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:48.766116 (+ 708us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:48.766123 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:48.766127 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:48.766350 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:48.767053 (+ 703us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:20:48.767065 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:20:48.767503 (+ 438us) client_negotiation.cc:769] Sending connection context
0806 09:20:48.767829 (+ 326us) client_negotiation.cc:240] Negotiation successful
0806 09:20:48.768602 (+ 773us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":392,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.255.124@KRBTEST.COM" created.
I20260806 09:20:48.772562 2067 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 09:20:48 dist-test-slave-mvvj krb5kdc[1913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008048, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.125@KRBTEST.COM for kudu/127.10.255.125@KRBTEST.COM
I20260806 09:20:48.793095 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.773650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:32969 (local address 127.0.0.1:49460)
0806 09:20:48.773912 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:48.773937 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:48.774105 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:48.775545 (+ 1440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:48.775553 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:48.776162 (+ 609us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:20:48.776409 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:48.776425 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:48.778048 (+ 1623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:48.778057 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:48.779787 (+ 1730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:48.779808 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:48.780793 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:48.780807 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:48.781064 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:48.781813 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:20:48.781844 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:20:48.784906 (+ 3062us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:20:48.790008 (+ 5102us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:48.790013 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:48.790016 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:48.790708 (+ 692us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:48.791239 (+ 531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:48.791243 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:48.791246 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:48.791395 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:48.792273 (+ 878us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:20:48.792277 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:20:48.792401 (+ 124us) client_negotiation.cc:769] Sending connection context
0806 09:20:48.792549 (+ 148us) client_negotiation.cc:240] Negotiation successful
0806 09:20:48.792791 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99}
I20260806 09:20:48.793658 2072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.773656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49460 (local address 127.10.255.125:32969)
0806 09:20:48.774570 (+ 914us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:48.774582 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:48.774624 (+ 42us) server_negotiation.cc:407] Connection header received
0806 09:20:48.774693 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:48.774705 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:48.775031 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:48.775199 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:48.776657 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:48.777878 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:48.779990 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:48.780610 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:48.780733 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:48.785170 (+ 4437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:48.785192 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:48.785216 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:48.785263 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:48.789796 (+ 4533us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:48.790901 (+ 1105us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:48.790914 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:48.790920 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:48.791080 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:48.791542 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:48.791550 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:48.791556 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:48.792123 (+ 567us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:48.792360 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:48.792757 (+ 397us) server_negotiation.cc:299] Negotiation successful
0806 09:20:48.793088 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":684,"thread_start_us":351,"threads_started":1}
I20260806 09:20:48.796741 2067 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } has no permanent_uuid. Determining permanent_uuid...
I20260806 09:20:48.798254 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.797712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:33579 (local address 127.0.0.1:33188)
0806 09:20:48.797967 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:48.798088 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260806 09:20:48.798624 2019 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
I20260806 09:20:48.800529 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.800104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:33579 (local address 127.0.0.1:33202)
0806 09:20:48.800316 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:48.800406 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
W20260806 09:20:48.800802 2067 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:33579: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.255.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.124.keytab.
Entry for principal kudu/127.10.255.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.124.keytab.
I20260806 09:20:48.816762 11261 external_mini_cluster.cc:1326] Running /tmp/dist-test-task5qcP_A/build/asan/bin/kudu
/tmp/dist-test-task5qcP_A/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.124:33579
--webserver_interface=127.10.255.124
--webserver_port=0
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.124.keytab
--principal=kudu/127.10.255.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.255.84:42327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.255.126:36673,127.10.255.125:32969,127.10.255.124:33579
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 09:20:48.850147 2067 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } attempt: 1
I20260806 09:20:48.851519 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.851012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:33579 (local address 127.0.0.1:33204)
0806 09:20:48.851241 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:48.851355 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260806 09:20:48.852917 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.852395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:33579 (local address 127.0.0.1:33216)
0806 09:20:48.852626 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:48.852740 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260806 09:20:48.853192 2067 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:33579: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
I20260806 09:20:48.882495 1993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } attempt: 5
Aug 06 09:20:48 dist-test-slave-mvvj krb5kdc[1913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008048, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for kudu/127.10.255.125@KRBTEST.COM
I20260806 09:20:48.897760 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.883326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:32969 (local address 127.0.0.1:49474)
0806 09:20:48.883624 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:48.883642 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:48.883809 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:48.884244 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:48.884249 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:48.884717 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:20:48.884913 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:48.884923 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:48.886026 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:48.886033 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:48.886957 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:48.886969 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:48.887882 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:48.887891 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:48.888167 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:48.888852 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:20:48.888872 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:20:48.891150 (+ 2278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:20:48.894809 (+ 3659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:48.894816 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:48.894820 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:48.895338 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:48.895779 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:48.895785 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:48.895789 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:48.895987 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:48.896590 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:20:48.896596 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:20:48.896789 (+ 193us) client_negotiation.cc:769] Sending connection context
0806 09:20:48.896947 (+ 158us) client_negotiation.cc:240] Negotiation successful
0806 09:20:48.897349 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157}
I20260806 09:20:48.897753 2072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.883382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49474 (local address 127.10.255.125:32969)
0806 09:20:48.883637 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:48.883644 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:48.883739 (+ 95us) server_negotiation.cc:407] Connection header received
0806 09:20:48.883986 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:48.883993 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:48.884091 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:48.884204 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:48.885085 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:48.885870 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:48.887129 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:48.887633 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:48.887790 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:48.891404 (+ 3614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:48.891410 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:48.891413 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:48.891455 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:48.894607 (+ 3152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:48.895481 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:48.895490 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:48.895494 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:48.895646 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:48.896112 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:48.896118 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:48.896122 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:48.896454 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:48.896634 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:48.897099 (+ 465us) server_negotiation.cc:299] Negotiation successful
0806 09:20:48.897362 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260806 09:20:48.899391 1993 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } has no permanent_uuid. Determining permanent_uuid...
I20260806 09:20:48.900610 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.900143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:33579 (local address 127.0.0.1:33228)
0806 09:20:48.900349 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:48.900444 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260806 09:20:48.901665 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.901278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:33579 (local address 127.0.0.1:33232)
0806 09:20:48.901453 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:48.901536 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260806 09:20:48.901978 1993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:33579: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
I20260806 09:20:48.921530 2067 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } attempt: 2
I20260806 09:20:48.923080 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.922574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:33579 (local address 127.0.0.1:33236)
0806 09:20:48.922795 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:48.922904 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260806 09:20:48.924290 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.923901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:33579 (local address 127.0.0.1:33248)
0806 09:20:48.924061 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:48.924143 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260806 09:20:48.924613 2067 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:33579: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
I20260806 09:20:48.953287 1993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } attempt: 1
I20260806 09:20:48.954886 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.954210 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:33579 (local address 127.0.0.1:33254)
0806 09:20:48.954505 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:48.954642 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260806 09:20:48.956213 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:48.955752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:33579 (local address 127.0.0.1:33262)
0806 09:20:48.955952 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:48.956055 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260806 09:20:48.956467 1993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:33579: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
I20260806 09:20:49.015942 2067 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } attempt: 3
I20260806 09:20:49.017722 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.016998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:33579 (local address 127.0.0.1:33270)
0806 09:20:49.017285 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:49.017427 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260806 09:20:49.019541 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.018811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:33579 (local address 127.0.0.1:33276)
0806 09:20:49.019175 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:49.019318 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204}
W20260806 09:20:49.019929 2067 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:33579: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
I20260806 09:20:49.024734 1993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } attempt: 2
I20260806 09:20:49.026087 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.025540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:33579 (local address 127.0.0.1:33288)
0806 09:20:49.025806 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:49.025910 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260806 09:20:49.027336 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.026967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:33579 (local address 127.0.0.1:33300)
0806 09:20:49.027128 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:49.027219 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260806 09:20:49.027623 1993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:33579: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
I20260806 09:20:49.133860 1993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } attempt: 3
I20260806 09:20:49.135128 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.134607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:33579 (local address 127.0.0.1:33314)
0806 09:20:49.134834 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:49.134929 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260806 09:20:49.136459 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.136044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:33579 (local address 127.0.0.1:33318)
0806 09:20:49.136257 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:49.136334 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
W20260806 09:20:49.136710 1993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:33579: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
I20260806 09:20:49.163224 2067 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } attempt: 4
I20260806 09:20:49.164813 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.164073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:33579 (local address 127.0.0.1:33328)
0806 09:20:49.164427 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:49.164566 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260806 09:20:49.166155 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.165699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:33579 (local address 127.0.0.1:33342)
0806 09:20:49.165883 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:49.165996 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260806 09:20:49.166451 2067 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:33579: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
W20260806 09:20:49.232060 2075 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 09:20:49.232481 2075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 09:20:49.232617 2075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 09:20:49.232744 2075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 09:20:49.240466 2075 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 09:20:49.240571 2075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 09:20:49.240630 2075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 09:20:49.240720 2075 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 09:20:49.240813 2075 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 09:20:49.251325 2075 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.255.84:42327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.255.126:36673,127.10.255.125:32969,127.10.255.124:33579
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/krb5kdc/kudu_127.10.255.124.keytab
--principal=kudu/127.10.255.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.255.124:33579
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.255.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 06 Aug 2026 07:10:43 UTC on ccycloud.quasar-ubmxwc.root.comops.site
build id 4569745
ASAN enabled
I20260806 09:20:49.252851 2075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 09:20:49.254391 2075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 09:20:49.267508 2081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 09:20:49.267508 2083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:49.268209 2075 server_base.cc:1034] running on GCE node
W20260806 09:20:49.268631 2080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 09:20:49.269924 2075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 09:20:49.272228 2075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 09:20:49.273484 2075 hybrid_clock.cc:648] HybridClock initialized: now 1786008049273390 us; error 57 us; skew 500 ppm
I20260806 09:20:49.273945 2075 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 06 09:20:49 dist-test-slave-mvvj krb5kdc[1913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008049, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 09:20:49.277736 2075 init.cc:377] Logged in from keytab as kudu/127.10.255.124@KRBTEST.COM (short username kudu)
I20260806 09:20:49.279481 2075 webserver.cc:460] Webserver started at http://127.10.255.124:40471/ using document root <none> and password file <none>
I20260806 09:20:49.280292 2075 fs_manager.cc:359] Metadata directory not provided
I20260806 09:20:49.280423 2075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 09:20:49.280754 2075 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 09:20:49.283960 2075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-2/data/instance:
uuid: "3ad305866d0145b9a7ef6317634cd8b4"
format_stamp: "Formatted at 2026-08-06 09:20:49 on dist-test-slave-mvvj"
server_key: "d0897de7e44e79fa4cd1439cc3a4fe59"
server_key_iv: "132bbe678805ea8fc5747a2afaf58e80"
server_key_version: "encryptionkey@0"
I20260806 09:20:49.284919 2075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-2/wal/instance:
uuid: "3ad305866d0145b9a7ef6317634cd8b4"
format_stamp: "Formatted at 2026-08-06 09:20:49 on dist-test-slave-mvvj"
server_key: "d0897de7e44e79fa4cd1439cc3a4fe59"
server_key_iv: "132bbe678805ea8fc5747a2afaf58e80"
server_key_version: "encryptionkey@0"
I20260806 09:20:49.290794 2075 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.002s
I20260806 09:20:49.294680 2090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 09:20:49.296162 2075 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260806 09:20:49.296350 2075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-2/data,/tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-2/wal
uuid: "3ad305866d0145b9a7ef6317634cd8b4"
format_stamp: "Formatted at 2026-08-06 09:20:49 on dist-test-slave-mvvj"
server_key: "d0897de7e44e79fa4cd1439cc3a4fe59"
server_key_iv: "132bbe678805ea8fc5747a2afaf58e80"
server_key_version: "encryptionkey@0"
I20260806 09:20:49.296604 2075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 09:20:49.314006 1993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } attempt: 4
I20260806 09:20:49.315374 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.314850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:33579 (local address 127.0.0.1:33356)
0806 09:20:49.315106 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:49.315219 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260806 09:20:49.316499 2075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 09:20:49.316776 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.316239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:33579 (local address 127.0.0.1:33360)
0806 09:20:49.316503 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:49.316600 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260806 09:20:49.317068 1993 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.255.124:33579: Network error: Client connection negotiation failed: client connection to 127.10.255.124:33579: connect: Connection refused (error 111)
I20260806 09:20:49.321823 2075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 09:20:49.322100 2075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 09:20:49.342911 2075 rpc_server.cc:307] RPC server started. Bound to: 127.10.255.124:33579
I20260806 09:20:49.342962 2141 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.255.124:33579 every 8 connection(s)
I20260806 09:20:49.344472 2075 server_base.cc:1166] Dumped server information to /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-2/data/info.pb
I20260806 09:20:49.348161 11261 external_mini_cluster.cc:1388] Started /tmp/dist-test-task5qcP_A/build/asan/bin/kudu as pid 2075
I20260806 09:20:49.348352 11261 external_mini_cluster.cc:1402] Reading /tmp/dist-test-task5qcP_A/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786007647474472-11261-0/minicluster-data/master-2/wal/instance
I20260806 09:20:49.348789 11261 external_mini_cluster.cc:1428] Setting key faa357cdce6453d066fb69b6e98ed473
I20260806 09:20:49.349159 2142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 09:20:49.359519 2142 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36673 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 09:20:49 dist-test-slave-mvvj krb5kdc[1913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.124@KRBTEST.COM
Aug 06 09:20:49 dist-test-slave-mvvj krb5kdc[1913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008049, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.124@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
I20260806 09:20:49.376576 2145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.350866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33368 (local address 127.10.255.124:33579)
0806 09:20:49.351703 (+ 837us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:49.351716 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:49.351761 (+ 45us) server_negotiation.cc:407] Connection header received
0806 09:20:49.354225 (+ 2464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:49.354250 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:49.354712 (+ 462us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:49.355094 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:49.357004 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.358351 (+ 1347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.360557 (+ 2206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.361394 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.361618 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:49.366458 (+ 4840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:49.366468 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:49.366483 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:49.366544 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:49.370939 (+ 4395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:49.371977 (+ 1038us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:49.371985 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:49.371993 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:49.372208 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:49.372694 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:49.372699 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:49.372703 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:49.373514 (+ 811us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:49.373814 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:49.374506 (+ 692us) server_negotiation.cc:299] Negotiation successful
0806 09:20:49.375006 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":394,"threads_started":1}
I20260806 09:20:49.382426 2146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.362681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.126:36673 (local address 127.0.0.1:46658)
0806 09:20:49.363455 (+ 774us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:49.363508 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:49.363661 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:49.364540 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:49.364547 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:49.365225 (+ 678us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:20:49.365551 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:49.365570 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.366872 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.366881 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:49.368534 (+ 1653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:49.368556 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.369969 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.369975 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:49.370137 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:49.370901 (+ 764us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:20:49.370922 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:20:49.374276 (+ 3354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:20:49.378736 (+ 4460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:49.378747 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:49.378755 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:49.379494 (+ 739us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:49.380135 (+ 641us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:49.380141 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:49.380144 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:49.380344 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:49.381228 (+ 884us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:20:49.381239 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:20:49.381481 (+ 242us) client_negotiation.cc:769] Sending connection context
0806 09:20:49.381737 (+ 256us) client_negotiation.cc:240] Negotiation successful
0806 09:20:49.382127 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":504,"thread_start_us":346,"threads_started":1}
I20260806 09:20:49.382799 2147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.362793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46658 (local address 127.10.255.126:36673)
0806 09:20:49.364166 (+ 1373us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:49.364170 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:49.364189 (+ 19us) server_negotiation.cc:407] Connection header received
0806 09:20:49.364252 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:49.364255 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:49.364316 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:49.364444 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:49.365720 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.366663 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.368756 (+ 2093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.369721 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.369872 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:49.374582 (+ 4710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:49.374590 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:49.374595 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:49.374640 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:49.378564 (+ 3924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:49.379691 (+ 1127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:49.379701 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:49.379706 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:49.379947 (+ 241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:49.380474 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:49.380480 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:49.380483 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:49.380910 (+ 427us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:49.381107 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:49.381922 (+ 815us) server_negotiation.cc:299] Negotiation successful
0806 09:20:49.382283 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1264,"thread_start_us":1136,"threads_started":1}
I20260806 09:20:49.384457 2142 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 09:20:49 dist-test-slave-mvvj krb5kdc[1913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.126@KRBTEST.COM
Aug 06 09:20:49 dist-test-slave-mvvj krb5kdc[1913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008049, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.124@KRBTEST.COM for kudu/127.10.255.125@KRBTEST.COM
I20260806 09:20:49.399731 2148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.380721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46660 (local address 127.10.255.126:36673)
0806 09:20:49.381446 (+ 725us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:49.381453 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:49.381478 (+ 25us) server_negotiation.cc:407] Connection header received
0806 09:20:49.381529 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:49.381534 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:49.381610 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:49.381724 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:49.384006 (+ 2282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.385026 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.387089 (+ 2063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.387761 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.387942 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:49.393306 (+ 5364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:49.393313 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:49.393316 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:49.393379 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:49.396566 (+ 3187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:49.397424 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:49.397429 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:49.397431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:49.397594 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:49.398026 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:49.398034 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:49.398037 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:49.398437 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:49.398735 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:49.399034 (+ 299us) server_negotiation.cc:299] Negotiation successful
0806 09:20:49.399263 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":567,"thread_start_us":331,"threads_started":1}
I20260806 09:20:49.400122 2146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.385379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.125:32969 (local address 127.0.0.1:49480)
0806 09:20:49.385631 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:49.385651 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:49.385768 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:49.386093 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:49.386098 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:49.386654 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:20:49.386858 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:49.386870 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.388349 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.388358 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:49.389871 (+ 1513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:49.389893 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.390698 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.390705 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:49.390944 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:49.391574 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:20:49.391592 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:20:49.393849 (+ 2257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:20:49.397123 (+ 3274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:49.397129 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:49.397134 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:49.397615 (+ 481us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:49.398047 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:49.398051 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:49.398054 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:49.398193 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:49.398849 (+ 656us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:20:49.398854 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:20:49.399058 (+ 204us) client_negotiation.cc:769] Sending connection context
0806 09:20:49.399220 (+ 162us) client_negotiation.cc:240] Negotiation successful
0806 09:20:49.399702 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111}
I20260806 09:20:49.400163 2072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.385520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49480 (local address 127.10.255.125:32969)
0806 09:20:49.385699 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:49.385703 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:49.385720 (+ 17us) server_negotiation.cc:407] Connection header received
0806 09:20:49.385887 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:49.385891 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:49.385953 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:49.386034 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:49.387082 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.388199 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.390051 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.390529 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.390678 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:49.394075 (+ 3397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:49.394082 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:49.394085 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:49.394120 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:49.396959 (+ 2839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:49.397754 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:49.397758 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:49.397760 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:49.397888 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:49.398304 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:49.398309 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:49.398312 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:49.398704 (+ 392us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:49.398850 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:49.399348 (+ 498us) server_negotiation.cc:299] Negotiation successful
0806 09:20:49.399678 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260806 09:20:49.401531 2142 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 09:20:49 dist-test-slave-mvvj krb5kdc[1913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008049, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.124@KRBTEST.COM for kudu/127.10.255.124@KRBTEST.COM
Aug 06 09:20:49 dist-test-slave-mvvj krb5kdc[1913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008047, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.255.125@KRBTEST.COM
I20260806 09:20:49.415334 2146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.402504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:33579 (local address 127.0.0.1:33382)
0806 09:20:49.402639 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:49.402652 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:49.402764 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:49.403089 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:49.403093 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:49.403498 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:20:49.403626 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:49.403635 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.404621 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.404628 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:49.405490 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:49.405501 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.406221 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.406228 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:49.406433 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:49.407052 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:20:49.407070 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:20:49.409441 (+ 2371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:20:49.412636 (+ 3195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:49.412640 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:49.412643 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:49.413213 (+ 570us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:49.413602 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:49.413607 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:49.413610 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:49.413776 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:49.414414 (+ 638us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:20:49.414420 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:20:49.414600 (+ 180us) client_negotiation.cc:769] Sending connection context
0806 09:20:49.414759 (+ 159us) client_negotiation.cc:240] Negotiation successful
0806 09:20:49.415033 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 09:20:49.415688 2145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.402368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33382 (local address 127.10.255.124:33579)
0806 09:20:49.402528 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:49.402532 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:49.402711 (+ 179us) server_negotiation.cc:407] Connection header received
0806 09:20:49.402879 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:49.402883 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:49.402945 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:49.403073 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:49.403758 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.404503 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.405624 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.406052 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.406181 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:49.409634 (+ 3453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:49.409639 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:49.409642 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:49.409672 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:49.412488 (+ 2816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:49.413343 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:49.413347 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:49.413350 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:49.413478 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:49.413894 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:49.413897 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:49.413899 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:49.414275 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:49.414389 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:49.414889 (+ 500us) server_negotiation.cc:299] Negotiation successful
0806 09:20:49.415265 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":72,"server-negotiator.queue_time_us":49}
I20260806 09:20:49.417929 2072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.401762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49486 (local address 127.10.255.125:32969)
0806 09:20:49.401919 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:49.401923 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:49.401938 (+ 15us) server_negotiation.cc:407] Connection header received
0806 09:20:49.402121 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:49.402129 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:49.402217 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:49.402314 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:49.403738 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.404523 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.405762 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.406208 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.406335 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:49.411173 (+ 4838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:49.411178 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:49.411182 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:49.411216 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:49.414638 (+ 3422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:49.415598 (+ 960us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:49.415604 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:49.415607 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:49.415787 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:49.416393 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:49.416397 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:49.416400 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:49.416727 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:49.417030 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:49.417347 (+ 317us) server_negotiation.cc:299] Negotiation successful
0806 09:20:49.417608 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 09:20:49.421820 2142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ad305866d0145b9a7ef6317634cd8b4: Bootstrap starting.
I20260806 09:20:49.423182 11261 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 09:20:49.425781 2142 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ad305866d0145b9a7ef6317634cd8b4: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:49.426931 2142 log.cc:824] T 00000000000000000000000000000000 P 3ad305866d0145b9a7ef6317634cd8b4: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:49.425815 1968 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "51ab83f1a7f9422db16a7face880c4e1"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46660
I20260806 09:20:49.430074 2142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ad305866d0145b9a7ef6317634cd8b4: No bootstrap required, opened a new log
I20260806 09:20:49.438014 2142 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ad305866d0145b9a7ef6317634cd8b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ab83f1a7f9422db16a7face880c4e1" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36673 } } peers { permanent_uuid: "176ea1e557524378991d9f051ab406c5" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } } peers { permanent_uuid: "3ad305866d0145b9a7ef6317634cd8b4" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } }
I20260806 09:20:49.438453 2142 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ad305866d0145b9a7ef6317634cd8b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ad305866d0145b9a7ef6317634cd8b4, State: Initialized, Role: FOLLOWER
I20260806 09:20:49.438930 2142 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ad305866d0145b9a7ef6317634cd8b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ab83f1a7f9422db16a7face880c4e1" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36673 } } peers { permanent_uuid: "176ea1e557524378991d9f051ab406c5" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } } peers { permanent_uuid: "3ad305866d0145b9a7ef6317634cd8b4" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } }
I20260806 09:20:49.440039 2150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ad305866d0145b9a7ef6317634cd8b4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ab83f1a7f9422db16a7face880c4e1" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36673 } } peers { permanent_uuid: "176ea1e557524378991d9f051ab406c5" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } } peers { permanent_uuid: "3ad305866d0145b9a7ef6317634cd8b4" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } } }
I20260806 09:20:49.440454 2150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ad305866d0145b9a7ef6317634cd8b4 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:20:49.441259 2142 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ad305866d0145b9a7ef6317634cd8b4 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 09:20:49.451551 2161 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3ad305866d0145b9a7ef6317634cd8b4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 09:20:49.451715 2161 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 09:20:49.449077 2075 master_runner.cc:186] Error getting master registration for 127.10.255.126:36673: OK, instance_id { permanent_uuid: "51ab83f1a7f9422db16a7face880c4e1" instance_seqno: 1786008048164167 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 09:20:49.457924 2075 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 09:20:49.465688 2067 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } attempt: 5
Aug 06 09:20:49 dist-test-slave-mvvj krb5kdc[1913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008048, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.125@KRBTEST.COM for kudu/127.10.255.124@KRBTEST.COM
I20260806 09:20:49.482466 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.466484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:33579 (local address 127.0.0.1:33392)
0806 09:20:49.466832 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:49.466859 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:49.467003 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:49.467357 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:49.467363 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:49.468021 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:20:49.468280 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:49.468295 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.469481 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.469492 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:49.471068 (+ 1576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:49.471087 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.471896 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.471903 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:49.472164 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:49.472915 (+ 751us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:20:49.472952 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:20:49.476082 (+ 3130us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:20:49.479762 (+ 3680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:49.479768 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:49.479772 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:49.480241 (+ 469us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:49.480630 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:49.480636 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:49.480639 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:49.480813 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:49.481412 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:20:49.481416 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:20:49.481590 (+ 174us) client_negotiation.cc:769] Sending connection context
0806 09:20:49.481736 (+ 146us) client_negotiation.cc:240] Negotiation successful
0806 09:20:49.482060 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203}
I20260806 09:20:49.482465 2145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.466715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33392 (local address 127.10.255.124:33579)
0806 09:20:49.466921 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:49.466926 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:49.466944 (+ 18us) server_negotiation.cc:407] Connection header received
0806 09:20:49.467131 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:49.467135 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:49.467199 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:49.467294 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:49.468449 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.469290 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.471228 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.471707 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.471804 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:49.476298 (+ 4494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:49.476303 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:49.476306 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:49.476344 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:49.479604 (+ 3260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:49.480365 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:49.480371 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:49.480375 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:49.480510 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:49.480931 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:49.480936 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:49.480947 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:49.481276 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:49.481460 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:49.481863 (+ 403us) server_negotiation.cc:299] Negotiation successful
0806 09:20:49.482093 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 09:20:49.487396 2067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 176ea1e557524378991d9f051ab406c5: Bootstrap starting.
I20260806 09:20:49.490679 2067 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 176ea1e557524378991d9f051ab406c5: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:49.491745 2067 log.cc:824] T 00000000000000000000000000000000 P 176ea1e557524378991d9f051ab406c5: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:49.494526 2067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 176ea1e557524378991d9f051ab406c5: No bootstrap required, opened a new log
I20260806 09:20:49.502528 2067 raft_consensus.cc:348] T 00000000000000000000000000000000 P 176ea1e557524378991d9f051ab406c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ab83f1a7f9422db16a7face880c4e1" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36673 } } peers { permanent_uuid: "176ea1e557524378991d9f051ab406c5" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } } peers { permanent_uuid: "3ad305866d0145b9a7ef6317634cd8b4" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } }
I20260806 09:20:49.502915 2067 raft_consensus.cc:729] T 00000000000000000000000000000000 P 176ea1e557524378991d9f051ab406c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 176ea1e557524378991d9f051ab406c5, State: Initialized, Role: FOLLOWER
I20260806 09:20:49.503435 2067 consensus_queue.cc:260] T 00000000000000000000000000000000 P 176ea1e557524378991d9f051ab406c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ab83f1a7f9422db16a7face880c4e1" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36673 } } peers { permanent_uuid: "176ea1e557524378991d9f051ab406c5" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } } peers { permanent_uuid: "3ad305866d0145b9a7ef6317634cd8b4" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } }
I20260806 09:20:49.504580 2164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 176ea1e557524378991d9f051ab406c5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ab83f1a7f9422db16a7face880c4e1" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36673 } } peers { permanent_uuid: "176ea1e557524378991d9f051ab406c5" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } } peers { permanent_uuid: "3ad305866d0145b9a7ef6317634cd8b4" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } } }
I20260806 09:20:49.505028 2164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 176ea1e557524378991d9f051ab406c5 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:20:49.505888 2067 sys_catalog.cc:564] T 00000000000000000000000000000000 P 176ea1e557524378991d9f051ab406c5 [sys.catalog]: configured and running, proceeding with master startup.
W20260806 09:20:49.517062 2175 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 176ea1e557524378991d9f051ab406c5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 09:20:49.517225 2175 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 09:20:49.513859 2000 master_runner.cc:186] Error getting master registration for 127.10.255.126:36673: OK, instance_id { permanent_uuid: "51ab83f1a7f9422db16a7face880c4e1" instance_seqno: 1786008048164167 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 09:20:49.527169 2000 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260806 09:20:49.574479 2096 tablet.cc:2369] T 00000000000000000000000000000000 P 3ad305866d0145b9a7ef6317634cd8b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:20:49.594260 1993 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } attempt: 5
Aug 06 09:20:49 dist-test-slave-mvvj krb5kdc[1913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786008048, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.255.126@KRBTEST.COM for kudu/127.10.255.124@KRBTEST.COM
I20260806 09:20:49.614241 1996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.595173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.255.124:33579 (local address 127.0.0.1:33404)
0806 09:20:49.595686 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0806 09:20:49.595709 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0806 09:20:49.595872 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 09:20:49.596340 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 09:20:49.596348 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 09:20:49.596921 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0806 09:20:49.597151 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:49.597208 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.598732 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.598740 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:49.600390 (+ 1650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 09:20:49.600407 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.601840 (+ 1433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.601847 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 09:20:49.602052 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:49.602810 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 09:20:49.602851 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0806 09:20:49.606103 (+ 3252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 09:20:49.610941 (+ 4838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:49.610950 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:49.610956 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:49.611520 (+ 564us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:49.612085 (+ 565us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 09:20:49.612090 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 09:20:49.612094 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0806 09:20:49.612294 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 09:20:49.613093 (+ 799us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 09:20:49.613099 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 09:20:49.613301 (+ 202us) client_negotiation.cc:769] Sending connection context
0806 09:20:49.613465 (+ 164us) client_negotiation.cc:240] Negotiation successful
0806 09:20:49.613797 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351}
I20260806 09:20:49.615507 2145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.595705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33404 (local address 127.10.255.124:33579)
0806 09:20:49.595924 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:49.595930 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:49.595965 (+ 35us) server_negotiation.cc:407] Connection header received
0806 09:20:49.596036 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:49.596041 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:49.596162 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:49.596295 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:49.597395 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.598573 (+ 1178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.600609 (+ 2036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.601405 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.601538 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:49.606376 (+ 4838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:49.606384 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:49.606390 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:49.606437 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:49.610576 (+ 4139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:49.611708 (+ 1132us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:49.611715 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:49.611719 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:49.611928 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:49.612433 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:49.612439 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:49.612442 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:49.612864 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:49.613023 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:49.614834 (+ 1811us) server_negotiation.cc:299] Negotiation successful
0806 09:20:49.615117 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 09:20:49.622635 1993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1: Bootstrap starting.
I20260806 09:20:49.627457 1993 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1: Neither blocks nor log segments found. Creating new log.
I20260806 09:20:49.629386 1993 log.cc:824] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1: Log is configured to *not* fsync() on all Append() calls
I20260806 09:20:49.633908 1993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1: No bootstrap required, opened a new log
I20260806 09:20:49.642614 1993 raft_consensus.cc:348] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ab83f1a7f9422db16a7face880c4e1" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36673 } } peers { permanent_uuid: "176ea1e557524378991d9f051ab406c5" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } } peers { permanent_uuid: "3ad305866d0145b9a7ef6317634cd8b4" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } }
I20260806 09:20:49.643211 1993 raft_consensus.cc:729] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51ab83f1a7f9422db16a7face880c4e1, State: Initialized, Role: FOLLOWER
I20260806 09:20:49.643927 1993 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ab83f1a7f9422db16a7face880c4e1" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36673 } } peers { permanent_uuid: "176ea1e557524378991d9f051ab406c5" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } } peers { permanent_uuid: "3ad305866d0145b9a7ef6317634cd8b4" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } }
I20260806 09:20:49.645437 2178 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ab83f1a7f9422db16a7face880c4e1" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36673 } } peers { permanent_uuid: "176ea1e557524378991d9f051ab406c5" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } } peers { permanent_uuid: "3ad305866d0145b9a7ef6317634cd8b4" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } } }
I20260806 09:20:49.646111 2178 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:20:49.646855 1993 sys_catalog.cc:564] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 09:20:49.646941 1968 raft_consensus.cc:482] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 09:20:49.647156 1968 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:49.650817 1968 raft_consensus.cc:504] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ab83f1a7f9422db16a7face880c4e1" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36673 } } peers { permanent_uuid: "176ea1e557524378991d9f051ab406c5" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } } peers { permanent_uuid: "3ad305866d0145b9a7ef6317634cd8b4" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } }
W20260806 09:20:49.652468 1947 tablet.cc:2369] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:20:49.653502 2042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "51ab83f1a7f9422db16a7face880c4e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "176ea1e557524378991d9f051ab406c5"
I20260806 09:20:49.654089 2042 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 176ea1e557524378991d9f051ab406c5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:49.657945 2042 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 176ea1e557524378991d9f051ab406c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51ab83f1a7f9422db16a7face880c4e1 in term 1.
I20260806 09:20:49.658805 1943 leader_election.cc:302] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 176ea1e557524378991d9f051ab406c5, 51ab83f1a7f9422db16a7face880c4e1; no voters:
I20260806 09:20:49.660174 1968 leader_election.cc:288] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1 [CANDIDATE]: Term 1 election: Requested vote from peers 176ea1e557524378991d9f051ab406c5 (127.10.255.125:32969), 3ad305866d0145b9a7ef6317634cd8b4 (127.10.255.124:33579)
I20260806 09:20:49.660887 2178 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 09:20:49.660601 2117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "51ab83f1a7f9422db16a7face880c4e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3ad305866d0145b9a7ef6317634cd8b4"
I20260806 09:20:49.661247 2117 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ad305866d0145b9a7ef6317634cd8b4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 09:20:49.665791 2117 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3ad305866d0145b9a7ef6317634cd8b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51ab83f1a7f9422db16a7face880c4e1 in term 1.
I20260806 09:20:49.669217 2178 raft_consensus.cc:686] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1 [term 1 LEADER]: Becoming Leader. State: Replica: 51ab83f1a7f9422db16a7face880c4e1, State: Running, Role: LEADER
I20260806 09:20:49.669878 2178 consensus_queue.cc:237] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ab83f1a7f9422db16a7face880c4e1" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36673 } } peers { permanent_uuid: "176ea1e557524378991d9f051ab406c5" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } } peers { permanent_uuid: "3ad305866d0145b9a7ef6317634cd8b4" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } }
I20260806 09:20:49.679024 2181 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51ab83f1a7f9422db16a7face880c4e1. Latest consensus state: current_term: 1 leader_uuid: "51ab83f1a7f9422db16a7face880c4e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ab83f1a7f9422db16a7face880c4e1" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36673 } } peers { permanent_uuid: "176ea1e557524378991d9f051ab406c5" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } } peers { permanent_uuid: "3ad305866d0145b9a7ef6317634cd8b4" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } } }
I20260806 09:20:49.679697 2181 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1 [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:49.686174 2188 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260806 09:20:49.707036 2021 tablet.cc:2369] T 00000000000000000000000000000000 P 176ea1e557524378991d9f051ab406c5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 09:20:49.714172 2188 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 09:20:49.731383 2072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.684603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49502 (local address 127.10.255.125:32969)
0806 09:20:49.684859 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:49.684867 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:49.689791 (+ 4924us) server_negotiation.cc:407] Connection header received
0806 09:20:49.690128 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:49.690136 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:49.690230 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:49.690331 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:49.700039 (+ 9708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.701352 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.704002 (+ 2650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.704786 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.704917 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:49.716718 (+ 11801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:49.716727 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:49.716733 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:49.716795 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:49.721345 (+ 4550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:49.727995 (+ 6650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:49.728006 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:49.728012 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:49.728258 (+ 246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:49.728937 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:49.728947 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:49.728951 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:49.729465 (+ 514us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:49.729827 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:49.730599 (+ 772us) server_negotiation.cc:299] Negotiation successful
0806 09:20:49.730923 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260806 09:20:49.735921 2202 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 09:20:49.744753 2145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.685219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33414 (local address 127.10.255.124:33579)
0806 09:20:49.685469 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:49.685476 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:49.700368 (+ 14892us) server_negotiation.cc:407] Connection header received
0806 09:20:49.700686 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:49.700693 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:49.700815 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:49.700896 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:49.712120 (+ 11224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.713403 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.726038 (+ 12635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.726875 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.727008 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:49.735414 (+ 8406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:49.735422 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:49.735428 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:49.735482 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:49.740705 (+ 5223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:49.741796 (+ 1091us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:49.741803 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:49.741807 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:49.741981 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:49.742533 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:49.742539 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:49.742542 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:49.742956 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:49.743253 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:49.743938 (+ 685us) server_negotiation.cc:299] Negotiation successful
0806 09:20:49.744241 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 09:20:49.749809 2117 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3ad305866d0145b9a7ef6317634cd8b4 [term 1 FOLLOWER]: Refusing update from remote peer 51ab83f1a7f9422db16a7face880c4e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:20:49.750589 2042 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 176ea1e557524378991d9f051ab406c5 [term 1 FOLLOWER]: Refusing update from remote peer 51ab83f1a7f9422db16a7face880c4e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 09:20:49.750855 2181 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ad305866d0145b9a7ef6317634cd8b4" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:20:49.751787 2181 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "176ea1e557524378991d9f051ab406c5" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 09:20:49.764042 2148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:49.683815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46664 (local address 127.10.255.126:36673)
0806 09:20:49.684087 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:49.684095 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:49.696493 (+ 12398us) server_negotiation.cc:407] Connection header received
0806 09:20:49.696827 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:49.696834 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:49.696960 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:49.697072 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:49.708149 (+ 11077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.709483 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.715799 (+ 6316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:49.716628 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:49.716744 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:49.732263 (+ 15519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 09:20:49.732272 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 09:20:49.732277 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 09:20:49.732329 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0806 09:20:49.749232 (+ 16903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:49.759935 (+ 10703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:49.759946 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:49.759955 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:49.760174 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 09:20:49.761187 (+ 1013us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 09:20:49.761193 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 09:20:49.761197 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0806 09:20:49.761659 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 09:20:49.761944 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:49.763230 (+ 1286us) server_negotiation.cc:299] Negotiation successful
0806 09:20:49.763539 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260806 09:20:49.786232 2164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 176ea1e557524378991d9f051ab406c5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51ab83f1a7f9422db16a7face880c4e1. Latest consensus state: current_term: 1 leader_uuid: "51ab83f1a7f9422db16a7face880c4e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ab83f1a7f9422db16a7face880c4e1" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36673 } } peers { permanent_uuid: "176ea1e557524378991d9f051ab406c5" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } } peers { permanent_uuid: "3ad305866d0145b9a7ef6317634cd8b4" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } } }
I20260806 09:20:49.786616 2164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 176ea1e557524378991d9f051ab406c5 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:20:49.790962 2201 mvcc.cc:205] Tried to move back new op lower bound from 7315488971748601856 to 7315488971455688704. Current Snapshot: MvccSnapshot[applied={T|T < 7315488971748601856}]
I20260806 09:20:49.799687 2204 mvcc.cc:205] Tried to move back new op lower bound from 7315488971748601856 to 7315488971455688704. Current Snapshot: MvccSnapshot[applied={T|T < 7315488971748601856}]
I20260806 09:20:49.802862 2164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 176ea1e557524378991d9f051ab406c5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "51ab83f1a7f9422db16a7face880c4e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ab83f1a7f9422db16a7face880c4e1" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36673 } } peers { permanent_uuid: "176ea1e557524378991d9f051ab406c5" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } } peers { permanent_uuid: "3ad305866d0145b9a7ef6317634cd8b4" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } } }
I20260806 09:20:49.803174 2164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 176ea1e557524378991d9f051ab406c5 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:20:49.809572 2181 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "51ab83f1a7f9422db16a7face880c4e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ab83f1a7f9422db16a7face880c4e1" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36673 } } peers { permanent_uuid: "176ea1e557524378991d9f051ab406c5" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } } peers { permanent_uuid: "3ad305866d0145b9a7ef6317634cd8b4" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } } }
I20260806 09:20:49.809904 2181 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1 [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:49.815203 2150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ad305866d0145b9a7ef6317634cd8b4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51ab83f1a7f9422db16a7face880c4e1. Latest consensus state: current_term: 1 leader_uuid: "51ab83f1a7f9422db16a7face880c4e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ab83f1a7f9422db16a7face880c4e1" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36673 } } peers { permanent_uuid: "176ea1e557524378991d9f051ab406c5" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } } peers { permanent_uuid: "3ad305866d0145b9a7ef6317634cd8b4" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } } }
I20260806 09:20:49.815613 2150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ad305866d0145b9a7ef6317634cd8b4 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:20:49.818456 2178 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "51ab83f1a7f9422db16a7face880c4e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ab83f1a7f9422db16a7face880c4e1" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36673 } } peers { permanent_uuid: "176ea1e557524378991d9f051ab406c5" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } } peers { permanent_uuid: "3ad305866d0145b9a7ef6317634cd8b4" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } } }
I20260806 09:20:49.818817 2178 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1 [sys.catalog]: This master's current role is: LEADER
I20260806 09:20:49.820101 2188 catalog_manager.cc:1347] Generated new cluster ID: 2e38aad639834a08b6f9e6fabb0f2275
I20260806 09:20:49.820233 2188 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 09:20:49.839206 2188 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 09:20:49.841441 2188 catalog_manager.cc:1504] Loading token signing keys...
I20260806 09:20:49.848500 2150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ad305866d0145b9a7ef6317634cd8b4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "51ab83f1a7f9422db16a7face880c4e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51ab83f1a7f9422db16a7face880c4e1" member_type: VOTER last_known_addr { host: "127.10.255.126" port: 36673 } } peers { permanent_uuid: "176ea1e557524378991d9f051ab406c5" member_type: VOTER last_known_addr { host: "127.10.255.125" port: 32969 } } peers { permanent_uuid: "3ad305866d0145b9a7ef6317634cd8b4" member_type: VOTER last_known_addr { host: "127.10.255.124" port: 33579 } } }
I20260806 09:20:49.848800 2150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ad305866d0145b9a7ef6317634cd8b4 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 09:20:49.890972 2188 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 51ab83f1a7f9422db16a7face880c4e1: Generated new TSK 0
I20260806 09:20:49.892320 2188 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 09:20:50.035297 2148 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:20:50.018895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46668 (local address 127.10.255.126:36673)
0806 09:20:50.019119 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:50.019128 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:50.032655 (+ 13527us) server_negotiation.cc:407] Connection header received
0806 09:20:50.033037 (+ 382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:50.033046 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:50.033180 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:50.033263 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:50.034868 (+ 1605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46668: BlockingRecv error: recv got EOF from 127.0.0.1:46668 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260806 09:20:50.038273 2072 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:20:50.020298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49508 (local address 127.10.255.125:32969)
0806 09:20:50.020535 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:50.020543 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:50.036397 (+ 15854us) server_negotiation.cc:407] Connection header received
0806 09:20:50.036710 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:50.036717 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:50.036829 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:50.036930 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:50.037968 (+ 1038us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49508: BlockingRecv error: recv got EOF from 127.0.0.1:49508 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260806 09:20:50.039093 2145 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:20:50.033620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33418 (local address 127.10.255.124:33579)
0806 09:20:50.033836 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:50.033842 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:50.036475 (+ 2633us) server_negotiation.cc:407] Connection header received
0806 09:20:50.037584 (+ 1109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:50.037590 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:50.037694 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:50.037779 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:50.038852 (+ 1073us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33418: BlockingRecv error: recv got EOF from 127.0.0.1:33418 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
W20260806 09:20:50.083907 2072 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:20:50.070349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49516 (local address 127.10.255.125:32969)
0806 09:20:50.070556 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:50.070580 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:50.081413 (+ 10833us) server_negotiation.cc:407] Connection header received
0806 09:20:50.082074 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:50.082082 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:50.082270 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:50.082359 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:50.083595 (+ 1236us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49516: BlockingRecv error: recv got EOF from 127.0.0.1:49516 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260806 09:20:50.145241 2072 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:20:50.124425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49526 (local address 127.10.255.125:32969)
0806 09:20:50.124659 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:50.124667 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:50.142577 (+ 17910us) server_negotiation.cc:407] Connection header received
0806 09:20:50.143278 (+ 701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:50.143286 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:50.143390 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:50.143471 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:50.144962 (+ 1491us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49526: BlockingRecv error: recv got EOF from 127.0.0.1:49526 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
W20260806 09:20:50.203996 2072 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:20:50.197480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49540 (local address 127.10.255.125:32969)
0806 09:20:50.197728 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:50.197738 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:50.201879 (+ 4141us) server_negotiation.cc:407] Connection header received
0806 09:20:50.202272 (+ 393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:50.202281 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:50.202387 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:50.202470 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:50.203632 (+ 1162us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49540: BlockingRecv error: recv got EOF from 127.0.0.1:49540 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260806 09:20:50.230121 2072 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:20:50.226880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49550 (local address 127.10.255.125:32969)
0806 09:20:50.227642 (+ 762us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:50.227649 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:50.228125 (+ 476us) server_negotiation.cc:407] Connection header received
0806 09:20:50.228500 (+ 375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:50.228507 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:50.228608 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:50.228693 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:50.229845 (+ 1152us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49550: BlockingRecv error: recv got EOF from 127.0.0.1:49550 (error 108)
Metrics: {"server-negotiator.queue_time_us":563}
W20260806 09:20:50.287075 2072 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:20:50.273721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49552 (local address 127.10.255.125:32969)
0806 09:20:50.273929 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:50.273935 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:50.284760 (+ 10825us) server_negotiation.cc:407] Connection header received
0806 09:20:50.285357 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:50.285365 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:50.285488 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:50.285575 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:50.286784 (+ 1209us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49552: BlockingRecv error: recv got EOF from 127.0.0.1:49552 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260806 09:20:50.349960 2072 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:20:50.335772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49560 (local address 127.10.255.125:32969)
0806 09:20:50.336039 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:50.336048 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:50.347374 (+ 11326us) server_negotiation.cc:407] Connection header received
0806 09:20:50.347769 (+ 395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:50.347777 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:50.347936 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:50.348033 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:50.349680 (+ 1647us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49560: BlockingRecv error: recv got EOF from 127.0.0.1:49560 (error 108)
Metrics: {"server-negotiator.queue_time_us":116}
W20260806 09:20:50.390233 2072 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:20:50.387111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49566 (local address 127.10.255.125:32969)
0806 09:20:50.387626 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:50.387635 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:50.388396 (+ 761us) server_negotiation.cc:407] Connection header received
0806 09:20:50.388676 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:50.388683 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:50.388789 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:50.388904 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:50.389949 (+ 1045us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49566: BlockingRecv error: recv got EOF from 127.0.0.1:49566 (error 108)
Metrics: {"server-negotiator.queue_time_us":331}
I20260806 09:20:50.454037 2161 catalog_manager.cc:1259] Loaded cluster ID: 2e38aad639834a08b6f9e6fabb0f2275
I20260806 09:20:50.454190 2161 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3ad305866d0145b9a7ef6317634cd8b4: loading cluster ID for follower catalog manager: success
I20260806 09:20:50.458421 2161 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3ad305866d0145b9a7ef6317634cd8b4: acquiring CA information for follower catalog manager: success
I20260806 09:20:50.461897 2161 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3ad305866d0145b9a7ef6317634cd8b4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260806 09:20:50.462430 2072 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 09:20:50.459663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49576 (local address 127.10.255.125:32969)
0806 09:20:50.459914 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:50.459923 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:50.460587 (+ 664us) server_negotiation.cc:407] Connection header received
0806 09:20:50.460817 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:50.460826 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:50.460958 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:50.461106 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0806 09:20:50.462108 (+ 1002us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49576: BlockingRecv error: recv got EOF from 127.0.0.1:49576 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
I20260806 09:20:50.519484 2175 catalog_manager.cc:1259] Loaded cluster ID: 2e38aad639834a08b6f9e6fabb0f2275
I20260806 09:20:50.519603 2175 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 176ea1e557524378991d9f051ab406c5: loading cluster ID for follower catalog manager: success
I20260806 09:20:50.522450 2175 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 176ea1e557524378991d9f051ab406c5: acquiring CA information for follower catalog manager: success
I20260806 09:20:50.524606 2175 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 176ea1e557524378991d9f051ab406c5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 09:20:50.602267 2072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:50.595304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49590 (local address 127.10.255.125:32969)
0806 09:20:50.595588 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:50.595594 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:50.596069 (+ 475us) server_negotiation.cc:407] Connection header received
0806 09:20:50.596297 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:50.596302 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:50.596504 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:50.596648 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:20:50.597144 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:50.597858 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:50.599454 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:50.599941 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:50.600073 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:50.600828 (+ 755us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:20:50.601497 (+ 669us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:20:50.601620 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:50.601828 (+ 208us) server_negotiation.cc:299] Negotiation successful
0806 09:20:50.601908 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260806 09:20:50.615192 2270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:50.608848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33424 (local address 127.10.255.124:33579)
0806 09:20:50.609447 (+ 599us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:50.609455 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:50.609591 (+ 136us) server_negotiation.cc:407] Connection header received
0806 09:20:50.609862 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:50.609867 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:50.610028 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:50.610220 (+ 192us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:20:50.610672 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:50.611399 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:50.612812 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:50.613222 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:50.613372 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:50.613911 (+ 539us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:20:50.614487 (+ 576us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:20:50.614659 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:50.614767 (+ 108us) server_negotiation.cc:299] Negotiation successful
0806 09:20:50.614858 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":362,"threads_started":1}
I20260806 09:20:50.629994 2270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:50.621786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33440 (local address 127.10.255.124:33579)
0806 09:20:50.622056 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:50.622067 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:50.623334 (+ 1267us) server_negotiation.cc:407] Connection header received
0806 09:20:50.623638 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:50.623644 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:50.623738 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:50.623816 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:20:50.624827 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:50.625839 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:50.627995 (+ 2156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:50.628438 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:50.628581 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:50.629175 (+ 594us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:20:50.629315 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:20:50.629403 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:50.629595 (+ 192us) server_negotiation.cc:299] Negotiation successful
0806 09:20:50.629685 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260806 09:20:50.630406 2072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:50.621789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49604 (local address 127.10.255.125:32969)
0806 09:20:50.622084 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:50.622092 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:50.622778 (+ 686us) server_negotiation.cc:407] Connection header received
0806 09:20:50.623071 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:50.623079 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:50.623196 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:50.623278 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:20:50.624148 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:50.625304 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:50.627730 (+ 2426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:50.628484 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:50.628627 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:50.629360 (+ 733us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:20:50.629546 (+ 186us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:20:50.629639 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:50.630008 (+ 369us) server_negotiation.cc:299] Negotiation successful
0806 09:20:50.630087 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260806 09:20:50.631991 2276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 09:20:50.621695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46674 (local address 127.10.255.126:36673)
0806 09:20:50.623609 (+ 1914us) server_negotiation.cc:206] Beginning negotiation
0806 09:20:50.623616 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 09:20:50.624705 (+ 1089us) server_negotiation.cc:407] Connection header received
0806 09:20:50.625011 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 09:20:50.625015 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 09:20:50.625187 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 09:20:50.625386 (+ 199us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 09:20:50.626024 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:50.626817 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:50.629208 (+ 2391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 09:20:50.629873 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 09:20:50.630003 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 09:20:50.630749 (+ 746us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 09:20:50.631206 (+ 457us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 09:20:50.631291 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 09:20:50.631554 (+ 263us) server_negotiation.cc:299] Negotiation successful
0806 09:20:50.631647 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1755,"thread_start_us":1638,"threads_started":1}
I20260806 09:20:50.637759 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 1926
I20260806 09:20:50.638942 1988 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:20:50.757733 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 1926
I20260806 09:20:50.780018 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 2000
I20260806 09:20:50.781101 2062 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:20:50.897625 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 2000
I20260806 09:20:50.920791 11261 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-task5qcP_A/build/asan/bin/kudu pid 2075
I20260806 09:20:50.922139 2137 generic_service.cc:196] Checking for leaks (request via RPC)
I20260806 09:20:51.034296 11261 external_mini_cluster.cc:1595] Killing /tmp/dist-test-task5qcP_A/build/asan/bin/kudu with pid 2075
2026-08-06T09:20:51Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (4837 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (9826 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (403462 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST